GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Main page
  • Contents
  • Current events
  • Random article
  • About Wikipedia
  • Contact us
  • Help
  • Learn to edit
  • Community portal
  • Recent changes
  • Upload file
  • Special pages
  • Search
  • Donate

This view

  • Original page
  • New address

GeezerVison is showing en.wikipedia.org — Truecasing - Wikipedia

icon
This article needs more citations. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.
Find sources: "Truecasing" – news · newspapers · books · scholar · JSTOR
(October 2010) (Learn how and when to remove this message)

Truecasing, also called capitalization recovery,[1] capitalization correction,[2] or case restoration,[3] is the problem in natural language processing (NLP) of determining the proper capitalization of words where such information is unavailable. This commonly comes up due to the standard practice (in English and many other languages) of automatically capitalizing the first word of a sentence. It can also arise in badly cased or noncased text (for example, all-lowercase or all-uppercase text messages).

Truecasing is only necessary for orthographies that have casing. This includes most languages written in the Latin, Greek, Cyrillic and Armenian scripts.

Techniques

  • Neural networks that operate at the word level or the character level have been trained to recover capitalization with greater than 90% accuracy.
  • Sentence segmentation can be used to determine where sentences begin, to implement the rule that the first word of every sentence must be capitalized.
  • Part-of-speech tagging can be used to identify proper nouns (such as Africa, Jupiter, Sarah, or Amazon), which must be capitalized. In some cases, the same word can be used as different parts of speech, and is capitalized differently. For example, Xerox the company, as a noun, is capitalized, but to xerox a document, as a verb, is not capitalized. A xerox, as in the copy of a document, can be recognized by the presence of a determiner, which is not used for proper nouns.
  • Named entity recognition can be used to identify proper nouns, which must be capitalized.
  • A spell checker can be used to identify words that are always capitalized.

Applications

Truecasing aids in other NLP tasks, such as named entity recognition (NER), automatic content extraction (ACE), and machine translation.[4] Proper capitalization allows easier detection of proper nouns, which are the starting points of NER and ACE. Some translation systems use statistical machine learning techniques, which could make use of the information contained in capitalization to increase accuracy.

See also

  • Sentence case
  • Title case

References

  1. ↑ Brown, Eric W.; Coden, Anni R. (2002). "Capitalization Recovery for Text". Information Retrieval Techniques for Speech Applications. Lecture Notes in Computer Science. Vol. 2273. pp. 11–22. doi:10.1007/3-540-45637-6_2. ISBN 978-3-540-43156-5.
  2. ↑ US patent 7,827,025 B2, Peter K. L. Mau & Dong Yu, "Efficient capitalization through user modeling", issued 2010-11-02, assigned to Microsoft Corporation 
  3. ↑ US patent 8,972,855 B2, Zhu Liu; David Gibbon & Behzad Shahraray, "Method and apparatus for providing case restoration", issued 2015-03-03, assigned to AT&T Intellectual Property I, L.P. 
  4. ↑ Lita, L. V.; Ittycheriah, A.; Roukos, S.; Kambhatla, N. (2003). "tRuEcasIng". Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics. Sapporo, Japan. pp. 152–159.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Truecasing&oldid=1340496476"
Category:
  • Tasks of natural language processing
Hidden categories:
  • Articles needing additional references from October 2010
  • All articles needing additional references
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.