GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Main page
  • Contents
  • Current events
  • Random article
  • About Wikipedia
  • Contact us
  • Help
  • Learn to edit
  • Community portal
  • Recent changes
  • Upload file
  • Special pages
  • Search
  • Donate

This view

  • Original page
  • New address

GeezerVison is showing en.wikipedia.org — Statistical semantics - Wikipedia

In linguistics, statistical semantics applies the methods of statistics to the problem of determining the meaning of words or phrases, ideally through unsupervised learning, to a degree of precision at least sufficient for the purpose of information retrieval.

History

The term statistical semantics was first used by Warren Weaver in his well-known paper on machine translation.[1] He argued that word-sense disambiguation for machine translation should be based on the co-occurrence frequency of the context words near a given target word. The underlying assumption that "a word is characterized by the company it keeps" was advocated by J. R. Firth.[2] This assumption is known in linguistics as the distributional hypothesis.[3] Emile Delavenay defined statistical semantics as the "statistical study of the meanings of words and their frequency and order of recurrence".[4] "Furnas et al. 1983" is frequently cited as a foundational contribution to statistical semantics.[5] An early success in the field was latent semantic analysis.

Applications

Research in statistical semantics has resulted in a wide variety of algorithms that use the distributional hypothesis to discover many aspects of semantics, by applying statistical techniques to large corpora:

  • Measuring the similarity in word meanings[6][7][8][9]
  • Measuring the similarity in word relations [10]
  • Modeling similarity-based generalization[11]
  • Discovering words with a given relation[12]
  • Classifying relations between words[13]
  • Extracting keywords from documents[14][15]
  • Measuring the cohesiveness of text[16]
  • Discovering the different senses of words[17]
  • Distinguishing the different senses of words[18]
  • Subcognitive aspects of words[19]
  • Distinguishing praise from criticism[20]

Related fields

Statistical semantics focuses on the meanings of common words and the relations between common words, unlike text mining, which tends to focus on whole documents, document collections, or named entities (names of people, places, and organizations). Statistical semantics is a subfield of computational semantics, which is in turn a subfield of computational linguistics and natural language processing.

Many of the applications of statistical semantics (listed above) can also be addressed by lexicon-based algorithms, instead of the corpus-based algorithms of statistical semantics. One advantage of corpus-based algorithms is that they are typically not as labour-intensive as lexicon-based algorithms. Another advantage is that they are usually easier to adapt to new languages or noisier new text types from e.g. social media than lexicon-based algorithms are.[21] However, the best performance on an application is often achieved by combining the two approaches.[22]

See also

  • Co-occurrence
  • Computational linguistics
  • Information retrieval
  • Latent semantic analysis
  • Latent semantic indexing
  • Semantic analytics
  • Semantic similarity
  • Statistical natural language processing
  • Text corpus
  • Text mining
  • Web mining

References

  1. ↑ Weaver 1955
  2. ↑ Firth 1957
  3. ↑ Sahlgren 2008
  4. ↑ Delavenay 1960
  5. ↑ Furnas et al. 1983
  6. ↑ Lund, Burgess & Atchley 1995
  7. ↑ Landauer & Dumais 1997
  8. ↑ McDonald & Ramscar 2001
  9. ↑ Terra & Clarke 2003
  10. ↑ Turney 2006
  11. ↑ Yarlett 2008
  12. ↑ Hearst 1992
  13. ↑ Turney & Littman 2005
  14. ↑ Frank et al. 1999
  15. ↑ Turney 2000
  16. ↑ Turney 2003
  17. ↑ Pantel & Lin 2002
  18. ↑ Turney 2004
  19. ↑ Turney 2001
  20. ↑ Turney & Littman 2003
  21. ↑ Sahlgren & Karlgren 2009
  22. ↑ Turney et al. 2003

Sources

  • Delavenay, Emile (1960). An Introduction to Machine Translation. New York, NY: Thames and Hudson. OCLC 1001646.
  • Firth, John R. (1957). "A synopsis of linguistic theory 1930-1955". Studies in Linguistic Analysis. Oxford: Philological Society: 1–32.
    Reprinted in Palmer, F.R., ed. (1968). Selected Papers of J.R. Firth 1952-1959. London: Longman. OCLC 123573912.
  • Frank, Eibe; Paynter, Gordon W.; Witten, Ian H.; Gutwin, Carl; Nevill-Manning, Craig G. (1999). "Domain-specific keyphrase extraction". Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence. IJCAI-99. Vol. 2. California: Morgan Kaufmann. pp. 668–673. CiteSeerX 10.1.1.148.3598. ISBN 1-55860-613-0. {{cite conference}}: Cite uses deprecated parameter |citeseerx= (help)
  • Furnas, George W.; Landauer, T. K.; Gomez, L. M.; Dumais, S. T. (1983). "Statistical semantics: Analysis of the potential performance of keyword information systems" (PDF). Bell System Technical Journal. 62 (6): 1753–1806. doi:10.1002/j.1538-7305.1983.tb03513.x. S2CID 22483184. Archived from the original (PDF) on 2016-03-04. Retrieved 2012-07-12.
  • Hearst, Marti A. (1992). "Automatic Acquisition of Hyponyms from Large Text Corpora" (PDF). Proceedings of the Fourteenth International Conference on Computational Linguistics. COLING '92. Nantes, France. pp. 539–545. doi:10.3115/992133.992154. Archived (PDF) from the original on 2012-05-22. Retrieved 2012-07-12.
  • Landauer, Thomas K.; Dumais, Susan T. (1997). "A solution to Plato's problem: The latent semantic analysis theory of the acquisition, induction, and representation of knowledge". Psychological Review. 104 (2): 211–240. doi:10.1037/0033-295x.104.2.211. S2CID 1144461.
  • Lund, Kevin; Burgess, Curt; Atchley, Ruth Ann (1995). "Semantic and associative priming in high-dimensional semantic space" (PDF). Proceedings of the 17th Annual Conference of the Cognitive Science Society. Cognitive Science Society. pp. 660–665.
  • McDonald, Scott; Ramscar, Michael (2001). "Testing the distributional hypothesis: The influence of context on judgements of semantic similarity". Proceedings of the 23rd Annual Conference of the Cognitive Science Society. pp. 611–616. CiteSeerX 10.1.1.104.7535. {{cite conference}}: Cite uses deprecated parameter |citeseerx= (help)
  • Pantel, Patrick; Lin, Dekang (2002). "Discovering word senses from text". Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining. KDD '02. pp. 613–619. doi:10.1145/775047.775138. ISBN 1-58113-567-X.
  • Sahlgren, Magnus (2008). "The Distributional Hypothesis" (PDF). Rivista di Linguistica. 20 (1): 33–53. Archived from the original (PDF) on 2012-03-15. Retrieved 2012-11-20.
  • Sahlgren, Magnus; Karlgren, Jussi (2009). Terminology mining in social media. CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management. doi:10.1145/1645953.1646006.
  • Terra, Egidio L.; Clarke, Charles L. A. (2003). "Frequency estimates for statistical word similarity measures" (PDF). Proceedings of the Human Language Technology and North American Chapter of Association of Computational Linguistics Conference 2003. HLT/NAACL 2003. pp. 244–251. doi:10.3115/1073445.1073477. Archived (PDF) from the original on 2013-11-03. Retrieved 2012-07-12.
  • Turney, Peter D. (May 2000). "Learning algorithms for keyphrase extraction". Information Retrieval. 2 (4): 303–336. arXiv:cs/0212020. doi:10.1023/A:1009976227802. S2CID 7007323.
  • Turney, Peter D. (2001). "Answering subcognitive Turing Test questions: A reply to French". Journal of Experimental and Theoretical Artificial Intelligence. 13 (4): 409–419. arXiv:cs/0212015. doi:10.1080/09528130110100270. S2CID 59099.
  • Turney, Peter D. (2003). "Coherent keyphrase extraction via Web mining". Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence. IJCAI-03. Acapulco, Mexico. pp. 434–439. arXiv:cs/0308033. Bibcode:2003cs........8033T.
  • Turney, Peter D. (2004). "Word sense disambiguation by Web mining for word co-occurrence probabilities". Proceedings of the Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text. SENSEVAL-3. Barcelona, Spain. pp. 239–242. arXiv:cs/0407065. Bibcode:2004cs........7065T.
  • Turney, Peter D. (2006). "Similarity of semantic relations". Computational Linguistics. 32 (3): 379–416. arXiv:cs/0608100. Bibcode:2006cs........8100T. doi:10.1162/coli.2006.32.3.379. S2CID 2468783.
  • Turney, Peter D.; Littman, Michael L. (October 2003). "Measuring praise and criticism: Inference of semantic orientation from association". ACM Transactions on Information Systems. 21 (4): 315–346. arXiv:cs/0309034. Bibcode:2003cs........9034T. doi:10.1145/944012.944013. S2CID 2024.
  • Turney, Peter D.; Littman, Michael L. (2005). "Corpus-based Learning of Analogies and Semantic Relations". Machine Learning. 60 (1–3): 251–278. arXiv:cs/0508103. Bibcode:2005cs........8103T. doi:10.1007/s10994-005-0913-1. S2CID 9322367.
  • Turney, Peter D.; Littman, Michael L.; Bigham, Jeffrey; Shnayder, Victor (2003). "Combining Independent Modules to Solve Multiple-choice Synonym and Analogy Problems". Proceedings of the International Conference on Recent Advances in Natural Language Processing. RANLP-03. Borovets, Bulgaria. pp. 482–489. arXiv:cs/0309035. Bibcode:2003cs........9035T.
  • Weaver, Warren (1955). "Translation" ( (PDF)). In Locke, W.N.; Booth, D.A. (eds.). Machine Translation of Languages. Cambridge, Massachusetts: MIT Press. pp. 15–23. ISBN 0-8371-8434-7. Archived from the original on 2019-01-29. Retrieved 2012-07-12. {{cite book}}: ISBN / Date incompatibility (help)
  • Yarlett, Daniel G. (2008). Language Learning Through Similarity-Based Generalization (PDF) (PhD thesis). Stanford University. Archived from the original (PDF) on 2014-04-19.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Statistical_semantics&oldid=1383136137"
Categories:
  • Applications of artificial intelligence
  • Computational linguistics
  • Information retrieval techniques
  • Semantics
  • Statistical natural language processing
  • Applied statistics
  • Computational fields of study
Hidden categories:
  • Articles with short description
  • Short description is different from Wikidata
  • CS1 errors: deprecated parameters
  • All articles with dead external links
  • Articles with dead external links from May 2018
  • Articles with permanently dead external links
  • CS1 errors: ISBN date
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.