본문 바로가기
Data Science/Information Retrieval

Stop words (English) - from Wikipedia

by leanu 2008. 1. 16.

Stop words, or stopwords, is the name given to words which are filtered out prior to, or after, processing of natural language data (text).

Hans Peter Luhn, one of the pioneers in information retrieval, is credited with coining the phrase and using the concept in his design. It is controlled by human input and not automated. This is sometimes seen as a negative approach to the natural articles of speech as mentioned above.

There is no definite list of stop words which all natural language processing tools incorporate. Not all NLP tools use a stoplist. Some tools specifically avoid using them to support phrase searching. The use of a stemming algorithm may reduce part of the rationale or dependence on a stoplist to filter out words.[citation needed]

Stop words can cause problems when using a search engine to search for phrases that include them, particularly in names such as 'The Who' or 'Take That'.


간단히 말하자면 검색에서 제외되는 비중이 없는 단어들을 stop words 라고 한다.




댓글