English, Article edition: A NEW FEATURE SELECTION METHOD BASED ON CONCEPT EXTRACTION IN AUTOMATIC CHINESE TEXT CLASSIFICATION SHASHA LIAO; MINGHU JIANG

User activity

Share to:
 
Bookmark: http://trove.nla.gov.au/version/132864
Physical Description
  • article
Language
  • English

Edition details

Title
  • A NEW FEATURE SELECTION METHOD BASED ON CONCEPT EXTRACTION IN AUTOMATIC CHINESE TEXT CLASSIFICATION
Author
  • SHASHA LIAO
  • MINGHU JIANG
Physical Description
  • article
Notes
  • The feature selection is an important part in automatic text classification. In this paper, we use a Chinese semantic dictionary â Hownet to extract the concepts from the word as the feature set, because it can better reflect the meaning of the text. However, as the concept definition in the dictionary sometimes cannot express the word properly, we define the expression power for every sememe and every definition of the word in further process, and define the relation degree between the sememe and the definition. A threshold is set in the sememe tree, the sememe of the little information is filtered, and the words of weak definition are reserved in expression power. By this method, we construct a combined feature set that consists of both sememes and the Chinese words. The values of sememes are given according to their expression power and relation to the word. By comparing seven feature weighing methods in text classification, we propose a CHI-MCOR weighing method according to the weighing theories and classification precision. Experimental result shows that if the words are extracted properly, not only the feature dimension is smaller but also the classification precision is higher. Our method makes a good balance between the features which occur frequently in the corpus and those which only occur in one category, the difference of the classification precision among different categories is small.
  • Text classification, HowNet, concept extraction, feature selection
  • RePEc:wsi:nmncxx:v:03:y:2007:i:03:p:331-347
Language
  • English
Contributed by
OAIster

Get this edition

  • Set up My libraries

    How do I set up "My libraries"?

    In order to set up a list of libraries that you have access to, you must first login or sign up. Then set up a personal list of libraries from your profile page by clicking on your user name at the top right of any screen.

  • All (1)
  • Unknown (1)
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.

User activity


e.g. test cricket, Perth (WA), "Parkes, Henry"

Separate different tags with a comma. To include a comma in your tag, surround the tag with double quotes.

Be the first to add a tag for this edition

Be the first to add this to a list

Comments and reviews

What are comments? Add a comment

No user comments or reviews for this version

Add a comment