English, Article edition: A Scalable Classification Algorithm for Very Large Datasets Dursun Delen; Marilyn G. Kletke; Jin-Hwa Kim

User activity

Share to:
 
Bookmark: http://trove.nla.gov.au/version/133381
Physical Description
  • article
Language
  • English

Edition details

Title
  • A Scalable Classification Algorithm for Very Large Datasets
Author
  • Dursun Delen
  • Marilyn G. Kletke
  • Jin-Hwa Kim
Physical Description
  • article
Notes
  • Today's organisations are collecting and storing massive amounts of data from their customer transactions and e-commerce/​e-business applications. Many classification algorithms are not scalable to work effectively and efficiently with these very large datasets. This study constructs a new scalable classification algorithm (referred to in this manuscript as Iterative Refinement Algorithm, or IRA in short) that builds domain knowledge from very large datasets using an iterative inductive learning mechanism. Unlike existing algorithms that build the complete domain knowledge from a dataset all at once, IRA builds the initial domain knowledge from a subset of the available data and then iteratively improves, sharpens and polishes it using the chucks from the remaining data. Performance testing of IRA on two datasets (one with approximately five million records for a binary classification problem and another with approximately 600 K records for a seven-class classification problem) resulted in more accurate domain knowledge as compared to other prediction methods including logistic regression, discriminant analysis, neural networks, C5, CART and CHAID. Unlike other classification algorithms whose performance and accuracy deteriorate as data size increases, the efficacy of IRA improves as datasets become significantly larger.
  • Massive datasets, data mining, rule induction, classification, knowledge bases, refinement techniques
  • RePEc:wsi:jikmxx:v:04:y:2005:i:02:p:83-94
Language
  • English
Contributed by
OAIster

Get this edition

  • Set up My libraries

    How do I set up "My libraries"?

    In order to set up a list of libraries that you have access to, you must first login or sign up. Then set up a personal list of libraries from your profile page by clicking on your user name at the top right of any screen.

  • All (1)
  • Unknown (1)
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.

User activity


e.g. test cricket, Perth (WA), "Parkes, Henry"

Separate different tags with a comma. To include a comma in your tag, surround the tag with double quotes.

Be the first to add a tag for this edition

Be the first to add this to a list

Comments and reviews

What are comments? Add a comment

No user comments or reviews for this version

Add a comment