Pattern Identification Using Text Mining

  • Sanil C Savale University of Pune
  • Anuja A Gharpure
Keywords: Text mining, Pattern mining, Pattern evolving, pattern deploying

Abstract

Text mining, also referred to as text data mining, roughly equivalent to text analytics, refers to the process of deriving high-quality information from text. High-quality information is typically derived through the devising of patterns and trends through means such as statistical pattern learning. Text mining usually involves the process of structuring the input text (usually parsing, along with the addition of some derived linguistic features and the removal of others, and subsequent insertion into a database), deriving patterns within the structured data, and finally evaluation and interpretation of the output. 'High quality' in text mining usually refers to some combination of relevance, novelty, and interestingness. Typical text mining tasks include text categorization, text clustering, concept/entity extraction, production of granular taxonomies, analysis, document, and entity relation modeling (i.e., learning relations between named entities). Text analysis involves information retrieval, lexical analysis to study word frequency distributions, pattern recognition, tagging/annotation, information extraction, mining techniques including link and association analysis, visualization and predictive analytics. The overarching goal is, essentially, to turn text into data for analysis, via application of natural language processing (NLP) and analytical methods.

References

[1] K. Aas and L. Eikvil, “Text Categorisation: A Survey,” Technical Report Raport NR 941, a. Norwegian Computing Center, 1999. [2] R. Agrawal and R. Srikant, “Fast Algorithms for a. Mining Association Rules in Large Databases,” Proc. b. 20th Int’l Conf. Very Large Data Bases (VLDB ’94), c. pp. 478-499, 1994. [3] H. Ahonen , O. Heinonen , M. Klemettinen , and a. A.I. Verkamo, “Applying Data Mining Techniques for Descriptive Phrase Extraction in Digital Document Collections,” Proc. IEEE Int’l Forum on Research and Technology Advances in Digital Libraries (ADL ’98), pp. 2-11, 1998. [4] T. Joachims, “Text Categorization with Support Vector Machines:Learning with Many Relevant Features,” Proc. European Conf. Machine Learning a. (ICML ’98),, pp. 137-142, 1998. [5] N. Cancedda, N. Cesa-Bianchi, A. Conconi, and a. C. Gentile, “Kernel Methods for Document b. Filtering,”TREC,trec.nist.gov/pubs/trec11/papers/ker mit.ps.gz, 2002. [6] N. Cancedda, E. Gaussier, C. Goutte, and J.-M. a. Renders, “Word- Sequence Kernels,” J. Machine b. Learning Research, vol. 3, pp. 1059- 1082, 2003.
[7] M.F. Caropreso, S. Matwin, and F. Sebastiani, a. “Statistical Phrases in Automated Text Categorization, b. “Technical Report IEI-B4-07-2000, Instituto di c. Elaborazione dell’ Informazione, 297, 1995. [8] J. Han and K.C.-C. Chang, “Data Mining for Web a. Intelligence,” Computer, vol. 35, no. 11, pp. 64-70, Nov. 2002. [9] C. Cortes and V. Vapnik, “Support-Vecto a. Networks,” Machine Learning, vol. 20, no. 3,
Published
2018-03-20
How to Cite
Savale, S., & Gharpure, A. (2018). Pattern Identification Using Text Mining. Asian Journal For Convergence In Technology (AJCT) ISSN -2350-1146, 2(2). Retrieved from http://www.asianssr.org/index.php/ajct/article/view/201
Section
Article

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.