Upload
kory-harvey
View
218
Download
0
Tags:
Embed Size (px)
Citation preview
Intelligent Systems
Lecture 23Introduction to Intelligent Data Analysis
(IDA). Example of system for Data Analyzing based on neural networks
Synonyms of IDA
• Data mining
• Knowledge discovery, in particular, Knowledge Discovery in Databases (KDD)
• Knowledge acquisition
Data Mining: Definition
• Data Mining is a collection of technologies which employ modern analysis techniques and computer power to find structure in data.
• Data Mining is composed of several branches, each of which attempts to solve a different problem.
Place of KDD in Decision support system (in medicine)
Place of Data Mining in Knowledge Discovery(Jiavei Han, Micheline Kamber “Data Mining.
Concepts and techniques”)
Data Mining: Ontology
• Predictive Modeling
• Clustering
• Deviation Detection
• Text Mining
• Link Analysis
• Etc. ...
Data Mining: Modeling
• Predictive Modeling attempts to predict values of future cases based on historical examples
• 90+% of all data mining is modeling
• Two major types:– estimation– classification
• Related to statistical regression
Data Mining: Clustering
• Clustering attempts to separate cases into ‘natural’ groupings.
• Strictly, there are no ‘right answers’
• Tends to be compute intensive
• Very popular in marketing, as market segmentation
Data Mining: Deviation Detection
• Deviation detection identifies cases which are ‘unexpected’
• All algorithms assume some model of ‘normality’- what is expected
• Related to outlier detection in conventional statistics
Data Mining: Text Mining
• Text mining includes several, different methods for discovering structure in documents.
• The most common text mining applications are search and retrieval tools.
Data Mining: Link Analysis
• Link analysis searches for indirect connections between items
• Primarily employed in fraud detection and law enforcement
• Link analysis tools typically include a data visualization component
Structure of software AnalDB
Shell
DLL
DLL
…
Modules
with NNsDatabase
User
BDE
GUI, generation of reports
Control of NN
Reading from Database, Options,
Commands