introduction to weka xingquan (hill) zhu slides copied from jeffrey junfeng pan (ust)
TRANSCRIPT
![Page 1: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/1.jpg)
Introduction to Weka
Xingquan (Hill) Zhu
Slides copied from Jeffrey Junfeng Pan (UST)
![Page 2: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/2.jpg)
Outline
Weka Data Source Feature selection Model building
Classifier / Cross Validation Result visualization
![Page 3: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/3.jpg)
WEKA
http://www.cs.waikato.ac.nz/ml/weka/ Data mining software in Java Open source software
UCI Data Repository http://www.ics.uci.edu/~mlearn/
MLRepository.html
![Page 4: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/4.jpg)
![Page 5: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/5.jpg)
![Page 6: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/6.jpg)
![Page 7: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/7.jpg)
Explorer: pre-processing the data
Data can be imported from a file in various formats: ARFF, CSV, C4.5, binary
Data can also be read from a URL or from an SQL database (using JDBC)
Pre-processing tools in WEKA are called “filters”
WEKA contains filters for: Discretization, normalization, resampling, attribute
selection, transforming and combining attributes, …
![Page 8: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/8.jpg)
@relation heart-disease-simplified
@attribute age numeric@attribute sex { female, male}@attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina}@attribute cholesterol numeric@attribute exercise_induced_angina { no, yes}@attribute class { present, not_present}
@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...
WEKA only deals with “flat” files
![Page 9: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/9.jpg)
@relation heart-disease-simplified
@attribute age numeric@attribute sex { female, male}@attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina}@attribute cholesterol numeric@attribute exercise_induced_angina { no, yes}@attribute class { present, not_present}
@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...
WEKA only deals with “flat” files
![Page 10: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/10.jpg)
![Page 11: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/11.jpg)
![Page 12: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/12.jpg)
![Page 13: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/13.jpg)
![Page 14: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/14.jpg)
![Page 15: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/15.jpg)
![Page 16: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/16.jpg)
![Page 17: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/17.jpg)
![Page 18: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/18.jpg)
![Page 19: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/19.jpg)
![Page 20: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/20.jpg)
![Page 21: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/21.jpg)
![Page 22: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/22.jpg)
![Page 23: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/23.jpg)
![Page 24: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/24.jpg)
![Page 25: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/25.jpg)
![Page 26: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/26.jpg)
![Page 27: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/27.jpg)
![Page 28: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/28.jpg)
![Page 29: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/29.jpg)
![Page 30: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/30.jpg)
![Page 31: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/31.jpg)
Explorer: attribute selection
Panel that can be used to investigate which (subsets of) attributes are the most predictive ones
Attribute selection methods contain two parts: A search method: best-first, forward selection, random,
exhaustive, genetic algorithm, ranking An evaluation method: correlation-based, wrapper,
information gain, chi-squared, … Very flexible: WEKA allows (almost) arbitrary combinations of
these two
![Page 32: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/32.jpg)
![Page 33: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/33.jpg)
![Page 34: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/34.jpg)
![Page 35: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/35.jpg)
![Page 36: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/36.jpg)
![Page 37: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/37.jpg)
![Page 38: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/38.jpg)
![Page 39: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/39.jpg)
![Page 40: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/40.jpg)
Explorer: building “classifiers”
Classifiers in WEKA are models for predicting nominal or numeric quantities
Implemented learning schemes include: Decision trees and lists, instance-based classifiers,
support vector machines, multi-layer perceptrons, logistic regression, Bayes’ nets, …
“Meta”-classifiers include: Bagging, boosting, stacking, error-correcting output
codes, locally weighted learning, …
![Page 41: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/41.jpg)
![Page 42: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/42.jpg)
![Page 43: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/43.jpg)
![Page 44: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/44.jpg)
![Page 45: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/45.jpg)
![Page 46: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/46.jpg)
![Page 47: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/47.jpg)
![Page 48: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/48.jpg)
![Page 49: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/49.jpg)
![Page 50: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/50.jpg)
![Page 51: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/51.jpg)
![Page 52: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/52.jpg)
![Page 53: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/53.jpg)
![Page 54: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/54.jpg)
![Page 55: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/55.jpg)
![Page 56: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/56.jpg)
![Page 57: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/57.jpg)
![Page 58: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/58.jpg)
![Page 59: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/59.jpg)
![Page 60: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/60.jpg)
![Page 61: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/61.jpg)
![Page 62: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/62.jpg)
Problem with Running Weka
Solution : java -Xmx1000m -jar weka.jar
Problem : Out of memory for large data set
![Page 63: Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)](https://reader035.vdocuments.mx/reader035/viewer/2022081514/5697bfdf1a28abf838cb2b81/html5/thumbnails/63.jpg)
Outline
Weka Data Source Feature selection Model building
Classifier / Cross Validation Result visualization