Computational Intelligence Dating of the Iron Age Glass

Download Computational Intelligence Dating  of the Iron Age Glass

Post on 05-Jan-2016




0 download

Embed Size (px)


Computational Intelligence Dating of the Iron Age Glass. Karol Grudziski Bydgoszcz Academy, Poland Maciej Karwowski University of Rzeszw, Poland Wodzisaw Duch Nanyang Institute of Technology, Singapore Nicola u s Copernicus University, Poland. Donors of the Data. - PowerPoint PPT Presentation


<ul><li><p>Computational Intelligence Dating of the Iron Age Glass Karol GrudziskiBydgoszcz Academy, PolandMaciej KarwowskiUniversity of Rzeszw, Poland Wodzisaw DuchNanyang Institute of Technology, Singapore Nicolaus Copernicus University, Poland</p></li><li><p>Donors of the DataInterdisciplinary Project Celtic Glass Characterization Prof. G. Trnka (Institute of Prehistory, University of Vienna); Prof. P. Wobrauschek (Atomic Institute of the Austrian Universities in Vienna)</p></li><li><p>Celtic Glass samples</p></li><li><p>Data Description (Original Database)Measurements of chemical compound concentrations using Energy Dispersive X-ray Fluorescence Spectroscopy (26 compounds) Class chronological period of manufacturementLT C1 (La Tene C1, 260 170 B.C.)LT C2 (La Tene C2, 170 110 B.C.)LT D1 (La Tene D1, 110 50 B.C.) 555 glass measurements, usually in 4 points of a single glass object.</p></li><li><p>Questions to be answered using CI analysisSystem capable of automatic dating of glass artifacts given chemical compound concentrations is needed, because there are few experts that can do it. Exploration of the hidden patterns in the data, with possible implication in archeology through rule extraction analysis (expert archeologist are unable to formalize the knowledge required to predict date).Corrosion layer is on the surface, broken parts are less corroded. Influence of corrosion on measurements and prediction of the class unknown.</p></li><li><p>Data PreprocessingChallenge to classification methods: several vectors for one object, small data. In this case for one glass artifact usually two measurements on each side on the surface and two on the broken parts are included. </p><p>Database contains cases with missing class, belonging to other chronological periods, measurements on decorations were excluded.</p></li><li><p>Numerical ExperimentsThree different experiments:1st: Both Surface and Broken Side Data2nd: Surface Data3rd: Broken Side Data Many algorithms implemented in WEKA, NETLAB, SBL and the GhostMiner packages were used for calculations.</p></li><li><p>Surface and Broken Side DataExperiment on the whole preprocessed dataset divided into training and test sets.Class Distribution (whole set):1) LT C1, 29.68% (84 cases)2) LT C2, 33.57% (95 cases)3) LT D1, 36.75% (104 cases)283 cases total, 143 training, 140 test; 1 surface and 1 side measurement (on average) belonging to the same glass object in both training and test sets !</p></li><li><p>Results of the First Experiment</p><p>SystemTrain (%)Test (%)Naive Bayes (WEKA)1-NN (SBL)IncNet, 5 n. (GM)SSV Tree (GM)MLP + reg. (Netlab)MLP backprop (Netlab)1R (WEKA) SVM (GM)C45 Rules (WEKA)C45 Tree (WEKA)81.8100.099.397.198.6100.0 74.199.391.697.981.475.073.670.570.067.166.463.662.155.7</p></li><li><p>Summary of the Results of the First ExperimentLT C1 well separated. Naive Bayes works very well. SBM methods may be very misleading for such data: measurements on the same artifact both in train and test; uncontrolled bootstrap learning.</p></li><li><p>MDS visualization</p></li><li><p>Logical Rules &amp; Attribute Selection 1R Tree Rules predict correctly 100/143 training and 93/140 test samples:1. IF MnO &lt; 2185.205 THEN C12. IF MnO [2185.205,9317.315) THEN C23. IF MnO 9317.315 THEN D1 Important attributes: MnO + TiO2, Fe2O3, NiO, Sb2O3, ZnO (LT C1), Fe2O3, TiO2, NiO, PbO (LT C2)TiO2, Sb2O3, Fe2O3, PbO, ZnO (LT D1)</p></li><li><p>Surface data experimentExperiment on a surface measurement dataset divided into training and test sets. Class Distribution (whole set):1) LT C1, 26.36% (34 cases)2) LT C2, 37.98% (49 cases)3) LT D1, 35.66% (46 cases) 129 cases total, 61 training, 68 test, cases belonging to the same artifact distributed into training and test partition. </p></li><li><p>Results - Second Experiment</p><p>SystemTrain (%)Test (%)1-NN (GM)MLP (16 neurons) WEKAIncNet (3 neurons, GM)SVM (GM. Gauss kernel)SSV Tree (GM. opt. prun.)C4.5- Rules (WEKA)NaiveBayes (WEKA)C45- Tree (WEKA)1R (WEKA)10010010098.410096.786.995.</p></li><li><p>Logical rules from 1R1R rules predict correctly 42/61 (68.9%) training and 43/68 (63.2%) test samples.</p><p>1. IF MnO &lt; 187.34 THEN C12. IF MnO &lt; [3821.99,9489.09) THEN C23. IF MnO [187.34, 3821.99) or MnO 9489.09 THEN D1</p></li><li><p>Logical Rules from C45C45 rules predict correctly 54/68 (79.4%) test samples 1. IF ZrO2 &gt; 296.1 THEN C12. IF Na2O 36472.22 THEN C13. IF Sb2O3 &gt;2078.76 THEN C24. IF CdO = 0 &amp; Na2O 27414.98 THEN C25. IF Na2O &gt; 27414.98 &amp; NiO 58.42 THEN D16. IF NiO &gt; 48.45 &amp; CdO = 0 &amp; BaO = 0 &amp; Br2O7 &lt; 53.6 &amp; Fe2O3 12003.35 &amp; ZnO 149.31 THEN D17. Default: D1</p></li><li><p>Logical rules from SSV1. IF MnO &lt; 1668.47 &amp; ZrO2 &gt; 303.34 THEN C12. IF MnO &lt; 1668.47 &amp; ZrO2 &lt; 303.34 &amp; TiO2 &lt; 76.235, or MnO &gt; 1668.47 &amp; Sb2O3 &gt; 986.19, or MnO &gt; 1668.47 &amp; Sb2O3 &lt; 986.19 &amp; CaO &lt; 79370 THEN C23. IF MnO &gt; 1668.47 &amp; Sb2O3 &lt; 986.19 &amp; CaO &gt; 79370, or MnO &lt; 1668.47 &amp; ZrO2 &lt; 303.34 &amp; TiO2 &gt; 76.235 THEN D1</p></li><li><p>Broken Side DataExperiment on a broken side data divided into training and test partition Class Distribution (whole set):1) LT C1, 32.47% (50 cases)2) LT C2, 29.87% (46 cases)3) LT D1, 37.66% (58 cases) 154 cases total, 78 training, 76 test, cases separated</p></li><li><p>Results of the third experiment</p><p>SystemTrain (%)Test (%)1-NN (GM)NaiveBayes (WEKA)IncNet, 3 neurons (GM)SVM (linear kernel) (GM)MLP, 19 neurons (WEKA)C45 Rules (WEKA)SSV (GM)C45 Tree (WEKA)1R (WEKA)10092.397.494.997.498.784.693.673.189.586.885.581.681.681.677.677.675</p></li><li><p>Logical rules from 1R1R Rules predict correctly 58/78 (74.4%) training and 57/76 (75.0%) test samples. 1. IF MnO &lt; 2134.61 THEN C12. IF MnO [2134.61 9078.525) THEN C23. IF MnO 9078.525 THEN D1 Similar Rules were found by the SSV tree with strong pruning.</p></li><li><p>Rules from C451. IF ZrO2 &gt; 199.38 &amp; CdO = 0 THEN C12. IF NiO 62.23 &amp; CaO 114121.35 THEN C13. IF CuO 5105.37 &amp; MnO &gt; 2546.77 &amp; ZnO 126.29 THEN C24. IF SnO2 &gt; 61.98 &amp; Br2O7 64.08 THEN D15. IF Sb2O3 8246.11 &amp; CuO 2042.19 &amp; Al2O3 &gt; 11525.69 THEN D16. Default C2</p></li><li><p>ConclusionsCI methods may help to assign samples of uncertain chronology to one of the chronological periods, providing rough logical rules to archeologists. Important chemical compounds useful for dating have been identified. Separate tests on the surface and broken side data lead to similar classification accuracies, confirming the hypothesis that corrosion on the surface has minor or no influence on results of the analysis. </p></li><li><p>Further WorkLarger database is needed. Detailed predictions by the CI methods should be confronted with archeologists. There is a significant proportion of unlabeled samples in the original database, unsupervised methods should be applied using reduced feature space. </p></li><li><p>AcknowledgmentsThe research on chemical analysis of the archeological glass was funded by the Austrian Science Foundation, project No. P12526-SPR.</p><p>We are very grateful to our colleagues from the Atomic Institute in Vienna for making this data available to us.</p></li></ul>