Upload File

unsupervised machine learning in agent-based modeling · 2018-03-02 · agent-based modeling is...

  • Home
  • Documents
  • Unsupervised Machine Learning in Agent-Based Modeling · 2018-03-02 · Agent-based modeling is “a form of computational modeling whereby a phenomenon is modeled in terms of agents
1
,- II. Agent-Based Model Agent-based modeling is “a form of computational modeling whereby a phenomenon is modeled in terms of agents and their interactions” [1]. In the Wolf Sheep Predation model, wolves (black) and sheep (white) move randomly on a field of grass and dirt patches. When a wolf and a sheep occupy the same space, the wolf eats the sheep. If a wolf or sheep consumes a sufficient amount of food, it reproduces. If a wolf or sheep goes long enough without food, it dies out. A final detail: If the ‘grass?’ toggle is ON, grass can be depleted by the sheep (resulting in a brown patch, which will eventually grow back). If ‘grass?’ is OFF, then grass is an infinite resource for the sheep. I. Overview Agent-based models (ABMs) are used by researchers in a variety of fields to model natural phenomena. In an ABM, a wide range of behaviors and outcomes can be observed based on the parameters of the model. In many cases, these behaviors can be categorized into discrete outcomes identifiable by human observers. Our goal was to use clustering algorithms to identify those outcomes from model output data. If this task can be completed reliably by a computer, it will make the task of investigating an ABM easier for human users. For this project, we used the Wolf Sheep Predation model that can be found in the models library of Netlogo 5.3.1 [2]. For data analysis and visualization, we used Python 3.5.2 and the scikit-learn and matplotlib libraries. Unsupervised Machine Learning in Agent-Based Modeling Luke Robinson and Forrest Stonedahl * Mathematics and Computer Science Department, Augustana College *Faculty Advisor V. Overarching Goals and Future Work VI. References [1] Wilensky, U., & Rand, W. (2015). An Introduction to agent-based modeling: modeling natural, social, and engineered complex systems with NetLogo. Cambridge, Mass.: MIT Press. [2] Wilensky, U. 1999. NetLogo. http://ccl.northwestern.edu/netlogo/ Center for Connected Learning and Computer-Based Modeling, Northwestern University. Evanston, IL. [3] Sklearn.cluster.DBSCAN. Retrieved February 13, 2017, from http://scikit-learn.org/stable/modules/generated/sklearn.cluster.DBSCAN.html [4] 2.3. Clustering. Retrieved February 13, 2017, from http://scikit-learn.org/stable/modules/clustering.html ,- BehaviorSpace Experiment DBSCAN DBSCAN is short for ‘Density-Based Spatial Clustering of Applications with Noise’ [3]. This algorithm finds core samples of high density and expands clusters from these. An epsilon value of 50 sets the maximum distance between two points to be in the same neighborhood. A value of 30 for min_samples specifies how many data points must be in a neighborhood for it to be considered the core of a cluster. The black dots on the diagonal fringe were classified as noise (not part of any cluster). BehaviorSpace is a tool in Netlogo that allows the user to perform an experiment that carries out many runs of a model with different combinations of the model’s parameters. The data for this project came from a BehaviorSpace experiment with the following parameters: Output measures: count sheep, count wolves Stop condition: not any? turtles or count sheep > 1500 Time limit: 1500 steps Total runs: 24,300 K-Means(n_clusters=2) silhouette score = .86 K-Means K-Means requires the user to specify the number of clusters, and it clusters data by trying to separate samples into groups of equal variance [4]. Our data forms two clusters: simulations where the sheep population exploded, and simulations where it didn’t. K-Means generally found these two clusters, but misclassified some points on the boundary (the blue points between 800 and 1100 sheep). Affinity Propagation The Affinity Propagation clustering algorithm chooses ‘exemplars’ (shown as large dots at left), which are points that best represent others around them, and then forms clusters by growing them outwards from the exemplars [4]. Due to the time complexity of this algorithm and the large dataset that we used, we had to run the algorithm on a random subset with only 2,000 data points. The sparser data set contributed to why this algorithm found more clusters than the other algorithms. ABM Clustering Algorithm on Output Data BehaviorSpace Experiment Cluster 1 Cluster 2 Cluster 3 Cluster Evaluations Cluster Visualizations Analysis of Parameters Parameter Visualizations The flowchart above shows the process of evaluating agent-based models using unsupervised learning techniques. There are many opportunities for future work on this project. Ideally, this is an iterative process that can be refined to help a modeler build the most informative model and gain a full understanding of it. Research could be done into the best ways to adjust the parameters of the ABM based on the parameter distributions that appear in clusterings of the model's output data. Also, attempts could be made to automate some or all of this process to further reduce the amount of work for the researcher. ,- We investigated the two clusters that made up the K-means clustering by examining the distribution of the parameters from the ABM that led to a run being in its respective cluster. The histograms for most of the variables showed an even distribution for both clusters, with the notable exceptions of the ‘wolfgainfromfood’ and ‘grass’ variables. IV. Parameter Analysis When ‘wolfgainfromfood’ has a higher value, the run is more likely to be in cluster 1 (red), where the sheep population did not explode. The reverse is also true. This makes sense because presumably the wolves’ increased gain from food enabled them to grow in population and limit the sheep population growth. In cluster 1, ¾ of the trials had grass-depletion enabled. In cluster 2, basically all trials had grass depletion disabled. This points to a key outcome from this model, which is that an ecosystem with three interacting species is more stable (less likely to have a population explosion) than an 2-species ecosystem. DBSCAN(epsilon=50, min_samples=30) silhouette score = .66 Silhouette Scores The silhouette score is a clustering metric ranging from -1 (worst) to 1 (best), by comparing distances between points within a cluster and between different clusters [4]. ["sheep-reproduce" 3 5 7] ["initial-number-sheep" [80 10 120]] ["wolf-gain-from-food" [12 8 28]] ["wolf-reproduce" 3 5 7] ["show-energy?" false] ["sheep-gain-from-food" 3 5 7] ["initial-number-wolves" [30 10 70]] ["grass-regrowth-time" [20 10 40]] ["grass?" true false] AffinityPropagation(damping=.75) silhouette score = .60 III. Clustering Algorithms 'grass?'=OFF (no grass depletion) 'grass?'=ON (grass depletion)

Upload: others

Post on 18-Jun-2020

2 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Unsupervised Machine Learning in Agent-Based Modeling · 2018-03-02 · Agent-based modeling is “a form of computational modeling whereby a phenomenon is modeled in terms of agents

,-

II. Agent-Based ModelAgent-basedmodelingis“aformofcomputationalmodelingwherebyaphenomenonismodeledintermsofagentsandtheirinteractions”[1].IntheWolfSheepPredationmodel,wolves(black)andsheep(white)moverandomlyonafieldofgrassanddirtpatches.Whenawolfandasheepoccupythesamespace,thewolfeatsthesheep.Ifawolforsheepconsumesasufficientamountoffood,itreproduces.Ifawolforsheepgoeslongenoughwithoutfood,itdiesout.Afinaldetail:Ifthe‘grass?’toggleisON,grasscanbedepletedbythesheep(resultinginabrownpatch,whichwilleventuallygrowback).If‘grass?’ isOFF,thengrassisaninfiniteresourceforthesheep.

I. OverviewAgent-basedmodels(ABMs)areusedbyresearchersinavarietyoffieldstomodelnaturalphenomena.InanABM,awiderangeofbehaviorsandoutcomescanbeobservedbasedontheparametersofthemodel.Inmanycases,thesebehaviorscanbecategorizedintodiscreteoutcomesidentifiablebyhumanobservers.Ourgoalwastouseclusteringalgorithmstoidentifythoseoutcomesfrommodeloutputdata.Ifthistaskcanbecompletedreliablybyacomputer,itwillmakethetaskofinvestigatinganABMeasierforhumanusers.Forthisproject,weusedtheWolfSheepPredationmodelthatcanbefoundinthemodelslibraryofNetlogo 5.3.1[2].Fordataanalysisandvisualization,weusedPython3.5.2 andthescikit-learnandmatplotlib libraries.

Unsupervised Machine Learning in Agent-Based ModelingLuke Robinson and Forrest Stonedahl*

Mathematics and Computer Science Department, Augustana College *Faculty Advisor

V. Overarching Goals and Future Work

VI. References[1]Wilensky,U.,&Rand,W.(2015). AnIntroductiontoagent-based

modeling:modelingnatural,social,andengineeredcomplexsystemswithNetLogo.Cambridge,Mass.:MITPress.

[2]Wilensky,U.1999.NetLogo.http://ccl.northwestern.edu/netlogo/CenterforConnectedLearningandComputer-BasedModeling,NorthwesternUniversity.Evanston,IL.

[3]Sklearn.cluster.DBSCAN.RetrievedFebruary13,2017,fromhttp://scikit-learn.org/stable/modules/generated/sklearn.cluster.DBSCAN.html

[4]2.3.Clustering.RetrievedFebruary13,2017,fromhttp://scikit-learn.org/stable/modules/clustering.html

,-

BehaviorSpace Experiment

DBSCANDBSCANisshortfor‘Density-BasedSpatialClusteringofApplicationswithNoise’[3]. Thisalgorithmfindscoresamplesofhighdensityandexpandsclustersfromthese.Anepsilon valueof50setsthemaximumdistancebetweentwopointstobeinthesameneighborhood.Avalueof30formin_samples specifieshowmanydatapointsmustbeinaneighborhoodforittobeconsideredthecoreofacluster.Theblackdotsonthediagonalfringewereclassifiedasnoise(notpartofanycluster).

BehaviorSpace isatoolinNetlogo thatallowstheusertoperformanexperimentthatcarriesoutmanyrunsofamodelwithdifferentcombinationsofthemodel’sparameters.ThedataforthisprojectcamefromaBehaviorSpace experimentwiththefollowingparameters:

Outputmeasures:countsheep,countwolves

Stopcondition:notany?turtlesorcountsheep>1500

Timelimit: 1500stepsTotalruns: 24,300

K-Means(n_clusters=2)

silhouettescore=.86K-MeansK-Meansrequirestheusertospecifythenumberofclusters,anditclustersdatabytryingtoseparatesamplesintogroupsofequalvariance[4].Ourdataformstwoclusters:simulationswherethesheeppopulationexploded,andsimulationswhereitdidn’t.K-Meansgenerallyfoundthesetwoclusters,butmisclassifiedsomepointsontheboundary(thebluepointsbetween800and1100sheep).

Affinity PropagationTheAffinityPropagationclusteringalgorithmchooses‘exemplars’(shownaslargedotsatleft),whicharepointsthatbestrepresentothersaroundthem,andthenformsclustersbygrowingthemoutwardsfromtheexemplars[4].Duetothetimecomplexityofthisalgorithmandthelargedatasetthatweused,wehadtorunthealgorithmonarandomsubsetwithonly2,000datapoints.Thesparserdatasetcontributedtowhythisalgorithmfoundmoreclustersthantheotheralgorithms.

ABM ClusteringAlgorithmonOutputData

BehaviorSpaceExperiment

Cluster1Cluster2Cluster3

ClusterEvaluations

ClusterVisualizations

AnalysisofParameters

ParameterVisualizations

Theflowchartaboveshowstheprocessofevaluatingagent-basedmodelsusingunsupervisedlearningtechniques.Therearemanyopportunitiesforfutureworkonthisproject.Ideally,thisisaniterativeprocessthatcanberefinedtohelpamodelerbuildthemostinformativemodelandgainafullunderstandingofit.ResearchcouldbedoneintothebestwaystoadjusttheparametersoftheABMbasedontheparameterdistributionsthatappearinclusterings ofthemodel'soutputdata.Also,attemptscouldbemadetoautomatesomeorallofthisprocesstofurtherreducetheamountofworkfortheresearcher.

,-

WeinvestigatedthetwoclustersthatmadeuptheK-meansclusteringbyexaminingthedistributionoftheparametersfromtheABMthatledtoarunbeinginitsrespectivecluster.

Thehistogramsformostofthevariablesshowedanevendistributionforbothclusters,withthenotableexceptionsofthe‘wolfgainfromfood’and‘grass’variables.

IV. Parameter Analysis

When‘wolfgainfromfood’hasahighervalue,therunismorelikelytobeincluster1 (red),wherethesheeppopulationdidnotexplode.Thereverseisalsotrue.Thismakessensebecausepresumablythewolves’increasedgainfromfoodenabledthemtogrowinpopulationandlimitthesheeppopulationgrowth.

Incluster1,¾ofthetrialshadgrass-depletionenabled.Incluster2,basicallyalltrialshadgrassdepletiondisabled.Thispointstoakeyoutcomefromthismodel,whichisthatanecosystemwiththreeinteractingspeciesismorestable(lesslikelytohaveapopulationexplosion)thanan2-speciesecosystem.

DBSCAN(epsilon=50,min_samples=30)

silhouettescore=.66

Silhouette ScoresThesilhouettescoreisaclusteringmetricrangingfrom-1(worst)to1(best),bycomparingdistancesbetweenpointswithinaclusterandbetweendifferentclusters[4].

["sheep-reproduce"357]["initial-number-sheep"[8010120]]["wolf-gain-from-food"[12828]]["wolf-reproduce"357]["show-energy?"false]["sheep-gain-from-food"357]["initial-number-wolves"[301070]]["grass-regrowth-time"[201040]]["grass?"truefalse]

AffinityPropagation(damping=.75)

silhouettescore=.60

III. Clustering Algorithms

'grass?'=OFF(nograssdepletion)

'grass?'=ON(grassdepletion)

Introduction to Agent-Based Modeling

Representative Agent Hypothesis & Agent-based Modeling ...€¦ · Introduction to the Cobweb Model Agent-based Modeling Representative Agent Hypothesis Extras Social Behavior and

Agent-Based Modeling - SESYNC

Eclipse as an Agent-Based Modeling Platform

Agent based modeling - AnyLogic...• Agent based modeling does NOT assume clock "ticks" or "steps" ̶Most well-built and efficient agent based models are asynchronous. Continuous

Agent Analyst: Agent-Based Modeling in ArcGIS®

Agent-Based Modeling with NetLogo...Agent-Based Modeling with NetLogo Uri Wilensky Center for Connected Learning and Computer-Based Modeling Northwestern Institute on Complex Systems

Review Article: Agent-based Modeling and Disaster ... · level modeling, (3) agent-based simulation, and (4) agent-based modeling. While system level simulation studies a social phenomenon

Introductory Notes on Agent-Based Modeling, Agent-Oriented ... · Introductory Notes on Agent-Based Modeling, Agent-Oriented Programming, & AMES Presenter: Leigh Tesfatsion Professor

Agent-based mathematical modeling

Gis & Agent-based Modeling Architectures_slides.pdf · • Gis & Agent-based Modeling Architecture • Agent-based, spatially explicit, modeling and simulation platform. • Free

Tutorial on Agent-based Modeling and Simulation

Agent-Based Modeling and Simulation of Connected Corridors ...connected-corridors.berkeley.edu/sites/default/files/Agent-Based Modeling and... · Agent-Based Modeling and Simulation

Agent Based Modeling (ABM)

Agent based modeling and MarketSim

Modeling Robot Swarms Using Agent-Based Simulation

Agent based modeling-presentation

Learning Complexity: Agent-Based Modeling Supporting … · Learning Complexity: Agent-Based Modeling Supporting ... Agent-based modeling supporting education research ... Paper:

SPM 9550 – Introduction to Agent Based Modeling...SPM 9550 – Introduction to Agent Based Modeling 5 Agent Based Model •An Agent is a persistent thing which has some state we

Running Head: AGENT-BASED MODELING Files/jackson et...Running Head: AGENT-BASED MODELING ! Agent-Based Modeling: A Guide for Social Psychologists Joshua Conrad Jackson1*, David Rand234,

Agent-Based Modeling of Portfolio Theory (I)

Lecture: Agent Based Modeling in Transportation

Agena agent based modeling-AdSiF

Agent-based Modeling and Restructurations

AGENT-BASED MODELING AND SIMULATION

Visualization Tools for Agent-Based Modeling in NetLogoccl.northwestern.edu/papers/2007/Kornhauser-Agent-2007.pdf · 2 TABLE 1 Some Agent Based Modeling Toolkits AgentSheets Anylogic

Modeling Diffusion Using an Agent-based Approa

Anylogic Agent Based Modeling Technology Overview

Agent-Based Modeling

Agent-Based Modeling of Hospital - 2014.pdf

Agent-Based Modeling: A New Approach for Theory …smithlab/pdfs/SmithConreyABM.pdf · Agent-Based Modeling for Social Psychology 9/12/2006 3 Agent-Based Modeling: A New Approach

Does Agent-based Modeling Survive in Sociology?

AGENT-BASED MODELING AND SIMULATION: DESKTOP ABMS

“EPIMEMETICS”: AGENT-BASED MODELING OF …sites.lsa.umich.edu/collectiveintelligence/wp-content/uploads/... · Collective Intelligence 2015 “EPIMEMETICS”: AGENT-BASED MODELING

Modeling Construction Competitive Bidding: An Agent-Based