predicting scientific data transfer characteristics · pdf filepredicting scientific data...

13
Predicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster

Upload: dangbao

Post on 09-Mar-2018

218 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

PredictingScientificDataTransferCharacteristicsWilliamAgnew,MichaelFischer,KyleChard,IanFoster

Page 2: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using
Page 3: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using
Page 4: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

GlobusAllowingcommunicationandcollaborationforusersaroundtheworld.-Kyle Chard

Page 5: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using
Page 6: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using
Page 7: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

LongTailedDistributions

Page 8: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

EndpointPredictionHeuristics

• History:Themostlikelysource(S)/destination(D)endpointasthemostrecentS/Dendpointusedbyauser

• MarkovChain:AtransitionmatrixoftheobservedprobabilitiesofusingeachendpointasaS/DconditionedonaparticularendpointbeingpreviouslyusedasaS/D

• MostUniqueUsers:ThemostlikelyS/DendpointistheS/Dendpointwiththemostuniqueusers

• Institution: ThemostlikelyS/Dendpointforauseristhemostpopularendpointatthatuser’sinstitution

• EndpointOwnership:Themostlikelyendpointisthemostrecentendpointtheusercreated

Page 9: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

EnsembleMethods:UsingRecurrentNeuralNetwork

• Combinemultipleheuristicsintoabetterheuristic

• Simpleexample:outputthetoprecommendationofeachheuristic

Page 10: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

Results:TransferAccuracy

Page 11: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

Results:UserAccuracy

Page 12: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using

ColdStart:PredictionsforNewUsers

Page 13: Predicting Scientific Data Transfer Characteristics · PDF filePredicting Scientific Data Transfer Characteristics William Agnew, Michael Fischer, Kyle Chard, Ian Foster. ... Using