a survey of data provenance in scientific workflow wu yuan email: [email protected] kunming...
TRANSCRIPT
![Page 1: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/1.jpg)
A Survey of Data provenance in Scientific Workflow
Wu Yuan Email: [email protected] University of Science and technology
![Page 2: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/2.jpg)
Outline
1. What is Provenance and how it works?
2. Taxonomy of provenance techniques.
3. Provenance model.
4. Provenance in scientific workflow.
5. What’s next.
![Page 3: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/3.jpg)
What is Provenance ?
Provenance.
→ 数据起源 / 数据出处 / 数据溯源…
![Page 4: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/4.jpg)
Provenance Service in Scientific experiment
![Page 5: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/5.jpg)
Provenance Definition
●The provenance of a result is the process that led to that result.
●where- provenance & why- provenance (Buneman, P., S. Khanna, and W.C. Tan,2001 )
![Page 6: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/6.jpg)
Understanding the Process provenance Change
Where- provenance? &Why- provenance?
![Page 7: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/7.jpg)
Provenance is an increasingly important topic.
→biology;
… Financial Auditing;
…Aerospace;
![Page 8: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/8.jpg)
The importance of provenance
Scientific analysis is complex Issues of trust, quality, and copyright of data Reproducing, interpreting results depends on
the provenance of the data. Workflow systems Support scientists in their analysis Trace the data used / generated at each step Replication Recipe
![Page 9: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/9.jpg)
Provenance “Lifecycle”
![Page 10: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/10.jpg)
Taxonomy of Provenance Techniques
![Page 11: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/11.jpg)
Provenance computing
● Query inversion.( 查询反演 ) …or the style of “lazy” .● Annotations. (标注) …or the style of “eager” .
![Page 12: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/12.jpg)
Model of describing provenance
W7(when, where, how, who, why, what, which) An information model and architecture for stream provenance
(LEAD, Calder, 气象 )
The four-level provenance model (LEAD, Kama,地球学 )
A time-and-value centric provenance model (Century,医学 )
![Page 13: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/13.jpg)
W7 model
![Page 14: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/14.jpg)
Data model of provenance
Relational Model XML
…
![Page 15: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/15.jpg)
The Model of Provenance in workflow
●RDF (resource description framework) ●PCS (provenance collection service) ●PQS (provenance query server)
![Page 16: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/16.jpg)
Provenance collection service
工作流日志逆 SQL查询语句标注模式
![Page 17: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/17.jpg)
provenance query server
Query :
Relational Model/SQL
XML/XQueryOR ……
![Page 18: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/18.jpg)
Current study
Query Language Annotation-aware
Provenance computing Provenance model Annotation management need a data model. Annotation management system
Data security and data reliability
→ Current study is limited …Query itself is complex
![Page 19: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/19.jpg)
Conclusion
Provenance recording should be part of the infrastructure.
Currently, the Web Services and the Open Grid Services Architecture do not provide any support for recording provenance.
![Page 20: A Survey of Data provenance in Scientific Workflow Wu Yuan Email: wuyuan@cnlab.net Kunming University of Science and technology](https://reader036.vdocuments.mx/reader036/viewer/2022062422/56649efa5503460f94c0cd42/html5/thumbnails/20.jpg)
Thanks for your
attendance !
…The End.