© 2010, pentaho. all rights reserved. . what is new in kettle 5?
TRANSCRIPT
![Page 1: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/1.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com.
What is new in Kettle 5?
![Page 2: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/2.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 2
What’s new in Kettle 5 agenda
●Back-end
●Carte
●Design patterns
●Usability
●Future
![Page 3: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/3.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 3
Kettle 5 – Backend technology
●Metrics
●Gathering of low level statistics
●Tied into the logging channels
●With full execution lineage
●Demo
![Page 4: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/4.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 4
Kettle 5 – Backend technology
●Pluggable data types
●Allowing alternative values
●GIS, Images, Sounds, … w/ specific steps
●Under construction!
●Developer feedback welcome & critical
●Demo
![Page 5: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/5.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 5
Kettle 5 – Carte
●Hooked up to a repository fun stuff happens…
![Page 6: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/6.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 6
Kettle 5 – Carte
●Execute job directly!
●kettle/runJob?job=/TestJob&level=Detailed
●Demo console wget
![Page 7: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/7.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 7
Kettle 5 – Carte
●Expose data services
●kettle/listServices
●Demo --> browser:
http://localhost:8084/kettle/listServices/
●Hit carte with SQL through JDBC…
●DEMO --> browser: http://localhost:8080 Pentaho BA Server
4.8.0 EE
![Page 8: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/8.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 8
Kettle 5 – Carte
●Data services a.k.a data federation
●http://wiki.pentaho.com/display/EAI/The+Thin+Kettle+JDBC+driver
![Page 9: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/9.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 9
Kettle 5 – Carte
●Data services
●Dynamically generated SQL
![Page 10: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/10.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 10
Kettle 5 – Carte
●Data services
●Exposes SQL from Mondrian in Carte log
●DEMO: Browser http://localhost:8084/
![Page 11: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/11.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 11
Kettle 5 – Carte
●Carte Plugins (build your own services)
● REST Services
●http://localhost:8084/api/carte/jobs
●http://localhost:8084/api/carte/transformations
●http://localhost:8084/api/carte/trans/log/<id>
●..
●DEMO: Show in browser
![Page 12: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/12.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 12
Kettle 5 – Design patterns
●Restartability
●Database transactions across Jobs & Transformations● http://wiki.pentaho.com/display/EAI/Database+transactions+in+jobs+and+transformations
●Job checkpoints and restartability● http://wiki.pentaho.com/display/EAI/Job+checkpoints+and+restartability
●Demo: show where to find the goodies in Spoon
![Page 13: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/13.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 13
Kettle 5 – Design patterns
●Looping over data, files, …
●Sub-jobs in transformations!
●Job Executor
●Demo: show in Spoon: Monitor Servers transformation
![Page 14: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/14.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 14
Kettle 5 – Design patterns
●Load balancing
●For transformations
●Data load monitoring of output buffer
●Demo: show in spoon
![Page 15: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/15.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 15
Kettle 5 – Usability
●Help buttons on steps and job entries
●Floating doc window, non modal
●DEMO: show Text File Input docs
![Page 16: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/16.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 16
Kettle 5 – Usability
●Continuous preview mode
●Work in progress
●DANGEROUS DEMO: Spoon open “CSV Input Example”
●+ Step select prev of Getting Started Transformation
![Page 17: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/17.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 17
Kettle 5 – Future
●Wrap up migration to Apache Ivy (nearly done)
●DEMO : show in Eclipse
●Implement metadata store back-end
●Top priority for the coming weeks
●MongoDB database connections, Sessions
manager, config mgt, data lineage, …
●Migrate PDI to Github when time permits
●Community Surprises.
![Page 18: © 2010, Pentaho. All Rights Reserved. . What is new in Kettle 5?](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5513bade55034653298b46c1/html5/thumbnails/18.jpg)
• © 2010, Pentaho. All Rights Reserved. www.pentaho.com. • US and Worldwide: +1 (866) 660-7555 | Slide 18
Kettle 5 – QA
●Thanks!
●Any questions?