- amazon s3 · • we have experienced the good, the bad, the ugly • we have documented the data...
TRANSCRIPT
![Page 1: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/1.jpg)
www.solverglobal.com
![Page 2: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/2.jpg)
www.solverglobal.com
Cloud Integration Paths (WTS2)
Using Sql Connector and Data Gateway
![Page 4: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/4.jpg)
www.solverglobal.com
Session Objectives
• Today we will examine:• Sql Connector and Data Gateway connectors for client side data access• Client side objects consumable by Cloud Integrations• Variations of client side objects• Pros and Cons of multiple data provisioning paths
![Page 5: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/5.jpg)
www.solverglobal.com
Session Agenda
• Connectors and their usability, Sql vs Gateway• Views versus Tables• SSIS in the mix• Extending data sourcing for FX Rates and control tables• Rules are your silver bullet• Leveraging existing infrastructure
![Page 6: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/6.jpg)
www.solverglobal.com
Connectors
• All data consumption in the Cloud is thru a connector• We will concentrate on 2 of the most flexible
• Sql Connector• Data Gateway
![Page 7: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/7.jpg)
www.solverglobal.com
Sql Connector
![Page 8: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/8.jpg)
www.solverglobal.com
Sql Connection Info
![Page 9: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/9.jpg)
www.solverglobal.com
What does the Sql Connector see
• Tables• Views• Note view to table is not 1 to 1• Views can contain logic
• For mappings• For filtering• For ????
![Page 10: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/10.jpg)
www.solverglobal.com
Sql Connector Pros & Cons
• Pros• Standard technology that just works• Flexibility of exposed objects• Supported on many data sources• Builds on MSSQL skill sets
• Cons• Not encrypted• Connection from internet is not recommended
• Caveat• BI360 Cloud is built on Azure SQL. Any Data source on Azure SQL(SaaS) is
easily accessible.
![Page 11: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/11.jpg)
www.solverglobal.com
Data Gateway Connector
![Page 12: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/12.jpg)
www.solverglobal.com
Gateway Setup
• Looks familiar because it is• Built on the Sql connector• Supports same objects
• Tables• Views
• Added layer for security• Allows connections thru firewalls
• SSL connection from client• Data push rather than pull
• Request is separate from data• Data is sent on secure connection
![Page 13: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/13.jpg)
www.solverglobal.com
Gateway Pros & Cons
• Pros• Based on standard technology (Sql Connector)• Secured data transmission• Flexible object support• Builds on MSSQL skill sets
• Cons• Data set size limitations• Requires constant server\client ping communication• Installed as a service that needs some management
![Page 14: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/14.jpg)
www.solverglobal.com
Data Source Requirements
• Data Source Definition• How many sources• How many locations• Remote or local• Data access security• Data Source Definition
• Data Source Transformations• COA consistency• Calendar consistency• Mapping needs• Any other transform that could require complex logic
![Page 15: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/15.jpg)
www.solverglobal.com
Cloud & Client Integration touch points
• How do we reconcile what the Cloud wants with what the client side provides
• We really cannot change much in how the cloud gets the data• Basic drag and drop functionality• Some transformations• Little dynamic structure• No logic application or looping type structures
![Page 16: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/16.jpg)
www.solverglobal.com
Cloud Integration
![Page 17: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/17.jpg)
www.solverglobal.com
Where are we now in the process?
• We know what the Cloud integrations want and need to be effective• We have experienced the good, the bad, the ugly
• We have documented the data sources• Documentation can never be discounted
• We have defined the transformations and other needs• A functional specification document becomes a decision tool
![Page 18: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/18.jpg)
www.solverglobal.com
Two paths to the same end
• Views on ERP tables • SQL Server Data Tools
![Page 19: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/19.jpg)
www.solverglobal.com
How to decide – Define an exit strategy
• Is this client a long term management prospect?• Is this client a one and done prospect?• How complex is the integration?• What are your skill sets?• What are the client skill sets?
![Page 20: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/20.jpg)
www.solverglobal.com
Scenario #1- It doesn’t get any simpler
• Great Plains integration• 1 entity• Single calendar• Low transactional data count• No currency conversion• Key item: Client will allow to build your source objects on the ERP
Server
![Page 21: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/21.jpg)
www.solverglobal.com
Scenario #1 Solution
• Views with 2 part naming (included with Cloud tenant)
• <dbname>.dbo.GL10110• Easy to implement• Performance is good• Little need for external logic• Simple to maintain• All stored on 1 SQL Server• Easy for client to backup• Easy for client to monitor• ETL is run in off hours for minimal
impact on ERP processes
![Page 22: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/22.jpg)
www.solverglobal.com
Scenario #1 Solution
![Page 23: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/23.jpg)
www.solverglobal.com
Scenario #1 Solution
![Page 24: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/24.jpg)
www.solverglobal.com
Scenario #1 Solution
![Page 25: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/25.jpg)
www.solverglobal.com
Scenario #1 Solution
![Page 26: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/26.jpg)
www.solverglobal.com
Scenario #1 Solution
![Page 27: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/27.jpg)
www.solverglobal.com
Scenario #2
• 3 Distinctly different data sources• Multiple calendars that need merged• Multiple COA’s that are mapped to an authority• All data sources are remote with nothing but read access• Currency conversion from multiple sources• Must load conversion rates from one ERP source• Other complex interactions and rules for translating source data to a
common design
![Page 28: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/28.jpg)
www.solverglobal.com
Scenario #2 Solution
• Much more complexity• Interim steps and transforms needed• Data sourcing for a Cloud feature there is not direct integration to• Ready made for an SSDT backend populating staging tables
• Easy to implement from familiar templates• Extended logging and error handling capabilities• Common tools and skill sets• Easy to manage once implemented
![Page 29: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/29.jpg)
www.solverglobal.com
Scenario #2 Solution Caveats
• Does require client provisioning a staging server• Extra cost for implementation• Extra management for IT
![Page 30: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/30.jpg)
www.solverglobal.com
Scenario #2 Solution – Dimensions
![Page 31: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/31.jpg)
www.solverglobal.com
Scenario #2 Solution – Fact Sets
![Page 32: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/32.jpg)
www.solverglobal.com
Scenario #2 Solution – Fact Sets
![Page 33: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/33.jpg)
www.solverglobal.com
Scenario #2 Solution – Conversion Rates
![Page 34: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/34.jpg)
www.solverglobal.com
Scenario #2 Solution – Conversion Rates
![Page 35: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/35.jpg)
www.solverglobal.com
Scenario #2 Solution – Conversion Rates
![Page 36: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/36.jpg)
www.solverglobal.com
BI360DW as a data source
• Ready made source for cloud views• ETL is already in place and data cleaned• Quick way to migrate to the cloud
![Page 37: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/37.jpg)
www.solverglobal.com
BI360 Dim Source for view
![Page 38: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/38.jpg)
www.solverglobal.com
BI360 Fact source for view
![Page 39: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/39.jpg)
www.solverglobal.com
Bonus Content – Period Control
• In a cloud integration how do we control the drop\load process• We can map and integration and select periods
• Those period selection are static• There is no dynamic “Between Current Period – 2 and Current Period”
• We can write rules to do deletes• Rule still need a source of how many periods to delete• Temp tables like PH implements are not there
![Page 40: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/40.jpg)
www.solverglobal.com
Bonus Content – Period Control as a dim
![Page 41: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/41.jpg)
www.solverglobal.com
Bonus Content – Period Control as a dim
![Page 42: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/42.jpg)
www.solverglobal.com
Bonus Content – More……..
• Dimensions can be stand alone, do not need to associate to a module• Can easily be managed in the portal or updated via integrations
• Dimensions make excellent staging tables for dynamic content• Rules are a powerful tool to achieve complex ends
• Learn the rule syntax and experiment
• Jobs can wrapper integration steps and rules• Dimensions + Rules + Jobs = Successful processes in the Cloud
![Page 43: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/43.jpg)
www.solverglobal.com
Key Takeaways & Resources
• No single solution• Know your clients• Be creative
![Page 44: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/44.jpg)
www.solverglobal.com
Your feedback is valuable:
![Page 45: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/45.jpg)
www.solverglobal.comwww.solverglobal.com
THANK YOU!• Alan Rittberger, Technical Service Lead, Solver• Toby Price, Senior Integration Engineer, Solver
![Page 46: - Amazon S3 · • We have experienced the good, the bad, the ugly • We have documented the data sources • Documentation can never be discounted • We have defined the transformations](https://reader035.vdocuments.mx/reader035/viewer/2022070814/5f0d6f597e708231d43a570e/html5/thumbnails/46.jpg)
www.solverglobal.com