The Netezza Data Appliance: A Platform for High Performance Data Warehousing

Based on - Too many cooks spoil the data warehouse broth Cut your staffing costs By Eira Hayward (http://www.theregister.co.uk/2011/11/16/data_warehouse_staffing)

By Group 19: Yuefeng Hou, Ankit Kinra

Costs of Data WarehousingHardware, software, and

administration Hidden Costs: business units

outside the IT organizationGetting data in and out, not

productive, keep the surrounding business intelligence environment going

Challenges of Data WarehousingAnalyzing billions of data points and

petabytes of data through a sea of ambiguity

A huge amount of costInefficient use of manpowerPreventing analysts from trying new

thingsWaste opportunity, cost time and

resources, and put the company at risk

Netezza Data Warehouse and Analytics ApplianceHighly flexible and robust

warehouseMerges the traditional big data

approaches, coping with both structured and unstructured data

Simplifies the database environment

Resource can be used in a more productive manner

Implementation and ownership costs are much lower

Netezza Data Warehouse and Analytics ApplianceA technology foundation able to

sustain performance as more users run increasingly complex workloads and as data volumes continue to grow

Simple, reliable, and immediateAble to handle almost

incomprehensible workloads without complexity getting in the way

Netezza Architecture Principles

Processing close to data sourcePlatform for advanced analyticsAppliance SimplicityFlexible configurations and

extreme scalability.

Integration Example for Netezza

A typical monthly task takes about two weeks involves running financial prediction models on millions of customers when performed manually.

Creation of C/C++ task reduces the time on parallel Netezza architecture.

Reduces time but increases debugging and setting up time.

Solution?

Integration Example for Netezza (Cont.)SAS Suite operations inside

Netezza.Scoring accelerator removes

manual coding and has benefits of scalability and high performance.

Loading of data can be handled via partner application suite called Kalido which has many Automated Load Routines which simplify the loading tasks.

Relation with courseData Warehouse in chapter 29OLAP in chapter 29

References Netezza Blogs by Thomas Dinsmore (URL:

http://thinking.netezza.com/blog/netezza-and-sas-integration-best-practices)

The Netezza Data Appliance Architecture: A Platform for High Performance Data Warehousing and Analytics by Phil Francisco (URL http://www.netezza.com/documents/whitepapers/Netezza_Appliance_Architecture_WP.pdf )

Too many cooks spoil the data warehouse broth Cut your staffing costs By Eira Hayward (URL http://www.theregister.co.uk/2011/11/16/data_warehouse_staffing )

Much Ado about Loading by John Evans (http://blog.kalido.com/ado-loading/)

Questions ?