how to develop big data

Download How to develop big data

Post on 19-Jul-2015




6 download

Embed Size (px)


Big Data architecture

How to Develop Big Data Phoenix SuWhat is Big data? ()

Web siteOld dataUser trackingUser inputMany raw dataMany raw dataUseful infoHowMany raw dataUseful info213Useful infoProviderProviderProviderWeb siteOld dataUser trackingUser inputMany raw dataMySQLDB2RDBMS RDBMS RDBMS Useful info23Many raw dataMySQLDB2RDBMS1Useful info23Many raw dataMySQLDB2RDBMS1Message QueueSocketHTTPSQLUseful infoMany raw dataMySQLDB2RDBMSMessage QueueSocket / HTTP / SQL Process Hadoop ()(16:00)+(16:00+30)++ (16:00+30+30) 16:00~17:00 16:00~16:30 16:30~17:00

Useful infoMessage QueueSocket / HTTP / SQL

Useful infoProvider NoSQL MongoDBRedisCassandra.Target Data Source Data Store for raw data Raw Data Algorithm Data Processor Data Store for useful data Provider Big Data