20150625 cloudera

Download 20150625 cloudera

Post on 04-Aug-2015

826 views

Category:

Technology

1 download

Embed Size (px)

TRANSCRIPT

1. HBase IT 2 2. 2Copyright Recruit Technologies Co., Ltd. All Rights Reserved. etc RTC IT 2G 5 SIerJavaC++ Android 20144 3. 3Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase 4. 4Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 1 2 3 4 5 6 HBase HBase HBase HBase 7 5. 5Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 6. 6Copyright Recruit Technologies Co., Ltd. All Rights Reserved. Server Database 9824 1 PB 7. 7Copyright Recruit Technologies Co., Ltd. All Rights Reserved. Hadoop 28,344 1038 1JOB 1Hbase 8. 8Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 200 240 9. 9Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase 10. 10Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase Hadoop Hive 11. 11Copyright Recruit Technologies Co., Ltd. All Rights Reserved. Hive 12. 12Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase 1. 2. 3. 13. 13Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase2 API API 14. 14Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase 15. 15Copyright Recruit Technologies Co., Ltd. All Rights Reserved. Web HBase API Hadoop API API 16. 16Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API 17. 17Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API key value Hash 18. 18Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API key CF1 CF2 CD CD ID CD CD 19. 19Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 1. HBase 2. Hashkey 3. key 4. 5. Hive 20. 20Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase 21. 21Copyright Recruit Technologies Co., Ltd. All Rights Reserved. Web HBase API Hadoop API API 22. 22Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API 23. 23Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API IDCD 24. 24Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API IDkey key CF1 CF2 CD CD ID CD CD 25. 25Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API key key value CD 26. 26Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API 27. 27Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API IDkey key value CD CD 28. 28Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API key key value CD 29. 29Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API 30. 30Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 1. 1. 2. 3. API 31. 31Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 32. 32Copyright Recruit Technologies Co., Ltd. All Rights Reserved. PUT importTSV CompleteBulkload 33. 33Copyright Recruit Technologies Co., Ltd. All Rights Reserved. ZooKeeper ZooKeeper CompleteBulkload 34. 34Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase tomcat API ZooKeeper Hadoop 35. 35Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase tomcat API ZooKeeper Hadoop 36. 36Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase tomcat API ZooKeeper Hadoop 37. 37Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 38. 38Copyright Recruit Technologies Co., Ltd. All Rights Reserved. word2vec 1-of- w(t) w(t-1) w(t+1) w(t+2) w(t-2) INPUT PROJECTION OUTPUT log ( + | ),,0 INPUT: 1-of-k PROJECTION: soft-max OUTPUT: ((+)|()) 39. 39Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase API tomcat API 40. 40Copyright Recruit Technologies Co., Ltd. All Rights Reserved. A CVR 156 3.57% 9.15 B CVR 31 46.59% 61.13 41. 41Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase 42. 42Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase 2.7% 16.7% 30.8%CVR 43. 43Copyright Recruit Technologies Co., Ltd. All Rights Reserved. 44. 44Copyright Recruit Technologies Co., Ltd. All Rights Reserved. HBase HBase ZooKeeper 45. 45Copyright Recruit Technologies Co., Ltd. All Rights Reserved. DB A B C D E w(t) w(t+1) w(t+5) w(t-1) w(t-5) 46. 46Copyright Recruit Technologies Co., Ltd. All Rights Reserved. Yes, We Are Hiring! 47.