bigdata machine learning platform
TRANSCRIPT
2015.01
Bigdata Machine Learning Platform
BICubeTM
BICubeTM
http:www.bicube.co.kr
2BICubeTM
Bigdata Machine Learning Platform
Sqoop Flume
HDFS (Hadoop Distributed File System)
Zookeeper
Yarn(2.0)
MapReduce
HivePig
Mahout
Mashup
RDB
Preprocess Classify Cluster Associate Visual
BICube
RDB Mashup SNS Crawler
Authent ication
CubeM
anager
Log Crawler
Machine Learning Engine
Spark
SparkSQL
SparkStream GraphXML
Storm Kafka Akka
BioinfoManipul
Mesos
BICubeTM Architecture
3BICubeTM
Bigdata Machine Learning Platform
• MultiLinearRegression, KoreanMorpheme
• Logistic Regression, SVM, Adaboost, Neural Network
• RandomForest, NaiveBayssian, Timeseries Analysis
• Kmeans, LDA, HMM, PCA, SVD, CRF, TDA
• Covariance, Correlation, ROC, LSA, EigenFace Image
• CF Recommender, ConfusionMatrix, AUC
• Bagging, Wagging, ArcX4,LogitBoost,ModestAdaboost
• SAMME,BinaryClibration, IsonicCalibration...
• Discriminant Adaptive Nearist Neighbor
• Hierachical agglomerative clustering
• Kernel Recursive Least Square,Radial Base Network
• Local scaled density base clustering, EMGaussianMixture
• Sequential minimum optimization,Dual coordinate Descent
• T-Test, F-Test, G-Test, Chi-square-Test Anova etc….
BICubeTM Algorithms
4BICubeTM
Bigdata Machine Learning Platform
Document-Topic Matirx ViewerDocument-Topic Matirx Viewer
Latent Dirichlet Allocation on Hadoop
5BICubeTM
Bigdata Machine Learning Platform
Word-Topic Matirx ViewerWord-Topic Matirx Viewer
Latent Dirichlet Allocation on Hadoop
13BICubeTM
Bigdata Machine Learning Platform
3D Visualization on GPU3D Visualization on GPU
Unstructured Document Clustering
20BICubeTM
Bigdata Machine Learning Platform
Trade Market Prediction
Recurrent Neural Network Feedfoward Neural Network(Elman) Counterpropagation Neural Network
Hopfield Neural NetworkBoltzman Neural NetworkNeat Neural NetworkSom Neural NetworkArt 1 Neural NetworkBam Neural NetworkAdaline Neural Network
Stock Market Analysis using ANN
26BICubeTM
Bigdata Machine Learning Platform
PointCloud on GPU for Topological Data AnalysisPointCloud on GPU for Topological Data Analysis
3D Point Cloud for TDA
27BICubeTM
Bigdata Machine Learning Platform
Module Manager Add components by yourself–
Module Manager by DIY type
28BICubeTM
Bigdata Machine Learning Platform
Process Manager- Process UI Design Manager
UI Manager by DIY type