Big Data and You

Varun Chandolachandola@buffalo.edu

http://www.buffalo.edu/~chandola

Computer Science & EngineeringUniversity at Buffalo, The State University of New York

Have You Met Big Data?

What is Big Data?

Fact or Fiction?

Fact or Fiction?

Big Data Landscape and Where You Fit In

The Rise of the Data Scientist

Is This the Best Time?

Machine Learning – Making Machines Intelligent!!

I “. . . gives computers ability to learn without beingexplicitly programmed.” – Arthur Samuel, 1959

Big Data and Machine Learning

I OpportunitiesI What can be done by applying ML to big data?I Applications, case studies, etc.

I ChallengesI How do ML methods handle the challenges of big data?

I ConcernsI What are the ethical, cultural, social impacts?I What does a black box ML system know about me?I Why?

Role of Machine Learning for Maximizing Big Data

I Commerce - recommendation systems, predictive analytics,churn prediction, fraud detection

I Science - climate change, sustainability, astronomy

I Social - network analysis, information propagation

Handling Challenges

I Big Volume:I Use big data architecturesI Make the data smallerI Make ML algorithms fasterI Stop when enough

I Big Velocity:I Streaming algorithmsI Online learning

I Big Variety:I Heterogeneous models