big data analytics
TRANSCRIPT
Big Data AnalyticsBen FountainMay 2016
2
What is Big Data?
“The dynamically linked super set of multiple significant scale discrete data sets.”
-Oscar Wilde
Characteristics include• Large volumes, typically adding terabytes of data daily• Aggregation of many historically discrete data sets• Dynamic links between the data setsConsequently • Any analysis is a point in time position
3
Why care?
• Better intelligence which can be leveraged in business, healthcare etc. to target efforts;
• Cost of a DNA analysis has reduced by around 5 orders of magnitude since the process became possible, making personalised medicines a reality in the near future.
• If you are investing in Big Data projects, the risk of data loss doesn’t necessarily change. The Volume of loss is potentially colossal with impacts that aren’t understood for an extended period.
• Customers hold concerns about companies taking a role of Orwellian Big Brother.
4
There’s no Best Practice…yet
Breaches• Snowden showed that Government organisations with specific focus on
security struggle to control Big Data and the associated risks.• Panama Papers showed that legal firms with an inherently high level of
confidentiality in their practices struggle.Compliance issues• Harder to define the purpose of data exploration.• Big Data breaches tend to be….bigger.• Regulators will expect technology to be used equally to exploit and
control Big Data.
5
Key Controls for Big Data1. Track all access that collects, views, and manipulates sensitive data, and ensure that it is
encrypted at each point.2. Encryption keys for sensitive data can't be stored at the same location as the data.3. All access and processing of data must be logged. These logs must be subject to human and
automatically monitoring.4. Use automated scanning to constantly monitor systems for vulnerabilities and malware.5. Monitor network egress for anomalies in traffic.6. Create a number of "false flag“ records. Configure alerts and blocks to identify and prevent
data breaches.
6
How to use Big Data Analytics?
Prescriptive AnalyticsHow can we influence the future?
Predictive AnalyticsHow can we plan for the future?
Diagnostic AnalyticsWhy did this happen?
Descriptive AnalyticsDo we know what happened?
Ana
lytic
s M
atur
ity
His
toric
al
Ana
lytic
sPr
oact
ive
Ana
lytic
s
7
Police use of Predictive Analytics
The California city of Fresno is just one of the police departments in the US already using a software program called “Beware” to generate “threat scores” about an individual, address or area.
As reported by the Washington Post in January, the software works by processing “billions of data points, including arrest reports, property records, commercial databases, deep web searches and the [person’s] social media postings”.Photo: Nick Otto/For The Washington PostQuote :https://www.theguardian.com/technology/2016/feb/04/us-police-data-analytics-smart-cities-crime-likelihood-fresno-chicago-heat-list
8
How to do it well
Staff appropriately• Specialist Skills are in demand;
• Big Data• Data Management
• Have a plan to recruit and retain them!Data Quality• Big Data Leaders show maturity in data quality
9
Final Point
Big Data is a pre-requisite of the desire for better analytics, the desire to better understand. Of itself, its just a large data set waiting to breach.
10
Points of contact
Ben FountainSenior Consultant
M: +44 (0) 7545 503 311E: [email protected]
NCC Group Blogshttps://www.nccgroup.trust/uk/about-us/newsroom-and-events/blogs/
TED Talks on Big Datahttps://www.ted.com/search?q=big+data
11
Experiment
“The dynamically linked super set of multiple significant scale discrete data sets.”
-Oscar Wilde
Well that’s a lie.
12
NCC Locations
EuropeManchester - Head OfficeAmsterdamBasingstokeCambridgeCopenhagenCheltenhamDelft Edinburgh GlasgowLeatherhead LeedsLondonLuxembourgMadridMalmöMilton KeynesMunichVilniusZurich
AustraliaSydney
North AmericaAtlantaAustinChicagoKitchenerNew YorkSan FranciscoSeattleSunnyvale