kickstarting the transition to parallel computing with ... · inventing the future of computing...
TRANSCRIPT
![Page 1: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/1.jpg)
Inventing the Future of Computing
Kickstarting the Transition to Parallel Computing With Open Hardware
Andreas Olofsson
[email protected] Linux Collaboration Summit 2013
April 15th-17th, 2013 – San Francisco, CA
1
![Page 2: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/2.jpg)
What is Adapteva?
2
Possibly the World’s Smallest Semiconductor
Company
64-core 28nm 100 GFLOPS
Coprocessor @2W
Now Also a System Company…
#1 in Processor Energy Efficiency at
50 GFLOPS/Watt
![Page 3: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/3.jpg)
The Computing Energy Crisis: IT’S REAL!!
3
0
1
10
100
1,000
10,000
100,000
1,000,000
10,000,000
100,000,000
1990 1995 2000 2005 2010 2015 2020 2025 2030
System ProcessingNeedsLegacy ProcessingEfficiency
“The Efficiency Gap” Von Neumann Saturation
![Page 4: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/4.jpg)
The Ideal World
4
Inf B RAM
CPU (Inf Hz)
Inf B/sec
![Page 5: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/5.jpg)
The Real World: Performance is Saturating!
5
4. Add Cores
3. SIMD
1. Scale Frequency
Now What?
2. Multi Issue
![Page 6: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/6.jpg)
Power Consumption
Thermal Density
Memory Bottlenecks
Latency Wall
Wiring
Frequency Wall
Yield Issues
Time to Market
Software Complexity
Amdahl’s Law
10 Trends that Will Shape the Future of Computing
6
![Page 7: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/7.jpg)
Nature is Massively Parallel
7
Efficient
Robust Hetero-geneous
Parallel
![Page 8: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/8.jpg)
The Heterogeneous Computing Vision
8
SYSTEM-ON-CHIP
BIG CPU
FPGA
BIG CPU
BIG CPU
BIG CPU
100’s of small RISC CPUs GPU Analog
![Page 9: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/9.jpg)
The Current State of Parallel Programming
9
How To Make Every Programmer a Parallel Programmer?
Source: Github
![Page 10: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/10.jpg)
10
Industry Challenges Before Us
• Rebuild the computer ecosystem
• Rewrite billions of lines of code
• Re-educate millions of programmers
• Rewrite the education curriculum
![Page 11: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/11.jpg)
11
No Computing Parallel Computing
“Von Neumann Age” Serial Computing
1943-2013?
No Electronic Computing
-1943
Parallel Computing 2013-??
Any Reason to Think the Future of Computing is NOT Parallel?
![Page 12: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/12.jpg)
What is Parallella?
12
“A $99 credit card sized parallel computing platform”
![Page 13: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/13.jpg)
Parallella Principles
13
• PARALLEL: • Heterogeneous and scalable parallel hardware
• OPEN: • Open source O/S (Linux) • Open chip documentation • Open source drivers and SDK • Open source hardware (board schematics, docs, layout) • Open standards (OpenCL, OpenMP, MPI, ...)
• ACESSIBLE: • $99 starting point • Easy to use novice progammers
![Page 14: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/14.jpg)
Parallella Kickstarter Stats
14
• ”$99 Linux supercomputer” • 5,000 backers • 6,300 boards ”pre-sold” in 4 weeks • 67 countries, all 50 US states • 50-75% of backers are developers • 5,000 more signups since Jan 1st • Customer Application Classes:
• SDR (GNU Radio) • Ray tracing/rendering • Image processing • Robotics • Gaming
• Cryptography • Media Server • Distributed Computing • Signal processing • HPC
![Page 15: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/15.jpg)
The Parallella Architecture
15
Dual Core ARM A9
AXI BUS
MIO
SHARED DRAM
“O/S” DRAM
USB OTG USB 2.0
UART Ethernet
SD-CARD I2C
DAC/ADC IF HDMI
Controller
AXI-MASTER AXI-SLAVE
“Glue-Logic”
Daughter Card
AXI-MASTER
Zynq FPGA
Zynq “Hard”
Off-Chip
MEM-CTRL
“Sandbox” EPIPHANY
![Page 16: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/16.jpg)
For the first time in public…
16
PARALLELLA-16 PARALLELLA-64
• Zynq Dual Core ARM A9 • 16-core Epiphany Accelerator • 1GB RAM • GbE, USB, HDMI, uSD • 6 GB/s expansion connectors • $99 (long term goal)
• Same as PARALLELLA-16, with • 64-core Epiphany Accelerator
First Parallella-16 Power-Up was at 1:30pm on April 11
![Page 17: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/17.jpg)
Parallella Bring-up Day 1
17
![Page 18: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/18.jpg)
Parallella Bring-up Day 2
18
![Page 19: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/19.jpg)
Parallella Bring-up Day 3
19
Epiphany Coprocessor Read/Write
Success
![Page 20: Kickstarting the Transition to Parallel Computing With ... · Inventing the Future of Computing Kickstarting the Transition to Parallel Computing With Open Hardware . Andreas Olofsson](https://reader034.vdocuments.mx/reader034/viewer/2022050718/5e1713b24bc7ab561b3c82d3/html5/thumbnails/20.jpg)
Parallella – What’s Next?
20
Ship 6,300 Boards ASAP
Start the Parallella Academic Program
Start working on Parallella-1024
Build a sustainable supply model