introduction to parallel computing with python
DESCRIPTION
An intro to parallel computing in python. There is example using mpi4py library. Mostly slide contains pictures, but hopefully the picture is describable.TRANSCRIPT
Introduction to Parallel Computing with PythonDoni Ramadhan
What is Parallel Computing?
What is MPI?
MPI Library for Python
Pros & Cons of MPI
Pros• Works
Concurrently• Optimize the
number of core• Tasks will be
finished faster
Cons• Needs time to
setup• Depends on
network throughput
• It is harder to program a parallel program
MPI Basics and Implementation
Environment Management
MPI_INITMPI_Comm_SizeMPI_Comm_RankMPI_WtimeMPI_Finalize
HelloWorld.py
Point-to-Point Communication
Point-to-Point Implementation
Buffering&Blocking vs. Non-Blocking Communication
Order and Fairness
Collective Communication
Broadcast
Scatter
Gather
Reduce
Output:
Matrix Multiplication