An Introduction to Parallel Programming

Lecture Notes, Study Materials and Important questions answers

Subject : An Introduction to Parallel

Programming
Chapter 1 Why Parallel Computing
1. Why Parallel Computing? - Answer (click here)
2. Why We Need Ever-Increasing Performance - Answer (click here)
3. Why We’re Building Parallel Systems - Answer (click here)
4. Why we Need to Write Parallel Programs - Answer (click here)
5. How Do We Write Parallel Programs? - Answer (click here)
6. Concurrent, Parallel, Distributed - Answer (click here)

Chapter 2 Parallel Hardware and Parallel Software

1. Parallel Hardware and Parallel Software - Answer (click here)
2. Some Background: von Neumann architecture, Processes, multitasking,
and threads - Answer (click here)
3. Modifications to the Von Neumann Model - Answer (click here)
4. Parallel Hardware - Answer (click here)
5. Parallel Software - Answer (click here)
6. Input and Output - Answer (click here)
7. Performance of Parallel Programming - Answer (click here)
8. Parallel Program Design with example - Answer (click here)
9. Writing and Running Parallel Programs - Answer (click here)
10. Assumptions - Parallel Programming - Answer (click here)

Chapter 3 Distributed Memory Programming with MPI

1. Distributed-Memory Programming with MPI - Answer (click here)
2. The Trapezoidal Rule in MPI - Answer (click here)
3. Dealing with I/O - Answer (click here)
4. Collective Communication - Answer (click here)
5. MPI Derived Datatypes - Answer (click here)
 6. Performance Evaluation of MPI Programs - Answer (click here)
7. A Parallel Sorting Algorithm - Answer (click here)

Chapter 4 Shared Memory Programming with Pthreads

1. Shared-Memory Programming with Pthreads - Answer (click here)
2. Processes, Threads, and Pthreads - Answer (click here)
3. Pthreads - Hello, World Program - Answer (click here)
4. Matrix-Vector Multiplication - Answer (click here)
5. Critical Sections - Answer (click here)
6. Busy-Waiting - Answer (click here)
7. Mutexes - Answer (click here)
8. Producer-Consumer Synchronization and Semaphores - Answer (click here)
9. Barriers and Condition Variables - Answer (click here)
10. Read-Write Locks - Answer (click here)
11. Caches, Cache Coherence, and False Sharing - Answer (click here)
12. Thread-Safety - Answer (click here)
13. Shared-Memory Programming with OpenMP - Answer (click here)
14. The Trapezoidal Rule - Answer (click here)
15. Scope of Variables - Answer (click here)
16. The Reduction Clause - Answer (click here)
17. The parallel For Directive - Answer (click here)
18. More About Loops in Openmp: Sorting - Answer (click here)
19. Scheduling Loops - Answer (click here)
20. Producers and Consumers - Answer (click here)
21. Caches, Cache Coherence, and False Sharing - Answer (click here)
22. Thread-Safety - Answer (click here)
23. Parallel Program Development - Answer (click here)
24. Two n-Body Solvers - Answer (click here)
25. Parallelizing the basic solver using OpenMP - Answer (click here)
26. Parallelizing the reduced solver using OpenMP - Answer (click here)
27. Evaluating the OpenMP codes - Answer (click here)
28. Parallelizing the solvers using pthreads - Answer (click here)
29. Parallelizing the basic solver using MPI - Answer (click here)
30. Parallelizing the reduced solver using MPI - Answer (click here)
31. Performance of the MPI solvers - Answer (click here)
32. Tree Search - Answer (click here)
33. Recursive depth-first search - Answer (click here)
34. Nonrecursive depth-first search - Answer (click here)
35. Data structures for the serial implementations - Answer (click here)
36. Performance of the serial implementations - Answer (click here)
37. Parallelizing tree search - Answer (click here)
38. A static parallelization of tree search using pthreads - Answer (click here)
39. A dynamic parallelization of tree search using pthreads - Answer (click
here)
40. Evaluating the Pthreads tree-search programs - Answer (click here)
41. Parallelizing the tree-search programs using OpenMP - Answer (click here)
42. Performance of the OpenMP implementations - Answer (click here)
43. Implementation of tree search using MPI and static partitioning - Answer
(click here)
44. Implementation of tree search using MPI and dynamic partitioning -
Answer (click here)
45. Which API? - Answer (click here)