Author Topic: Some question regarding parallel programming concepts  (Read 14651 times)

faisal

  • Newbie
  • *
  • Posts: 5
    • View Profile
Some question regarding parallel programming concepts
« on: January 07, 2021, 03:34:35 PM »
Q1. What is the art of programming? Is it a book?
Q2. What is bus?
Q3. What is sequential and parallel programs?
Q4. Followup: What is concurrency?
Q5. Followup: What is difference between MPI(multi processing) and OPENMP(multi-threading)?
Q6. Is MPI multi-core and MP many segments within a core?


fmk

  • Administrator
  • Full Member
  • *****
  • Posts: 233
    • View Profile
Re: Some question regarding parallel programming concepts
« Reply #1 on: January 08, 2021, 04:46:26 PM »
1. not what i was refrring to the book by knuth (though that is where the term may have originated) ..  a philosophy about how to program that is widely articulated
2. bus something that communicates data between computer hw components (wires, optical fiber,..)
3. sequential is written to only use one ccore, parallel program written to use many cores
4. parts of a computation that are identified as being able to run in parallel
5. openmp provides a way of using multiple cores at same time with threads running in the same mempry space of a single process, in mpi there are no threads, the processes have seperate address spaces and communication is perfomred between them.
6. mp is between cores on a single cpu, mpi can be between a cores on a single cpu or between cores on different cpus