Summary

• The serial part or the communication overhead of the code limits the scalability of the code (Amdahl Law)
• Programs have to be ᢛ% parallel to use large (ᡖ proc) machines
• Several Programming Models are in use today:
  • Shared Memory programming (SMP) (with Automatic Compiler parallelization, Data-Parallel and explicit Shared Memory models)
  • Message Passing model
• Choosing a Programming Model is largely a matter of the application, personal choice and target machine. It has nothing to do with scalability.
  • Don’t confuse Algorithm and implementation
• Machines with a global address space can run applications based on both, SMP and Message Passing programming models

Previous slide

Back to first slide

View graphic version