Data parallelism is an approach towards parallel processing that depends on being able to break up data between multiple compute units (which could be cores in a processor, processors in a computer, ...
When I wrote about password guessing using GPUs last week, I mentioned that password guessing is an embarrassingly parallel problem, right up there with 3-D rendering, face recognition, Monte Carlo ...
The first one I’ll go over today is task and data parallelism. What are they and what do they mean and then I’ll finish with talking a bit about Amdahl’s Law. Amdahl’s law is a very interesting ...