Gnu Parallel - Parallelize Serial Command Line Programs Without Changing Them

Gnu Parallel - Parallelize Serial Command Line Programs Without Changing Them

This site gives a good explanation of how to get started using Gnu Parallel, which can be used to break up data files into chunks that can be run concurrently rather than serially processing through the entire file.