Parallel shells with xargs: Utilize all your cpu cores on UNIX and Windows

Posted by bob on Feb 17, 2021 1:33 PM EDT
Linux Journal; By Charles Fisher
Mail this story
Print this story

One particular frustration with the UNIX shell is the inability to easily schedule multiple, concurrent tasks that fully utilize CPU cores presented on modern systems. The example of focus in this article is file compression, but the problem rises with many computationally intensive tasks, such as image/audio/media processing, password cracking and hash analysis, database Extract, Transform, and Load, and backup activities. It is understandably frustrating to wait for gzip * running on a single CPU core, while most of a machine's processing power lies idle.

Full Story

  Nav
» Read more about: Story Type: Tutorial; Groups: Community, GNU, Linux, Microsoft

« Return to the newswire homepage

This topic does not have any threads posted yet!

You cannot post until you login.