High Performance Parallel (and Sequential) C++ Algorithms, which accompany "Practical Parallel Algorithms in C++ and C#" book.

The above performance is in millions of unsigned 32-bit integers/second when sorting an array of 100 million elements. Benchmarks ran on Linux.

LSD Radix Sort single-core with two additional performance tools:

• novel two-phase implementation reduces passes over the array to (1 + D), where D is the number of digits
• de-randomization of writes to bins

Sorting algorithms provided in this repository:

• Single-core LSD Radix Sort: Novel Two Phase
• Multi-core Parallel LSD Radix Sort : linear time
• Multi-core Parallel Merge Sort
• Single-core In-Place Merge Sort
• Multi-core Parallel In-Place Merge Sort
• Single-core In-Place MSD Radix Sort: linear time
• Numerous hyrid sorting algorithms - e.g. Paralle Merge Insertion Sort
• Merge Radix Sort hybrids: linear time
• Improved adaptivity to memory resources, even with virtual memory
• Count Sort
• Parallel Histogram
• Block Swap
• Parallel Merge
• Radix Sort to support non-integer data types
• Safer Average calculations
• Blazing Fast sort of byte array
• De-Randomization of Radix Sort writes to bins
• Recursive and non-recursive Parallel Sum
• Bottom-up Non-Recursive In-Place Merge Sort

Windows support:

• VisualStudio 2022 Microsoft compiler and Intel's OneAPI compiler. Solution is included.
• Intel's Threading Building Blocks (TBB) and Microsoft's Parallel Patterns Library (PPL)
• C++17

Linux support:

• g++ using Intel's Threading Building Blocks (TBB)
• C++20

To install g++ which supports C++17:

sudo apt update
sudo apt upgrade
# reboot the machine
sudo apt install build-essential

To update gcc to support c++17 standard, Parallel STL and Intel's Threading Building Blocks (TBB):

sudo apt install libtbb-dev
git clone https://github.com/DragonSpit/ParallelAlgorithms.git
cd ParallelAlgorithms

To build on WSL Ubuntu, use g++ command and not gcc. The order of the following arguments matters!

g++ ParallelAlgorithms.cpp ParallelStdCppExample.cpp RadixSortLsdBenchmark.cpp MemoryUsage.cpp CountingSortParallelBenchmark.cpp SumBenchmark.cpp RadixSortMsdBenchmark.cpp ParallelMergeSortBenchmark.cpp -ltbb -std=c++20 -O3 -o ParallelAlgorithms

To build on AWS Ubuntu, use g++ command and not gcc. The order of the following arguments matters!

g++ ParallelAlgorithms.cpp ParallelStdCppExample.cpp RadixSortLsdBenchmark.cpp MemoryUsage.cpp CountingSortParallelBenchmark.cpp SumBenchmark.cpp RadixSortMsdBenchmark.cpp ParallelMergeSortBenchmark.cpp -ltbb -std=c++2a -O3 -o ParallelAlgorithms

To run it:

./ParallelAlgorithms

On Windows, Visual Studio 2022, free and paid versions are supported. To build the project use Visual Studio 2022 to open ParallelAlgorithms.sln file, then select Build/RebuildSolution. Once the project builds, select "Local Windows Debugger" to run it. Or, open the CommandPrompt application, go to the "x64\Release" directory, and run ParallelAlgorithms.exe.

By default, the solution/project uses Microsoft C++ compiler, which avoid requiring installation of Intel's OneAPI. Intel's OneAPI C++ compiler is supported by the ParallelAlgorithms.sln VisualStudio 2022 Solution. Once Intel's OneAPI, which is free, has been installed, select Project/IntelCompiler/UseIntelOneAPICompiler, followed by Build/RebuildSolution. Some of the algorithms are faster when build with Intel's OneAPI compiler.

Benchmarks of C++ Standard Parallel Algorithms (STL) are provided, with benchmark code in ParallelSTL repository, which builds and runs on Linix and Windows.

Blogs:

• Sorting 19X Faster than C++ Parallel Sort
• Parallel Merge for merging two arrays of any data type supporting comparison.
• Parallel Merge Sort for sorting arrays of any data type supporting comparison.
• Novel LSD Radix Sort (two-phase).
• Parallel Sort from Standard C++17.
• LSD Radix Sort for arrays of unsigned long's.