GeezerVison

When strided weights are used, the mean function typically returned random results.
The produced result of mean is no longer dependent on platform or processing style (linear, strided, on CPU or GPU)

Description

b74f28f sum on CPU now has the same precision as other platforms

• Introduction of Kahan summation algorithm for series. This algorithm reduced the error when a series of summations are performed with values of varying sizes.
  With this introduction, the difference in result of a linear array and strided array is minimal. The precision in the tests are as a result improved.
  As result, the precision of many tests can be improved now since all platforms generate similar results, independent from parallel or serial processing.

9307d6f Fixes to mean, on all platforms
All:

• Introduction of Kahan summation algorithm for series. This algorithm reduced the error when a series of summations are performed with values of varying sizes.
  With this introduction, the difference in result of a linear array and strided array is minimal. The precision in the tests are as a result improved.
• Negative weights can no longer generate a division by zero.
• In most cases sub-arrays would generated random results with strided weights.

CPU:

• the idxs of the weights array is now calculated according to its own strides iso the strides of the input array.

CUDA:

• Param were used without full initialisation. Because the construction of Param’s are deprecated, they are replaced by the createEmptyArray() constructions.
• Idxs of weights are now calculated according to its own strides. Idem for the offsets.
• Small arrays are processed on the CPU. Strides arrays are now processed on the GPU, independent from size since the CPU version only handles linear arrays.

ONEAPI:

• Idxs of weights are now calculated according to its own strides. Idem for offsets.
• Param were used without full initialisation. Because the construction of Param’s are deprecated, they are replaced by the createEmptyArray() constructions.
• Small arrays are processed on the CPU. Strides arrays are now processed on the GPU, independent from size since the CPU version only handles linear arrays.
• Offsets are handle for the linear processing.

OPENCL:

• Idxs of weights are now calculated according to its own strides. Idem for offsets.
• When converting a linear array to a vector, the weights offsets were overwritten.
• The size of the tmpOut and tmpWeight arrays are now correctly sized. Intermediate results were overwritten resulting in a mean of a part of the array.
• Small arrays are processed on the CPU. Strides arrays are now processed on the GPU, independent from size since the CPU version only handles linear arrays.
• Param were used without full initialisation. Because the construction of Param’s are deprecated, they are replaced by the createEmptyArray() constructions.

TEST:
- extra tests added on all temporary formats.
- allowed fault tolerance for tests is lowered, since now the correct mean is calculated for all backends.
- MeanAllTest now uses random data iso constants for testing. This blocked the detection of partial processing of the input.

Additional information about the PR answering following questions:

• Is this a new feature or a bug fix? BUG
• More detail if necessary to describe all commits in pull request.
• Why these changes are necessary. CORRECT RESULTS WERE NOT GUARANTEED
• Potential impact on specific hardware, software or backends. NONE
• New functions and their functionality. NONE
• Can this PR be backported to older versions? NO
• Future changes not implemented in this PR. NO
  Fixes:

Changes to Users

Better precision in all circumstances, and independent form platform or array format.

Checklist

• Rebased on latest master
• Code compiles
• Tests pass
• Functions added to unified API
• Functions documented