portable implementation of crc64ecma for both x86_64/AArch64 using SIMD (SSE/NEON)

[lihuiba]

Translated from the assembly implementation of ISA-L.

Its performance compared to the asm implementations is similar in X86_64, and ~2x faster in M1.

in MBP with M1 ARM CPU:

Note: Google Test filter = TestChecksumBig.crc64*
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from TestChecksumBig
[ RUN      ] TestChecksumBig.crc64ecma_hw
crc64ecma_hw_portable time spent: 1246389 us (40.12 GB/s
[       OK ] TestChecksumBig.crc64ecma_hw (1337 ms)
[ RUN      ] TestChecksumBig.crc64ecma_hw_asm
crc64ecma_hw_asm(crc64_ecma_refl_pmull) time spent: 2177113 us (22.97 GB/s)
[       OK ] TestChecksumBig.crc64ecma_hw_asm (2182 ms)
[----------] 2 tests from TestChecksumBig (3520 ms total)

[----------] Global test environment tear-down
[==========] 2 tests from 1 test suite ran. (3520 ms total)
[  PASSED  ] 2 tests.

in a server with Intel Xeon X86_64 CPU:

Note: Google Test filter = TestChecksumBig.crc64*
[==========] Running 2 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 2 tests from TestChecksumBig
[ RUN      ] TestChecksumBig.crc64ecma_hw
crc64ecma_hw_portable time spent: 3841106 us (13.02 GB/s)
[       OK ] TestChecksumBig.crc64ecma_hw (3919 ms)
[ RUN      ] TestChecksumBig.crc64ecma_hw_asm
crc64ecma_hw_asm(crc64_ecma_refl_by8) time spent: 4064074 us (12.30 GB/s)
[       OK ] TestChecksumBig.crc64ecma_hw_asm (4102 ms)
[----------] 2 tests from TestChecksumBig (8021 ms total)

[----------] Global test environment tear-down
[==========] 2 tests from 1 test case ran. (8021 ms total)
[  PASSED  ] 2 tests.

in a server with Neoverse-N1 ARM CPU:

Note: Google Test filter = TestChecksumBig.crc64*
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from TestChecksumBig
[ RUN      ] TestChecksumBig.crc64ecma_hw
crc64ecma_hw_portable time spent: 5248720 us (9.53 GB/s)
[       OK ] TestChecksumBig.crc64ecma_hw (5393 ms)
[ RUN      ] TestChecksumBig.crc64ecma_hw_asm
crc64ecma_hw_asm(crc64_ecma_refl_pmull) time spent: 5277467 us (9.47 GB/s)
[       OK ] TestChecksumBig.crc64ecma_hw_asm (5287 ms)
[----------] 2 tests from TestChecksumBig (10681 ms total)

[----------] Global test environment tear-down
[==========] 2 tests from 1 test suite ran. (10681 ms total)
[  PASSED  ] 2 tests.

[Coldwings]

LGTM

[Coldwings]

Maybe we should make those mcpu like args be a configurable option, so users can make their own choice.

[lihuiba]

Definitely! You can make it later, as well as an option for the assemblies and nasm in test-checksum.