Use of XxHash instead of or besides MD5

Suggestions and feature requests.
Post Reply
Message
Author
Dominik Rutschmann
Posts: 3
Joined: 13.05.2012, 10:48

Use of XxHash instead of or besides MD5

#1 Post by Dominik Rutschmann » 13.03.2017, 14:37

Hello,

I wanted to suggest to use the XxHash instead of the MD5 hash or at least offer the possibility to use xxHash instead of MD5. XxHash is open source , offers the same quality as MD5 as a hash for file comparison and integrity checks, but is much faster than MD5.

Here is the page for further information: https://github.com/Cyan4973/xxHash

Best regards,

Dominik Rutschmann

Zorkoff
Posts: 109
Joined: 10.05.2011, 21:14
Location: Boston, MA

Re: Use of XxHash instead of or besides MD5

#2 Post by Zorkoff » 13.03.2017, 18:27

MD5 is very useful for comparing downloaded files with the published MD5 values from the website.

File Hippo gives an MD5 for each of the files that can be downloaded.

SHA-1 and SHA-256 are also offered by some download sites and would be more useful than XxHash (which I have never seen a published value).

Dominik Rutschmann
Posts: 3
Joined: 13.05.2012, 10:48

Re: Use of XxHash instead of or besides MD5

#3 Post by Dominik Rutschmann » 17.06.2017, 00:49

I wouldn't want that Freecommander completely drops support for MD5, but to offer it at least as an option for creating Hash values. Because in comparison to XX-Hash MD5 is SO much slower, especially the implementation Freecommander uses.
I ran a small test with an 1,67GB Linux image:
MD5 with Freecommander: 1m02s
xxHashx64 with Teracopy: 0m09s
MD5 with Teracopy: 0m12s

I am going to run some further Benchmarks on my e350 CPU, where the difference between xxHash and MD5 were much bigger in Teracopy.


Now on my E350 Processor with a 2GB file:
Teracopy: MD5 00m21s; xxHashx64 00m24s
Freccommander MD5 03m38s

I compared the MD5 values of Teracopy and FreecommanderXe and they are the same. So it isn't the case that Teracopy uses a lower precession algorithm (if that is even possible). FreecommanderXE ist just extremely slow in generating MD5 hashes.

Post Reply

Who is online

Users browsing this forum: No registered users and 4 guests