Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchmarks available? #49

Open
kolinfluence opened this issue Nov 18, 2022 · 1 comment
Open

benchmarks available? #49

kolinfluence opened this issue Nov 18, 2022 · 1 comment

Comments

@kolinfluence
Copy link

kolinfluence commented Nov 18, 2022

hi, any benchmarks for ratio, speed, cpu usage and memory usage for >800bytes, 2k and 10k?
compared with zstd, lz4 and snappy? something like this extracted from zstd github

Compressor name | Ratio | Compression | Decompress.
-- | -- | -- | --
zstd 1.5.1 -1 | 2.887 | 530 MB/s | 1700 MB/s
zlib 1.2.11 -1 | 2.743 | 95 MB/s | 400 MB/s
brotli 1.0.9 -0 | 2.702 | 395 MB/s | 450 MB/s
zstd 1.5.1 --fast=1 | 2.437 | 600 MB/s | 2150 MB/s
zstd 1.5.1 --fast=3 | 2.239 | 670 MB/s | 2250 MB/s
quicklz 1.5.0 -1 | 2.238 | 540 MB/s | 760 MB/s
zstd 1.5.1 --fast=4 | 2.148 | 710 MB/s | 2300 MB/s
lzo1x 2.10 -1 | 2.106 | 660 MB/s | 845 MB/s
lz4 1.9.3 | 2.101 | 740 MB/s | 4500 MB/s
lzf 3.6 -1 | 2.077 | 410 MB/s | 830 MB/s
snappy 1.1.9 | 2.073 | 550 MB/s | 1750 MB/s
@siara-cc
Copy link
Owner

Hi, Thanks for your query. I saw your other message too. Unishox is for compressing short strings and not a replacement for lz4/zstd/snappy. It can co-exist with these technologies though.

The current implementation of Unishox2 is not great on speed so I am working on it and also Unishox3. The spec for Unishox3 is complete, but it is taking time to build the dictionary from millions of records from Reddit and Twitter posts. However you could use Unishox3-Alpha for now if you find it suitable for your case as I don't indent to change it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants