tag:github.com,2008:https://github.com/minio/zipindex/releases 2024-08-19T17:23:40Z tag:github.com,2008:Repository/362186994/v0.4.0 2024-10-11T10:21:54Z <p>Add chunked encoding of large directories (<a class="issue-link js-issue-link" href="https://github.com/minio/zipindex/pull/16">#16</a>)</p> <p>When warm, it provides a nice speedup:</p> <p>``` <br />BEFORE:</p> <p>BenchmarkFindSerialized/100-32 84632 14027 ns/op 24.28 b/file 84632 files/s 5062 B/op 4 allocs/op <br />BenchmarkFindSerialized/1000-32 13371 88087 ns/op 23.32 b/file 13371 files/s 49398 B/op 4 allocs/op <br />BenchmarkFindSerialized/10000-32 1491 769408 ns/op 20.66 b/file 1491 files/s 451106 B/op 4 allocs/op <br />BenchmarkFindSerialized/100000-32 163 7350855 ns/op 20.25 b/file 163.0 files/s 4499216 B/op 5 allocs/op <br />BenchmarkFindSerialized/1000000-32 15 175437187 ns/op 20.16 b/file 7.500 files/s 44978624 B/op 6 allocs/op</p> <p>AFTER: <br />BenchmarkFindSerialized/100-32 89673 13144 ns/op 24.28 b/file 89673 files/s 216 B/op 4 allocs/op <br />BenchmarkFindSerialized/1000-32 15356 78862 ns/op 23.32 b/file 15356 files/s 220 B/op 4 allocs/op <br />BenchmarkFindSerialized/10000-32 1663 719424 ns/op 20.66 b/file 1663 files/s 228 B/op 4 allocs/op <br />BenchmarkFindSerialized/100000-32 170 6894286 ns/op 20.25 b/file 170.0 files/s 26760 B/op 4 allocs/op <br />BenchmarkFindSerialized/1000000-32 16 67916169 ns/op 20.16 b/file 16.00 files/s 2812044 B/op 4 allocs/op <br />```</p> <p>* Add new chunked format for faster FindSerialized.</p> <p>It kicks in at 25000 dir entries. Ensures that performance will be somewhat linear.</p> <p>Bumps index limit to 1B.</p> <p>``` <br />BenchmarkFindSerialized/100-32 88186 13926 ns/op 24.28 b/file 88186 files/s 216 B/op 4 allocs/op <br />BenchmarkFindSerialized/1000-32 14157 82875 ns/op 23.32 b/file 14157 files/s 220 B/op 4 allocs/op <br />BenchmarkFindSerialized/10000-32 1562 757547 ns/op 20.66 b/file 1562 files/s 225 B/op 4 allocs/op <br />BenchmarkFindSerialized/100000-32 567 2101872 ns/op 21.66 b/file 567.0 files/s 1164419 B/op 10 allocs/op <br />BenchmarkFindSerialized/1000000-32 583 2035905 ns/op 21.73 b/file 583.0 files/s 1181472 B/op 47 allocs/op <br />```</p> klauspost tag:github.com,2008:Repository/362186994/v0.3.1 2024-07-15T11:52:51Z <p>Sync upstream changes (<a class="issue-link js-issue-link" href="https://github.com/minio/zipindex/pull/15">#15</a>)</p> <p>Notably includes <a class="issue-link js-issue-link" href="https://github.com/golang/go/issues/66869">golang/go#66869</a> and `RemoveInsecurePaths()` for <a class="issue-link js-issue-link" href="https://github.com/golang/go/issues/55356">golang/go#55356</a></p> klauspost tag:github.com,2008:Repository/362186994/v0.3.0 2022-08-25T08:19:58Z <p>Clean up and documentation (<a class="issue-link js-issue-link" href="https://github.com/minio/zipindex/pull/12">#12</a>)</p> <p>Add format description.</p> klauspost tag:github.com,2008:Repository/362186994/v0.2.1 2021-10-14T13:50:23Z klauspost tag:github.com,2008:Repository/362186994/v0.2.0 2021-04-29T09:15:54Z klauspost tag:github.com,2008:Repository/362186994/v0.1.0 2021-04-28T16:26:36Z klauspost