tag:github.com,2008:https://github.com/segmentio/ctlstore/releasesTags from ctlstore2024-02-16T20:24:37Ztag:github.com,2008:Repository/197225253/v0.0.92024-02-16T20:24:37Zv0.0.9: Upgrade go-sqlite3 to v1.14.22 (#142)<p>Upgrade go-sqlite3 to v1.14.22 (<a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/142">#142</a>)</p>
<p>## Description</p>
<p>Update the `go-sqlite3` dependency for Ctlstore to get to the latest upstream version from <a href="https://github.com/mattn/go-sqlite3">https://github.com/mattn/go-sqlite3</a>.</p>
<p>Notably we depend on a Segment-specific fork that includes a patch which enables preupdate hooks for our code without requiring a build-time flag to be manually put into place by all users of the ctlstore library.</p>
<p>## Details</p>
<p>This depends on <a class="issue-link js-issue-link" href="https://github.com/segmentio/go-sqlite3/pull/9">segmentio/go-sqlite3#9</a> to allow the `go get` to succeed.</p>
<p>Once that is merged, we deleted the [segment-v1.14.22](<a href="https://github.com/segmentio/go-sqlite3/releases/tag/segment-v1.14.22">https://github.com/segmentio/go-sqlite3/releases/tag/segment-v1.14.22</a>) tag in that repo and recreated it as [v1.14.22-segment](<a href="https://github.com/segmentio/go-sqlite3/releases/tag/v1.14.22-segment">https://github.com/segmentio/go-sqlite3/releases/tag/v1.14.22-segment</a>).</p>
<p>> [!TIP]
<br />> Despite fixing the `master` of go-sqlite3 to [update module path](<a href="https://github.com/segmentio/go-sqlite3/blob/b9c49a6eaf4ca03f2515c9ef9334d20741363b3b/go.mod#L1">https://github.com/segmentio/go-sqlite3/blob/b9c49a6eaf4ca03f2515c9ef9334d20741363b3b/go.mod#L1</a>), I was getting errors doing `go get` after deleting and recreating the `segment-v1.14.22` tag like so:
<br />> ```
<br />> % go get github.com/segmentio/go-sqlite3@segment-v1.14.22
<br />> go: github.com/segmentio/go-sqlite3@segment-v1.14.22 (v1.14.23-0.20240208202956-73b5bef61db6) > requires github.com/segmentio/go-sqlite3@v1.14.23-0.20240208202956-73b5bef61db6: parsing go.mod:
<br />> module declares its path as: github.com/mattn/go-sqlite3
<br />> but was required as: github.com/segmentio/go-sqlite3
<br />> ```
<br />>
<br />> <a class="user-mention notranslate" href="https://github.com/kevinburkesegment">@kevinburkesegment</a> explained this was likely due to the Go package cache, so we decided to just delete that previous tag and not try to recreate it. Instead we created a tag with a different name.</p>
<p>Testing completed successfully:
<br />* [x] ensure CI runs
<br />* [x] verify on other services that include ctlstore client, when those services are updated. <a href="https://segment.atlassian.net/browse/IO-1695">https://segment.atlassian.net/browse/IO-1695</a></p>
<p>> [!NOTE]
<br />> Replacement for PR <a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/140">#140</a> which had the wrong version number in its branch name.</p>erikdwtag:github.com,2008:Repository/197225253/v0.0.82023-11-30T14:40:02Zv0.0.8: Multi-Shoveler Open and Close (#131)<p>Multi-Shoveler Open and Close (<a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/131">#131</a>)</p>
<p>* start up multiple reflectors
<br />* Concurrent ldb downloads
<br />* Add rotating reader and tests
<br />* add convenience methods
<br />* use go 1.13 friendly atomic interface
<br />* add support for multiple LDB copies in InitContainer
<br />* only create dbs if they don't exist
<br />* reopen and close last rotated reader
<br />* create a changelog for first ldb in multimode</p>wavetylortag:github.com,2008:Repository/197225253/v0.0.72023-11-01T19:10:07Zv0.0.7: properly check errors while shoveling (#130)<p>properly check errors while shoveling (<a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/130">#130</a>)</p>
<p>* properly check errors while shoveling</p>
<p>* address another parallel test suite not copying test case var</p>
<p>* add reflector poll timeout configuration cli arg</p>wavetylortag:github.com,2008:Repository/197225253/v0.0.62023-10-06T20:18:44Zv0.0.6: [CONFIG-329][CONFIG-330] End to end snapshot integrity check (#124)<p>[CONFIG-329][CONFIG-330] End to end snapshot integrity check (<a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/124">#124</a>)</p>
<p>* refactor supervisor to use sdk v2 and add checksum</p>
<p>* open another reader to get checksum</p>
<p>* make generate</p>
<p>* refactoring</p>
<p>* hex encoding</p>
<p>* don't calculate</p>
<p>* use metadata</p>
<p>* WIP test</p>
<p>* wip</p>
<p>* wip</p>
<p>* WIP</p>
<p>* WIP</p>
<p>* WIP</p>
<p>* fix install</p>
<p>* WIP</p>
<p>* wip</p>
<p>* wip</p>
<p>* chmod</p>
<p>* install s3cmd from alpine</p>
<p>* install aws-cli in alpine</p>
<p>* install shasum in alpine</p>
<p>* wip</p>
<p>* test if sha value matches</p>
<p>* wip</p>
<p>* fix shell syntax error</p>
<p>* add 5 attempts threshold</p>
<p>* skip checksum validation if null</p>
<p>* test unhappy path</p>
<p>* revert false negative</p>
<p>* address feedbacks</p>
<p>* fix script</p>
<p>* test unhappy path</p>
<p>* revert false negative</p>
<p>* using sha1</p>
<p>* update log to avoid confusion</p>
<p>* fix wording</p>
<p>---------</p>
<p>Co-authored-by: Hongyu Zhou <hongyu.zhou@segment.com></p>zhou-hongyutag:github.com,2008:Repository/197225253/v0.0.52023-08-11T13:57:08Zv0.0.5: Script for downloading snapshots using s5cmd and pigz (#120)<p>Script for downloading snapshots using s5cmd and pigz (<a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/120">#120</a>)</p>
<p>* add s5cmd to image
<br />* add pigz to test faster decompress
<br />* add downloading to script
<br />* add concurrency parameter
<br />* Add metrics to the download script</p>wavetylortag:github.com,2008:Repository/197225253/v0.0.42023-08-03T15:20:30Zv0.0.4: Update sqlite version (#113)<p>Update sqlite version (<a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/113">#113</a>)</p>
<p>* update sqlite version</p>
<p>* fix merge</p>
<p>* fix int test</p>
<p>* update version</p>
<p>---------</p>
<p>Co-authored-by: Taylor Brennan <taylor.brennan@segment.com></p>kalamaytag:github.com,2008:Repository/197225253/v0.0.32022-10-28T23:37:58Zv0.0.3aklishtag:github.com,2008:Repository/197225253/v0.0.22022-07-11T11:54:15Zv0.0.2<p>feat(testing): improve support for running parallel tests with ctlsto…</p>
<p>…re (<a class="issue-link js-issue-link" href="https://github.com/segmentio/ctlstore/pull/95">#95</a>)</p>dominicbarnestag:github.com,2008:Repository/197225253/v0.0.12021-11-18T22:26:27Zv0.0.1