Skip to content

Publish Toolkit CLI nightlies to GHCR - #1393

Merged
BYK merged 1 commit into
mainfrom
fix/toolkit-cli-nightly
Oct 3, 2026
Merged

BYK merged 1 commit into
mainfrom
fix/toolkit-cli-nightly

Conversation

@BYK

@BYK BYK commented Oct 3, 2026 •

Copy link
Copy Markdown
Member

Summary

  • Stamp all five main-branch standalone binaries with the commit-timestamp nightly version.
  • Generate optional delta patches against the preceding Toolkit nightly and publish rolling plus versioned OCI manifests with job-scoped package permissions.
  • Verify anonymous access, source/version annotations, and all five compressed platform layers after publishing. Keep the installer on legacy GHCR until this public-read check succeeds on main.

Validation

  • pnpm run tsc and pnpm run lint passed after generating the CLI schema. pnpm run test:ci-projects passed 16 tests.
  • Focused upgrade, GHCR, delta, installer, and CLI-upgrade suites passed 434 tests; the isolated ZIP suite passed 15 tests.
  • Full pnpm run test reached 10,254 passing CLI tests and 16 skipped; the unrelated ZipWriter large-content test timed out at 15 seconds under the full suite. Its isolated rerun passed.
  • pnpm run docs:check and pnpm run pre-commit:generated passed.

Stamp main-branch binaries with the commit-timestamp nightly version, generate optional deltas from the preceding Toolkit image, and publish rolling and versioned manifests. Require anonymous access and verify the five platform layers after publication.

Co-Authored-By: GPT-6 Sol (OpenAI) <agent@openai.com>
@github-actions github-actions Bot added the risk: medium PR risk score: medium label Oct 3, 2026
@BYK
BYK merged commit ac8389a into main Oct 3, 2026
34 checks passed
@BYK
BYK deleted the fix/toolkit-cli-nightly branch October 3, 2026 15:14
mr-danya pushed a commit to mr-danya/sentry-mcp that referenced this pull request Oct 6, 2026
---
Upgrades the default skill-eval agent models from the older
`claude-sonnet-4.6` / `claude-opus-4.6` pair to the requested newer
models.

## Changes
- `DEFAULT_AGENT_MODELS` in `test/skill-eval/helpers/llm-client.ts` →
`anthropic/claude-sonnet-5`, `openai/gpt-5.6-luna`
- `AGENT_MODELS` default in `test/e2e/skill-eval.test.ts` → same pair
- updated doc comments in `script/eval-skill.ts` to match

Model IDs use the existing OpenRouter slug convention
(`<provider>/<model>`). The judge model (`claude-haiku-4.5`) is left
unchanged. Both models remain env-overridable via `EVAL_AGENT_MODELS`.

Closes getsentry#1392
---

---------

Co-authored-by: jared-outpost[bot] <jared-outpost[bot]@users.noreply.github.com>
mr-danya pushed a commit to mr-danya/sentry-mcp that referenced this pull request Oct 6, 2026
---
Upgrades the default skill-eval agent models from the older
`claude-sonnet-4.6` / `claude-opus-4.6` pair to the requested newer
models.

## Changes
- `DEFAULT_AGENT_MODELS` in `test/skill-eval/helpers/llm-client.ts` →
`anthropic/claude-sonnet-5`, `openai/gpt-5.6-luna`
- `AGENT_MODELS` default in `test/e2e/skill-eval.test.ts` → same pair
- updated doc comments in `script/eval-skill.ts` to match

Model IDs use the existing OpenRouter slug convention
(`<provider>/<model>`). The judge model (`claude-haiku-4.5`) is left
unchanged. Both models remain env-overridable via `EVAL_AGENT_MODELS`.

Closes getsentry#1392
---

---------

Co-authored-by: jared-outpost[bot] <jared-outpost[bot]@users.noreply.github.com>
mr-danya pushed a commit to mr-danya/sentry-mcp that referenced this pull request Oct 6, 2026
---
Upgrades the default skill-eval agent models from the older
`claude-sonnet-4.6` / `claude-opus-4.6` pair to the requested newer
models.

## Changes
- `DEFAULT_AGENT_MODELS` in `test/skill-eval/helpers/llm-client.ts` →
`anthropic/claude-sonnet-5`, `openai/gpt-5.6-luna`
- `AGENT_MODELS` default in `test/e2e/skill-eval.test.ts` → same pair
- updated doc comments in `script/eval-skill.ts` to match

Model IDs use the existing OpenRouter slug convention
(`<provider>/<model>`). The judge model (`claude-haiku-4.5`) is left
unchanged. Both models remain env-overridable via `EVAL_AGENT_MODELS`.

Closes getsentry#1392
---

---------

Co-authored-by: jared-outpost[bot] <jared-outpost[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

risk: medium PR risk score: medium

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant