Skip to content

home for all of the looping and chunking work#16

Merged
jeremypress merged 5 commits into
mainfrom
jp-prompt2
Jun 3, 2024
Merged

home for all of the looping and chunking work#16
jeremypress merged 5 commits into
mainfrom
jp-prompt2

Conversation

@jeremypress

@jeremypress jeremypress commented Jun 2, 2024

Copy link
Copy Markdown
Contributor

Why

  • we need to be able to handle large web pages
  • we're toying with the idea of handling sub steps to prevent annoyances when automating

what changed

  • cleaned up evals a little
  • added dom debug mode to see what the LLM sees
  • added new prompts for actions, along with looping and chunking logic

@jeremypress
jeremypress merged commit 4d0ba46 into main Jun 3, 2024
@pkiv
pkiv deleted the jp-prompt2 branch October 29, 2024 11:23
miguelg719 pushed a commit that referenced this pull request Jul 23, 2026
* make server graph service-worker compatible

* separate CDP multiplexing from WebSocket transport

---------

Co-authored-by: samfinton <samfinton@samfintons-MacBook-Pro.local>
shriyatheunicorn added a commit that referenced this pull request Jul 23, 2026
… routing + STAGEHAND_V4_SDK_PATH

Encodes the nondeterministic-suite cadence as data and wires attribution
end to end; makes the v4 SDK location explicit configuration.

- benchmarks/: manifest schema and expansion with validity rules
  (invalid combinations reported with reasons, never dropped silently);
  v4-vs-playwright manifest; GENERAL_HARNESS design doc; grading-
  decision README (v3-carried rubric verifier kept deliberately)
- framework/runner.ts: project routing - deterministic --sdk runs land
  in stagehand-v4-deterministic, external-harness and benchmark-matrix
  runs in stagehand-v4; experiment names and metadata carry the full
  (benchmark, harness, toolSurface) triple; sdk metadata inferred from
  the tool surface; v4Sha resolved from the configured checkout
- v4SdkLoader.ts: STAGEHAND_V4_SDK_PATH is the sole source of the v4
  SDK at runtime. The former link:../../v4-spike dependency (and its
  lockfile entry) is removed: it broke pnpm install on every fresh
  clone and CI runner lacking the nested checkout
- .v4-sdk-types/: generated SDK declarations are committed so typecheck
  works without any v4 checkout; regenerated against the SDK's logger-
  injection (onLog) surface; regenerate when the checkout moves (#16)
- initV4.ts: anthropic browser-CORS header via model config (no SDK
  patch needed); pure buildV4InitParams for browserless unit coverage;
  systemPrompt passthrough; SDK logs bridged into the eval logger via
  onLog so they land in Braintrust rows

Part of STG-2671
shriyatheunicorn added a commit that referenced this pull request Jul 23, 2026
… routing + STAGEHAND_V4_SDK_PATH

Encodes the nondeterministic-suite cadence as data and wires attribution
end to end; makes the v4 SDK location explicit configuration.

- benchmarks/: manifest schema and expansion with validity rules
  (invalid combinations reported with reasons, never dropped silently);
  v4-vs-playwright manifest; GENERAL_HARNESS design doc; grading-
  decision README (v3-carried rubric verifier kept deliberately)
- framework/runner.ts: project routing - deterministic --sdk runs land
  in stagehand-v4-deterministic, external-harness and benchmark-matrix
  runs in stagehand-v4; experiment names and metadata carry the full
  (benchmark, harness, toolSurface) triple; sdk metadata inferred from
  the tool surface; v4Sha resolved from the configured checkout
- v4SdkLoader.ts: STAGEHAND_V4_SDK_PATH is the sole source of the v4
  SDK at runtime. The former link:../../v4-spike dependency (and its
  lockfile entry) is removed: it broke pnpm install on every fresh
  clone and CI runner lacking the nested checkout
- .v4-sdk-types/: generated SDK declarations are committed so typecheck
  works without any v4 checkout; regenerated against the SDK's logger-
  injection (onLog) surface; regenerate when the checkout moves (#16)
- initV4.ts: anthropic browser-CORS header via model config (no SDK
  patch needed); pure buildV4InitParams for browserless unit coverage;
  systemPrompt passthrough; SDK logs bridged into the eval logger via
  onLog so they land in Braintrust rows (feature-detected against the
  loaded SDK's schema - older checkouts without onLog keep working)

Part of STG-2671
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant