VinF Hybrid Inference #4: ChromeAdapter in stream methods

[erikeldridge]

#8917 enabled non-streaming methods to use Chrome's on-device model. This PR does the same for the streaming methods (generateContentStream and sendMessageStream).

[changeset-bot]

⚠️ No Changeset found

Latest commit: 86d47b0

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[github-actions]

Vertex AI Mock Responses Check ⚠️

A newer major version of the mock responses for Vertex AI unit tests is available. update_vertexai_responses.sh should be updated to clone the latest version of the responses: v8.0

[google-oss-bot]

Size Report ¹

Affected Products

• @firebase/vertexai

  Type	Base (d546aec)	Merge (75ebe54)	Diff
  browser	38.2 kB	38.8 kB	+663 B (+1.7%)
  main	39.1 kB	39.8 kB	+663 B (+1.7%)
  module	38.2 kB	38.8 kB	+663 B (+1.7%)

• firebase

  Type	Base (d546aec)	Merge (75ebe54)	Diff
  firebase-vertexai.js	34.7 kB	35.3 kB	+528 B (+1.5%)

Test Logs

• Base (d546aec): https://github.com/firebase/firebase-js-sdk/actions/runs/14255959303
• Merge (75ebe54): https://github.com/firebase/firebase-js-sdk/actions/runs/14389407142

1. https://storage.googleapis.com/firebase-sdk-metric-reports/VPDnYMfO4x.html

[google-oss-bot]

Size Analysis Report ¹

Affected Products

• @firebase/vertexai

  • ChatSession

    Size

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    size	16.0 kB	16.1 kB	+126 B (+0.8%)
    size-with-ext-deps	34.9 kB	35.0 kB	+126 B (+0.4%)

    Dependency

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    functions	22 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest createEnhancedContentResponse formatBlockErrorMessage formatNewContent generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	23 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest createEnhancedContentResponse formatBlockErrorMessage formatNewContent generateContent generateContentOnCloud generateContentStream generateContentStreamOnCloud generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentStreamOnCloud

  • GenerativeModel

    Size

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    size	19.2 kB	19.3 kB	+145 B (+0.8%)
    size-with-ext-deps	38.2 kB	38.3 kB	+145 B (+0.4%)

    Dependency

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    functions	25 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	26 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateContentStreamOnCloud generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentStreamOnCloud

  • ImagenModel

    Size

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    size	21.0 kB	21.1 kB	+145 B (+0.7%)
    size-with-ext-deps	39.9 kB	40.1 kB	+145 B (+0.4%)

    Dependency

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    functions	27 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	28 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateContentStreamOnCloud generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	+ generateContentStreamOnCloud

  • VertexAIModel

    Size

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    size	19.2 kB	19.3 kB	+145 B (+0.8%)
    size-with-ext-deps	38.2 kB	38.3 kB	+145 B (+0.4%)

    Dependency

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    functions	25 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	26 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateContentStreamOnCloud generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentStreamOnCloud

  • getGenerativeModel

    Size

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    size	21.5 kB	21.9 kB	+421 B (+2.0%)
    size-with-ext-deps	41.7 kB	42.1 kB	+421 B (+1.0%)

    Dependency

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    functions	26 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getGenerativeModel getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	27 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateContentStreamOnCloud generateResponseSequence getClientHeaders getFunctionCalls getGenerativeModel getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentStreamOnCloud

  • getImagenModel

    Size

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    size	21.1 kB	21.3 kB	+145 B (+0.7%)
    size-with-ext-deps	40.1 kB	40.3 kB	+145 B (+0.4%)

    Dependency

    Type	Base (d546aec)	Merge (75ebe54)	Diff
    functions	28 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getImagenModel getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	29 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateContentStreamOnCloud generateResponseSequence getClientHeaders getFunctionCalls getHeaders getImagenModel getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	+ generateContentStreamOnCloud

Test Logs

• Base (d546aec): https://github.com/firebase/firebase-js-sdk/actions/runs/14255959303
• Merge (75ebe54): https://github.com/firebase/firebase-js-sdk/actions/runs/14389407142

1. https://storage.googleapis.com/firebase-sdk-metric-reports/e4wN2OE6hA.html

[erikeldridge]

To avoid confusion, I'll close this in favor of #8949