Skip to content

VinF Hybrid Inference: infer expected inputs from prompt (exploration) #8989

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: vaihi-exp-google-ai
Choose a base branch
from

Conversation

erikeldridge
Copy link

Problem Statement

Vertex doesn't require callers to pre-specify expected input types. Could we make the hybrid API do the same?

Findings

We can infer the types, but I'm unsure the complexity is worth the cost.

I'm putting up thie PR only for discussion.

@erikeldridge erikeldridge requested a review from a team as a code owner May 1, 2025 01:18
Copy link

changeset-bot bot commented May 1, 2025

⚠️ No Changeset found

Latest commit: 2dab7ea

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Copy link
Contributor

github-actions bot commented May 1, 2025

Vertex AI Mock Responses Check ⚠️

A newer major version of the mock responses for Vertex AI unit tests is available. update_vertexai_responses.sh should be updated to clone the latest version of the responses: v11.0

@google-oss-bot
Copy link
Contributor

Size Report 1

Affected Products

  • @firebase/vertexai

    TypeBase (31261ca)Merge (1bdde0d)Diff
    browser46.2 kB46.4 kB+238 B (+0.5%)
    main47.3 kB47.5 kB+238 B (+0.5%)
    module46.2 kB46.4 kB+238 B (+0.5%)
  • firebase

    TypeBase (31261ca)Merge (1bdde0d)Diff
    firebase-vertexai.js36.3 kB36.4 kB+120 B (+0.3%)

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/xz9KxI4Cl4.html

@google-oss-bot
Copy link
Contributor

Size Analysis Report 1

Affected Products

  • @firebase/vertexai

    • getGenerativeModel

      Size

      TypeBase (31261ca)Merge (1bdde0d)Diff
      size26.4 kB26.5 kB+116 B (+0.4%)
      size-with-ext-deps45.4 kB45.5 kB+116 B (+0.3%)

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/rL9ZsLlXeg.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants