feat: update nuxt example for proper streaming support

[Hebilicious]

Resolves #196

Deployed here => https://nuxt-openai-vercel-hebilicious.vercel.app/

cc @danielroe

[changeset-bot]

⚠️ No Changeset found

Latest commit: a2b2f9a

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[pi0]

Hi @Hebilicious thanks for following this up 🚀 I think we can avoid this workaround and instead hotfix upstream (unenv, h3, nitro) to promote a proper working example.

I am currently working on some fixes.

[Hebilicious]

@pi0 i'll tag this as draft in the meantime. Do we have 3 separate tracking issues (unenv/h3/nitro) opened ?

Edit: The alias issue has been fixed with the latest unenv version.

[jaredpalmer]

Checking on this, what is status of streaming w/nuxt?

[pi0]

@jaredpalmer It is ready on edge release channels ready to release ~tomorrow on nuxt 3.7 👍🏼

@Hebilicious Would you please update PR with edge to verify?

[Hebilicious]

@pi0
Updating to nitro and h3 nightly :

• works on dev

• deploying on vercel edge :

{
    "url": "/api/chat",
    "statusCode": 405,
    "statusMessage": "HTTP method is not allowed.",
    "message": "HTTP method is not allowed.",
    "stack": ""
}

[Hebilicious]

Here's a separated repo with the deployed example : https://github.com/Hebilicious/nuxt-openai-vercel-edge-demo

Deployed here :

-vercel-edge preset : https://nuxt-vercel-edge-hebilicious.vercel.app/
-cloudflare-pages preset : https://d182f224.openai-nuxt-test.pages.dev/

The code works the same on all platforms and on dev.

Note: The code doesn't work without resolutions/overrides.

  "resolutions": {
    "h3": "1.8.0-rc.2",
    "nitropack": "2.5.2"
  }

[pi0]

Thanks for working on this dear @Hebilicious ❤️

I think it looks good to me. I have tested with your external repo and it works all fine (made few quick changes would be nice consider some from https://github.com/pi0/nuxt-openai-demo/tree/main)

Also if Vercel team is okay, it would probably be a good idea to merge PR as is with edge dependencies since is better than current example anyway and we will make sure to come with another PR as soon as stable nuxt/nitro with streaming support released 👍🏼

[danielroe]

We hope to have a new version of Nuxt + Nitro released in next couple of days. It might be worth deferring merge of this PR until that point.

[pi0]

Agreed let's wait to merge and announce by time of release! We can also remove nitro/h3 explicitly pins by next edge release of Nuxt (pending CI)

[MaxLeiter]

Marking this as a draft so it doesn't get accidentally merged. Please ping me here / on Slack when it's ready to go 🚀

@pi0 @danielroe @Hebilicious

[pi0]

Good news! h3 1.8 is released and immediately available for all Nuxt users. Just make sure to renew lock file and node_modules and remove any resolutions are you are good to go for vercel edge support! (validated on my repo ~> https://nuxt-openai-demo.vercel.app/).

[Hebilicious]

Updated the deps and the lockfile, this should be good to go 🚀

[MaxLeiter]

Thanks so much @Hebilicious, @pi0, and @danielroe! 🚀