Local wisper

[aadityamundhalia]

Description

This pr resolves the issue with uploading video and audio files mp3 and mp3. The installed whisper added to requirements.txt allows to transcribe the audio or video to txt and that is converted to langchains.

Checklist before requesting a review

Please delete options that are not relevant.

• My code follows the style guidelines of this project
• I have performed a self-review of my code
• I have commented hard-to-understand areas
• I have ideally added tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes -> was not able to to run the tests locally sorry I am not python programmer so got bit limited knowledge
• Any dependent changes have been merged

Video (if appropriate):

Wisper.mp4

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Sep 7, 2023 0:30am

[vercel]

@aadityamundhalia is attempting to deploy a commit to the Quivr-app Team on Vercel.

A member of the Team first needs to authorize it.

[aadityamundhalia]

If you guys can help me by explaining how I can run tests on local I will be able to do it on my next PR

[StanGirard]

Rename to whisper with an h

[aadityamundhalia]

done

[gozineb]

Hi @aadityamundhalia, just tested it locally and had the following error while upload the mp4 in the test files:

Can you please take a look at it ?

[aadityamundhalia]

@gozineb can you please share your .env file.
also you need to rebuild the containers so try:

docker-compose down
docker-compose -f docker-compose.dev.gpu.yml up -d --build

I will re run on my local to confirm

[gozineb]

I have updated my .env in the backend with LOCAL_WHISPER=True. I pruned and rebuilt the containers 🥲.
I have tested the make dev and the make prod which are used respectively in local and in prod. They should still be able to work after your changes.
Also, with docker-compose -f docker-compose.dev.gpu.yml up -d --build, i get the following error:

I run quivr on an apple M1

[aadityamundhalia]

@gozineb my apologies I did tested after my changes looks like it did no load the latest at that time. When retried was able to replicated the issue there was a small issue with the quotes that is now resolved. I will appreciate if you can have another go thanks

[StanGirard]

Thé issue might be that you don't have a gpu and therefore cannot test.

[aadityamundhalia]

@StanGirard this will work on cpu as well just bit slow but will work tried on my 12900k was no issues. There was an issue with my if statement that is now resolved. Try again please it should work

[gozineb]

@aadityamundhalia seems to be working now for make dev !! Still same issue with make prod though : Error processing file: cannot use a string pattern on a bytes-like object

And still getting the same error with the docker-compose -f docker-compose.dev.gpu.yml up -d --build

[aadityamundhalia]

@gozineb you can't run the gpu yml on Mac as Mac don't have gpu. Try the regular one like dev.yml

[gozineb]

Sorry @aadityamundhalia, still not working for me: Error processing file: cannot use a string pattern on a bytes-like object. Don't think it has anything to do with the gpu/MAC

[aadityamundhalia]

@gozineb I will try to create a step by step by step document for how to get it working will also try to run it on my m1 mac to see if there are any issues.

[aadityamundhalia]

@gozineb Sorry for late reply, I have not forgotten about this. Just bit occupied these days. So far I have learned that local wisper do not work on m1 mac.

[mamadoudicko]

Closing since it has been a while. Feel free to reopen it when you are available, @aadityamundhalia.