I don't think it hallucinates very much. If a customer asks a question that is answerable based on documents you uploaded, it will find the answer! I am working on a playground to showcase the RAG.
Our first post is here https://theairevolution.beehiiv.com/p/firstissue
It has 30 links of interesting new things we found on Twitter, Hackernews, Github, Reddit, and ProductHunt. Let me know what you think!
Show HN:
I created a website using the unofficial ChatGPT API to answer questions from an image input. The questions are transcribed and equations in the image are converted into LaTex. The text input is then fed into ChatGPT. The response is shown in real time, with all equations being converted back to LaTex.
- Planning on cleaning up code and open sourcing. If anyone is interested in contributing feel free to reach out at [email protected]
- Going to try to embed the audio files to create similarity clusters.
- Might add folder upload so that producers can upload large loop libraries and have their sounds clustered or allow them to search their library through natural language.
- If you have any ideas for cool things I could add or improve, feel free to leave it in a comment or reach out through my email!
I used the Freesound.org api (https://freesound.org/help/developers/) to download a bunch of sounds to MongoDB. Specifically, I selected to include the ID, Name, Tags, Description, Previews, Images, and Analysis in the response. I then looped through all these sounds and combined the response info into a prompt for GPT Davinci, instructing it to create a descriptive paragraph about the sound. I combined Davinci's description with the Freesound.org descriptions and embedded it using Ada. I inserted the embeddings into Pinecone with the audio preview url and ID as metadata. Then I just embed the search query and compare it with the sound embeddings (Pinecone allows you to select what type of similarity, I used cosine) and return the 25 most similar sounds.
Thanks for the great feedback, I really appreciate it!
1. I'll definitely add some good examples, I think that will help with getting better sounds.
2. Working on improving the UI right now
3. Going to add this in the next push as well. For now reach out at [email protected]
Where do the tests run? Is it testing the prod app?