I came here to ask about the cost of this based on the number of tokens. Since this prompt is repeated on every single request, isn't there a way to embed it when you load the model? Or they simply use the raw OpenAI API like any of us mortals?
In 1996 at my first job as a programmer, the company had a system where the password field in the login screen was obscured by using wingdings as the font. :)
Motorway | Senior Developers (backend, frontend, UI), Director of Engineering, IT Support Engineer | London, or Remote (depends on position) | Full-time | https://careers.motorway.co.uk
All details about Motorway in the link above. We use React, NodeJS, Postgres, Redis, NextJS, among others technologies. I can confirm it's a great place to work. Feel free to email me at my username at gmail.com if you have questions.