I looked into using https://github.com/mybigday/llama.rn. Ultimately, it was too slow to be conversational. The demands of the rendering the WebGL would likely not help.
I made Cheqbook with my accountant co-founder after he got sick of only being able to recommend Quickbooks Desktop for his clients. Most people still use accounting on desktops and still have to move the company files around by thumb drive or email.
We tried the other online solutions first but found they were not proper accounting tools. They didn't have necessary reports and double-entry books. In most cases, we had to fight with the UI to get anything done. Ultimately, we built this so accountants and bookkeepers could handle more clients and business owners could concentrate on their business.
I agree. If you don't have any good sysadmin in your team, you are likely to be stuck at heroku. But then again, if you didn't have a sysadmin, you wouldn't have built it yourself. Starting at heroku or similar clone, still makes sense if your new thing may not make it past the first year. I guess it also depends what the business model is.
I've heard this a lot lately. Heroku uses super standard stuff (nginx,varnish,postgres,etc). I could move my stuff off Heroku in a matter of days. I used to do a lot of sysadmin work. I go with them because I can't devote time to sysadmin work anymore. Same reason I don't run my own mail servers anymore.
I second most of the listed services. Just because you can code or host your own systems, it doesn't mean you should. Any time spent on extraneous internal devices is a disservice to your core and customers.
Lastly, shameless plug but I think we have a better accounting solution in http://cheqbook.com
It was a while ago. If I was to do it over again I might try https://github.com/tirthajyoti-ghosh/expo-llm-mediapipe. Maybe newer models will help.