Same frustration with frameworks like Langchain and Llama_Index let me to build a simple UI base Agentic freamwork that runs locally. https://github.com/ranjanprj/agentollama
Agile/Scrum and all forms of project management is a scam you should work in layers serving layer above, have wbs and tasks assigned out of it in your layer, justifying urgency by impact on business/users, reward people who accept and close most tasks by appreciation and break. And fire anyone who misbehaves.
Micro services is a deployment pattern and not a development pattern you could build monolith and expose various services to and various parts with an Ingress and point of to the same monalic and for example in java project these various end points of the services inside the same on it would only load up the classes/objects which are relevant to that service. There is no overhead in terms of memory or CPU by placing monolith as micro services exposed by end points
I just ran a 2006 Java code to detect and read car license plate, and it ran in the first run on Java 17. The code is 17 years old and runs just fine without any issues. I think Java folks messed up AI/ML space due to licensing. But I still think it's best PL for AI/ML.
I read somewhere on HackerNews that Python is kinda like a default language and rest such as Go, C, C++, Java are just for Optimization, once you figure out your solution.
I'm a big fan of Postgres and this is really a nice project,
one question how does this compare to Apache Madlib.
Also is it safe to run untrusted extensions in Postgres which is serving transactions in production.
Shameless Plug: I have been building a similar Open-Source standalone tool that can provide AI/ML REST APIs, but would like to use embedded Postgres tackle big data/model problems.
https://github.com/rebataur/dskube