There are also a bunch of ideas coming out of academia, but I don't know how many of them have a sustained effort behind them and not just a couple of papers
Having worked for a SIEM vendor, I can say that all security software is extremely invasive, and most security people can probably track every action you make on company-issued devices, and that includes HTTPS decryption.
Prometheus push gateway maybe? I guess it depends on limitations like battery life, bandwidth and network access (maybe it's behind a NAT or something)
hnswlib is in cpp and has python bindings (you should be able to make your own for other languages). Faiss, Annoy (by Spotify) should also provide similar functionality.
If you really think that's enough to build a real product, go for it.
Even open-source companies (Elastic, Mongo, Scylla) have to build tons of infra around their core codebase in order to make it an actual cloud product.
While there's probably some value in posting the resources "everyone knows", Papers with Code was submitted multiple times in the past few years, which is a pretty common HN thing (whether this behavior is desired is up to dang and the community I guess).
I remember a talk where someone who did both software and hardware development for Intel talked about "Hardware development cycle fro software developers" or something like that at some conference, and the cost of simulating CPUs or fabricating them for a round of testing was absolutly mindblowing. Also - the fact the a 1 in a billion bug will happen multiple times a second on a modern CPU.
P.S Did anyone else happen to run into this talk? I tried to find on youtube and could'nt find anything related.
Ubuntu LTS on my laptop, because it's the closest I've found to "Just Works" status.
I run RHEL servers at work, but that's not my decision, though they are serious workhorses (albeit always somewhat outdated).
While there are some good recommendations here, I would defintely hire an expert (either in-house or some external contractor) to design and test the final solution.
NiFi is intended as a serious workhorse, we run it on a cluster with 256GM of RAM and over 20 cores for each server (on-prem), the 2GB of disk storage is negligible in any sort of scale (Just like the dual core/8gb machine)
From what I see in the B2B space, acquisitions are a major avenue for quick innovation. Large corporations buy smaller startup, do some integration into existing solutions and come out with a new product (If they don't just keep the new company as a separate costumer-facing identity (Look at NetApp + SolidFire, or the whole Dell-EMC conglomerate)
Quibi - they raised a billion (according to the media) before launching anything,and a video I can rotate doesn't sound like a revolutionary new form of media or art.