Ask HN: Decent, open source search engine?
4 comments
I started https://mitta.us as this, but am pivoting to prompt management for GPT-3. I've Open Sourced the code for the crawler here: https://github.com/kordless/grub-2.0. The entire system uses Google Vision for extracting text. I dislike fiddling with the DOM...
If you are interested in using Solr for this, I can provide instructions to you. I'm kordless at the gmails ... com. I'm going to release the entire code for doing this with the UI once my pivot is done.
If you drop me a line, I can let you preview the UI.
If you are interested in using Solr for this, I can provide instructions to you. I'm kordless at the gmails ... com. I'm going to release the entire code for doing this with the UI once my pivot is done.
If you drop me a line, I can let you preview the UI.
https://github.com/a5huynh/spyglass
> A personal search engine, crawl & index websites you want with a simple set of rules
> A personal search engine, crawl & index websites you want with a simple set of rules
It's still in development, but you could checkout searchhut[1] by the people from sourcehut.
[1]: https://git.sr.ht/~sircmpwn/searchhut
[1]: https://git.sr.ht/~sircmpwn/searchhut
Ideally, I want the search engine to crawl the links I give it so I can search the subpages of the sites too.
I know google has a “site:” parameter but I dont think I can put 50 sites into one google search