Edit: I forgot to add how would I add the webpage to the databases already suggested here? Do I need to use a separate program to spider/index each site, and check for its updates?
I've been meaning to attempt running a custom search engine for particular sites I've 'bookmarked'. Some sites contain gold that could be useful in the future and is not often discovered in Google results.
Should I go the Postgres/Elasticsearch route or are somewhat out-of-the-box solutions available?
I've been wanting to run my own search engine sorta thingy that indexes websites I feed it. I sometimes find little nooks of the net that post resources I may need in the future. Like my own mini-Google that indexes a list of sites.
How can I go about creating this? Are their off-the-shelf solutions, will I need to say combine scrapy with elastic search? The links in this thread look promising.
I must say, Swift is a pretty good writer; yet this perception is warped by my surprise to be honest. I guess I'll go looking out for more of her written works when I next have a free moment to make a better judgement.