You probably ask for user's email and send them their secret special link that could be used over and over to restore the cookie? in case if they accidently delete their cookie?
So how does filtering work? I guess user would need to provide custom set of keywords? Can they specify Regex? Are keywords used against article title or against the whole body?
If you are matching against article body, do you have any logic that would determine location of "article meat" or "article body boundaries", i.e. would strip out header / footer / ads / comments / navigation links etc?
Yeah the 2015 will be the year when those $500MM of venture capital invested into Bitcoin would come to fruition with mainstream-friendly secure wallets, killer social apps (like Bitcoin Tipping Economy, BitExperts.com, etc)
It was my main lappy up until a year ago, and it has been travelling across North America and Eastern Europe with me with no issues.
It is now on its 3rd HDD, and original battery which lasts about 20 min now - not a problem since it is always plugged in. Everything else works real great, and it has MATTE monitor 1280 x 800. Everything works flawless, keyboard has no issues at all, other than looking a bit used :)
In fact HDD being PATA (not SATA) was the main reason why I have got myself used ThinkPad T-420 and stuffed it with dual SSD's (2nd SSD in an extra swappable CD-ROM bay from China for $10 shipping included), 16Gb of RAM, and used dual monitor docking station. Really hate that 13" 1600 x 900 screen - it is just too small after 15.4" on HP, and I also have to run fonts on 150%. Still taking my time to hook it up as my main rig through dock and dual monitors. Mostly using it now through Remote Desktop when I need Win 7 / Visual Studio 2013.
All these years I was hoping to wait over Win8 and glossy monitors, so with Win10 this summer I may actually get myself a new laptop - let's see if Microsoft has finally learned how not to screw their desktop users with tablet-optimized UI
IMHO, spammers have little chance against Google in a long run, here is why:
- it is of vital highest priority for Google to stay ahead of SEO spammers, or they may stand to lose their $$$ billion search business. So resources to fight spam will always be allocated
- it would take only 1 smart Google person to write smart algo, and it will get amplified by 100,000 server cores at Google. And Google employs >> 1 smart EE
- the Chrome browser has 50% market share and may collect enormous SERP quality / engagement metrics on what "end users" actually click in search results, how much time they spend there vs amount of content on that page, and what page finishes each search quest (i.e. user has found what they were looking for) - these are in fact one of the best "quality signals" available to Google.
- and Google could completely ignore signals from any Chrome instance that has even slightest suspect on being manipulated (Chrome is a native app so it could monitor mouse movement patterns, etc).
- I would say Google is much better equipped than spammers to keep staying ahead. Of course, there are going to be some short term advances in a black hat SEO or social networks manipulations, but eventually every serious loophole would get closed
Thanks! I've briefly looked at Splash and related projects like ScrapingHub, etc - looks like this niche is live and kicking...
The distributed scrapy-cluster is the way to go, if you need to crawl anything of decent size ( maybe even Amazon - 300+ MM webpages, j/k :)
I see a lot of Python based projects recently, even in Bitcoin niche, we even have a local Toronto based Python meetup. Looks like Python dev community is active.
I have a domain name PYFORUM.com - would it be good idea to launch a forum site? With Bitcoin tipping built-in? So instead of saying "Thanks" people would be able to send $0.25 in Bitcoin to those who helped them in the forums or made them laugh? What are the most established Python forums out there?
and then this announcement came across. Will be looking at what kind of crawlers they would release. Hopefully some modern ones based on a WebKit / Chromium core, that exposes DOM model and suitable for navigating all these AJAX script fueled modern web interfaces.
Also very interested to see what kind of Machine Learning / classifiers they are using. When working on our search engine, we were using purely statistical classifiers like all variations of Bayes, SVM (Support Vector Machines) and decision trees C4.5 glued together with some custom algos. We did not use neural nets at all. Nowadays, neural nets have a new name - "deep learning" and seem to be everywhere.
Really really interesting in terms of what people would build with an Open Source Search Engine. Watch out Google :)
https://getasgard.com - kudos on your landing page - it looks great, and is also informative.
Since you use blockchain ... What are incentives for people to actually run this blockchain on their computers? Are software packages themselves physically stored in a blockchain? Or just signed metadata about package, including external download url?
Sorry lots of questions... This is because I am getting over excited when I see projects related to crypto design / blockchain / Bitcoin
http://QRID.com - liberating people from passwords - mobile app / OpenID / OIDC Provider - allows touchless login to websites by scanning QR code on your monitor
http://BitExperts.com - almost like StackOverflow, but with Bitcoin tips and bounties. Also could be used for brainstorming ideas, with an optional bounty pool
http://BitNews.com - aggregates news headlines from 26 bitcoin websites in a mobile-friendly format
Not bad, not bad... And I like the domain name too. Also, reminds me of my own idea years back when domain name POOMA NEWS.com was available...
POOMA of course meant "Pulled Out Of", and I could not help with some double-"O" animated logo ideas either... Realized that constantly being funny is such a strain on your creativity, decided to use that towards solving serious problems :)
You probably ask for user's email and send them their secret special link that could be used over and over to restore the cookie? in case if they accidently delete their cookie?