One of my buddies that got into SEO a half decade before I did mentioned the copy and paste rankeroo stuff was real popular back in the days of Infoseek, Altavista, Excite, Lycos and similar.
Google looks for the canonical version of a document and then deduplicates before returning the result set.
You can add
&filter=0
to the end of the search URL for a particular query to turn off the duplicate content filters.
An old school spam technique for some affiliates in the early days of Google was to buy a high PR link to their affiliate URL so that like site.com/?aff=123 would be the default version of the homepage & the branded searches for the merchant would then owe the affiliate the commissions until the rankings shifted again.
Very easy to post things on Reddit as a marketer, particularly when working with a small group who can respond to each other to season threads. Plus you can pay trusted Reddit account holders to post items for you.
Back in the day a friend mentioned you could choose what version of a phrase you wanted to make the canonical for a search autocompletion by embedding a broken image call to a SERP page for the version of a keyword you wanted to be more popular.
Google has tons of ways to identify real users versus fake users. And lots of the fake it until you make it efforts leave statistical outliers that can lead to ignoring or smoothing away much of the benefits, especially if there is no fire following the smoke trail.
Sites that have a poor user experience by design create the ranking signals for their own demotion by such design. Get a lot of traffic from search with not many people liking the destination page and that ranking will quickly go away.
For what it is worth, Google has favored macro-parasites over micro-parasites. The bigger companies have access to the ears of market regulators, etc. The average small publisher or affiliate site has almost nobody care if it disappears.
Part of the most recent Google update was penalizing high authority trusted sites for publishing off topic content from third parties. There is a concept called "goog enough" explaining how the likes of Forbes ranked for just about everything.
https://www.blindfiveyearold.com/its-goog-enough
One time I had a client who thought it was "unfair" to pay me just because I knew how algorithms worked. He was quickly fired, but he did not find inheriting his family owned business unfair. He did not find his ranking boost which gave him outsized profits unfair.
There is no way to go back in time to make everything fair from some arbitrary starting point. All you can do is your best to do your best.
Pricing can lead to unequal outcomes, but it at least provides a signal that you are on the right track or not.
A quest for universal fairness can only work by lowering people rather than by promoting them doing what they are best at.
Anyone seeking universal fairness & equal outcomes in all aspects of life should read Kurt Vonnegut's Harrison Bergeron as many times as required to change that mindset.
http://www.tnellen.com/cybereng/harrison.html
"THE YEAR WAS 2081, and everybody was finally equal. They weren't only equal before God and the law. They were equal every which way. Nobody was smarter than anybody else. Nobody was better looking than anybody else. Nobody was stronger or quicker than anybody else. All this equality was due to the 211th, 212th, and 213th Amendments to the Constitution, and to the unceasing vigilance of agents of the United States Handicapper General."
People are not required to live in the biggest & most expensive cities in the world. Doing so is a premium good. Removing the pricing signal just turns everything into a lottery and/or lowest common denominator practices demonstrating the tragedy of the commons. Sorry your neighbor has mental health issues, uses meth and screams as they throw stuff against the wall at night. Hope you got a good night sleep!
When I got started on the web I moved a couple states over to live with a friend who was going to college. We lived in a mobile home & our rentier extractor landlord captured like $110 a month. I was able to spend little time doing work I didn't want to do in order to pay rent & could spend a lot of time learning.
High rents can offer some level of exclusivity and give people an opportunity to express their values, what they value, and how much they value it. There's a reason that most people who are in subsidized public housing end up wanting to move away if they can afford to.
The old people with a reverse mortgage & the taxpayer subsidizing the associated losses.
People who put much of their excess savings into an appreciating home they planned to sell to fund their retirement as they moved elsewhere to somewhere cheaper, but now have a home which as a step function is worth far less.
People who would be quickly underwater if the property market tanks deciding to jingle mail, leading to blighted streets for those who stayed.
Local property taxes pay for schools, fire departments, police, etc.
As far as the state being a perfect provider to step in ... in the US about half of healthcare spending is fraud. That the bill is passed onto someone else is a big slice of that (along with ignoring antitrust laws, local CON laws, illegal to import pharmaceuticals directly as a consumer, etc).
I used to live near Chicago as a kid & recalled this
https://en.wikipedia.org/wiki/Cabrini%E2%80%93Green_Homes
"At first, the housing was integrated and many residents held jobs. This changed in the years after World War II, when the nearby factories that provided the neighborhood's economic base closed and thousands were laid off. At the same time, the cash-strapped city began withdrawing crucial services like police patrols, transit services, and routine building maintenance. ... On July 17, 1970, Chicago police patrolman Anthony N. Rizzato and Sergeant James Severin were shot and killed by gang members while patrolling community housing for an all-volunteer "Walk and Talk" project. As the officers proceeded across the Cabrini–Green baseball field, the assailants opened fire from an apartment window. The purpose of the shooting was to seal a pact between two rival gangs."
Which land will the free or subsidized housing go on? Will the people spending a grand or two a month in property taxes want the elevated crime levels near their own front door?
They could have charged a review fee to have an appraiser visit & make accurate price estimates & then let the homeowner keep the Zillow certified valuation label if they don't sell it to Zillow.
Official #1: Btw (by the way) that deal is ridiculous.
Official #2: I know right...model def (definitely) does not capture half the risk.
Official #1: We should not be rating it.
Official #2: We rate every deal. It could be structured by cows and we would rate it.
And the parts that were so junky they couldn't be rated got remixed into another deal to get rated.
Big brands have the ad budget to advertise. That drives awareness. If they have offline stores, those can be thought of as both destinations AND interactive billboards which drive further brand awareness and demand for branded searches.
Many of the top search queries are navigational searches for brands.
And so if tons of people are searching for your brand then if there is a potentially related query that contains the brand term & some other stuff then they'll likely return at least a result or two from the core brand just in case it was what you were looking for.
Google takes 45% revshare on YouTube. Some videos that were demonetized still show ads, so on those Google is taking 100%.
I've seen mid-roll ads on songs on YouTube.
Hosting costs & delivery costs (per byte) drop every year. Every year their compression gets better. Every year their ad revenues goes up. YouTube ad revenues have been growing at something like 30% a year for many years.
I think one reason Google doesn't break out YouTube profitability is because as soon as they show they are profitable they end up getting some of their biggest partners (like music labels) using those profits to readjust revshares.
Also if Google claims YouTube is not profitable they can be painted as the victim for extremist content or hate content they host, whereas if they show they were making a couple billion year a year in profits these narratives would be significantly less effective.
Core search ad prices haven't really been falling yet Google blended click prices keep falling about 20% a year while ad click volume is growing about 60% a year. This is driven primarily by increasing watch time on YouTube and increasing ad load on YouTube. Google blends video ad views in with their "clicks" count.
Worth mentioning a couple factors related to this. You couldn't turn location data on for any service external to Google without also having it turned on for Google & even when you had location services turned off for Google sometimes they still had it turned on anyhow.
There are a few widespread scaled publishing operations like IAC which seems to be doing well with the split up of About.com & relaunching it as vertically focused branded sites, but the content farm business model died with the Panda update.
Some of the sites that were hit like Suite101.com went offline. eHow is still off well over 90%. ArticlesBase sold on Flippa for like $10k or some such. One of the few wins hiding in all the rubble was HubPages, but even they had to rebrand and split out sites & merged into a company with a market cap of about $26 million ... and the CEO of Hubpages is brilliant.
Even with IAC on some sites they are suggesting ad revenues won't be enough
http://www.tearsheet.co/culture-and-talent/investopedia-laun... "As Investopedia charts its course as a media brand, it’s coming up against the roadblock all publishers eventually hit — the reality that display revenue alone won’t be enough. ... Siegel said he expects course revenue to exceed what’s generated from the site’s free content. While he wouldn’t say what the company’s annual revenue was, Siegel said it grew an average of around 30 percent for each of the last three years."
There is also other factors which parallel the panda update that further diminish the quick-n-thin rehash publishing business model
- Google's featured snippets & knowledge graph pulling content into the SERPs so there is no outbound click on many searches
- programmatic advertising redirecting advertiser ad spend away from content targeting to retargeting & other forms of behavioral targeting (an advertiser can use a URL as a custom audience for AdWords ad targeting even if that site does not carry any Google ads on it)
- mobile search results have a smaller screen space where if there is any commercial intent whatsoever the ads push the organic results below the fold
I would agree that programming search results tend to be quite good, but I think this is likely in large part because the average person attracted to programming both has a high IQ and has experience building some part of the web stack. Thus the sites that are quite manipulative in nature would have a hard time trying to fake it until they make it in such a vertical where people are hard to monetize and are very good at distinguishing real from fake. And even if a fake site started to rank for a bit it would quickly fall off as discerning users gave it negative engagement signals.
This is also perhaps part of the reason sites like Stack Overflow monetize indirectly with employment related ads targeted to high value candidates versus say a set of contextually targeted ads on a typical forum page or teeth whitening gizmo ads on the Facebook ad feed.
The lack of filtering of "trash" probably comes from a bunch of different areas
- I think there was a quote that people are most alike in their base instincts and most refined in areas where they are unique. some of the most common queries are related to celebrity gossip & such. There are also flaws in human nature where inferior experiences win based on those flaws. For example, try to buy flowers online and see how many layers of junk fees are pushed on top of the advertised upfront low price. shipping, handling, care, weekend delivery, holiday delivery, etc etc etc
- some efforts to filter trash based on folding in end user data may promote low quality stuff that people believe in. a neutral & objective political report is less appealing than one which confirms a person's political biases. and in many areas people are less likely to share or consider paying for something neutral versus something slanted toward their worldview.
- as the barrier to entry on the web has increased some of the companies that grew confident they had a dominant position in a market may have decided to buy out other smaller players in the vertical & then degrade the user experience as real competition faded. there was a Facebook exec email mentioning they were buying Instagram to eliminate a competitor. Facebook's ad load is now much higher than it was when they were smaller. But the same sort of behavior is true in other verticals too. Expedia & Booking own most the top travel portals.
There has also been a ton of collateral damage in filtering all the trash. So many quirky niche blogs & tiny ecommerce businesses were essentially scrubbed from the web between Panda, Penguin & other related algo updates.
One interesting bit from the most recent IAC investor conference call is on it they mentioned that their search deal with Google was renewed for another 4 years & that the rev share on mobile was lower than it was in the past. An analyst asking a question mentioned both Google and Yahoo! were lowering revenue share on mobile.
There are numerous ways to interpret that. At a base level, one could look at how the mobile search results are sometimes a screen full of ads, or how in some verticals they are a screen full of ads followed by yet another screen full of ads.
And then there is the knowledge graph & other flavors of scrape-n-displace, which is largely content recycled from elsewhere, given prominent positioning not based on merit or editorial quality, but based on who the publisher (or recycler) is.
Another parallel trend would be the confirmation bias / brand bias factors promoting older and staler sites. Or simplified "take" articles in the mainstream media rather than the original source articles on niche hobbyist blogs and forums or such.
And in taking broad sets of new niche intents and trying to guide those streams of users back down well worn paths. For example, sometimes when you want to find a particular news story about a broad & well-known web platform like Apple, Amazon, Facebook, or Google it can be hard to find sites other than the official site. And on some other longtail queries Google rewrites what is being searched for in a way that brings up some results that don't match the true searcher intent. Probably the best example I can come up with on this front is say you wanted a pair of shoes of a specific brand, size, width, and model number. If they are not the most recent and most heavily marketed versions it can be tough. Auto-generated internal search pages on trusted brand sites rank well, while a small retailer carrying that specific shoe might be penalized by Panda.
Google looks for the canonical version of a document and then deduplicates before returning the result set.
You can add &filter=0 to the end of the search URL for a particular query to turn off the duplicate content filters.
An old school spam technique for some affiliates in the early days of Google was to buy a high PR link to their affiliate URL so that like site.com/?aff=123 would be the default version of the homepage & the branded searches for the merchant would then owe the affiliate the commissions until the rankings shifted again.