The 1000 most-visited sites on the web (by Google)(fseek.me)

52 pointsby ddbbvor 16 Jahren52 comments

The 1000 most-visited sites on the web (by Google)

http://fseek.me/2010/05/the-1000-most-visited-sites-on-the-web-by-google/

Stackoverflow: #824 experts-exchange.com: #996

26 comments

latchvor 16 Jahren

I extracted the data, added IP, country and response headers, and dumped it into a usable format:

http://openmymind.net/top1000data.txt

You can do some decently interesting analysis..like the fact that nginx is the front-end for nearly as many sites as IIS.

lazyantvor 16 Jahren

Thanks for the data.

"nginx is the front-end for nearly as many sites as IIS", oh I wished that was true but according to my naive counting IIS is over 3 times more popular, am I missing something?:

$ wget http://openmymind.net/top1000data.txt

$ grep -c '"Server": "nginx"' top1000data.txt

39

$ grep -c '"Server": "Microsoft-IIS' top1000data.txt

149

ireadzalotvor 16 Jahren

Could you share how you extracted the data? I thought it was nifty that way you have it in that txt file. Thanks.

sonnyzvor 16 Jahren

Why is dropbox 'myth and folklore'???

latchvor 16 Jahren

The categories of the json dump come directly from the original google source..so i don't know (and dropbox certainly isn't the only mis-categorized entry):

http://www.google.com/adplanner/static/top1000/

rmorrisonvor 16 Jahren

Oh god, and I've been trusting them w/ my backups!!!!!

sosukevor 16 Jahren

Over what time period is pageviews calculated on?

latchvor 16 Jahren

The page views is pulled from the original google list. They have more information at: http://www.google.com/support/adplanner/bin/answer.py?hl=en&...

They don't say what time frame page view is, but they do say unique visits is over the course of 1 month - so its probably safe to assume page view is also over 1 month.

jpdbaughvor 16 Jahren

They must have filtered porn. There is no way redtube.com is not in the top 100.

sucuri2vor 16 Jahren

They did: " Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites. "

jclvor 16 Jahren

A curious list of restrictions... I wonder what kind of site would be in the top 1000 that didn't have publicly visible content or load properly? Pure Flash sites, maybe?

papachitovor 16 Jahren

Alexa has a top 500 list with google and porn sites included http://www.alexa.com/topsites

jpdbaughvor 16 Jahren

Sorry! I must have missed that.

remivor 16 Jahren

Source: http://www.google.com/adplanner/static/top1000/

petercoopervor 16 Jahren

Not sure why that's not the main link here instead of a useless blog article that removes half the data and adds no insight or extra information whatsoever.. :-)

portmanvor 16 Jahren

Amazing that Facebook has ONE THOUSAND pageviews per unique visitor compared to about 100 pageviews per unique visitor on the rest of the sites.

rayvegavor 16 Jahren

# 824 stackoverflow vs # 994 expertsexchange

Perhaps another confirmation of what the SO folks have been saying about their popularity.

petercoopervor 16 Jahren

Note that StackOverflow is listed as being in the "Music" category :-) Wha..?

cadrvor 16 Jahren

I always go to StackOverflow to find out what the kids are listening to these days.

sucuri2vor 16 Jahren

#20 - ask.com #252 - digg.com #261 - justin.tv

Reddit not in the list... What I don't understand is how come sites like openoffice.org, kaspersky.com, mcafee.com are so high in the list. Do people really visit them that often?

CapitalistCartrvor 16 Jahren

It's more likely that their computer does. For stuff like Auto-updates.

lftlvor 16 Jahren

Ahh that probably explains counduit.com at #29 as well.

michaelbuckbeevor 16 Jahren

And likely HP.com as well. Stupid printer drivers.

michaelbuckbeevor 16 Jahren

Given how inaccurate the categorizations are I think it's possible that Reddit got put in the "adult" category.

pgvor 16 Jahren

Anyone care to do a scatterplot of domain name length vs rank?

tewksvor 16 Jahren

It looks somewhat periodic:

http://images.rdujour.com/wp-content/uploads/2010/05/domainL...

I did not include the length of the tld.

tewksvor 16 Jahren

Monthly uniques versus domain name length:

http://images.rdujour.com/wp-content/uploads/2010/05/uniques...

[deleted]vor 16 Jahren

iceyvor 16 Jahren

Depressingly, Mahalo is on the list (#946).

trunvor 16 Jahren

Dropbox on the list at 985. Impressive.

darienvor 16 Jahren

But reddit.com is nowhere to be seen... surprising.

dratsvor 16 Jahren

My question is, if reddit were on that list, would the moderation system be able to prevent it turning into Digg? I don't think it could, although maybe the subreddit system could. Places like /r/politics/ are fairly useless for intelligent debate already. Such link sharing sites don't have the same "my friends are there" grounding force that Facebook has, it's just the "vibe" and community so running away to a new site is easily mounted.

petercoopervor 16 Jahren

And listed as a "Myth and Folklore" site. I wonder who came up with these "categories" - there are some crazy assignments in the list.

[deleted]vor 16 Jahren

sucuri2vor 16 Jahren

Did you guys notice Wordpress.com and .org in there:

.com: 120,000,000 uniques

.org: 8,100,000 uniques

Impressive.

larryfreemanvor 16 Jahren

Keep in mind that the numbers listed are estimations.

For example, HubPages, the site where I work, is listed at #270 with 11M unique visitors and 97M page views.

Our monthly absolute unique visitors (according to Google Analytics) is more than three times that. Our monthly page views are greater than 100M.

monosvor 16 Jahren

"...as measured by Ad Planner."

the list is a decent guesstimate. unless every single site on the planet uses the facebook like button, google analytics, google ads, or something else that tracks globally, there is now way to correctly measure UC or PI.

jhaglundvor 16 Jahren

it reassures me that foxnews.com is farther down than I would have expected.

43. http://bbc.co.uk 83. http://nytimes.com 179. http://reuters.com 257. http://foxsports.com 279. http://foxnews.com

[deleted]vor 16 Jahren

dolinskyvor 16 Jahren

Mashable - #696 Techcrunch - #850. Nice to see I'm not the only one that prefers Cashmore to Arrington.

ElbertFvor 16 Jahren

Why? All Mashable does is post about Twitter trends and recycle Techcrunch posts a week later.

arstvor 16 Jahren

I really doubt that usgs.gov (#978) gets anywhere near the number of visits that nfl.com gets (#993).

ojbyrnevor 16 Jahren

Everytime there's an earthquake in California, half the state goes there.

[deleted]vor 16 Jahren

wheatiesvor 16 Jahren

Wow, yahoo is up there. It's a shame they can't monetize their websites more.

ThomPetevor 16 Jahren

I think their problem is that they are to big an operation. They probably could be if they trimmed the company.

zandorgvor 16 Jahren

Geocities still running in Japan after being shut down in the west? Wierd!

alexyimvor 16 Jahren

It's interesting how hard it is to come up with http://windows.com even though I tried explicitly searching for it

volidavor 16 Jahren

where s youtube?

jclvor 16 Jahren

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites."

[deleted]vor 16 Jahren

hokkosvor 16 Jahren

where is google in that list ?

bondvor 16 Jahren

"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites." reply

retubevor 16 Jahren

the daily mail at 236 aarrgghhhhh!!!!!!!

rokhayakebevor 16 Jahren

Scribd 102. Excellent. I would like to know how much financing each one of those site took to date.

ori_bvor 16 Jahren

google isn't on that list?

nkassisvor 16 Jahren

where is slashdot?