Ask HN: Any HN stats analysis been done?

22 pointsby lifeisstillgoodvor 11 Jahren5 comments

I was just thinking of some questions about HN discussions - things like what does the average discussion look like? How long between replies is common / polite (I seem to let the other end hang for hours)

I don't particularly care about best time to post (that's defined by me as when I am struck by something) but there are many interesting questions one could ask the corpus

(Which leads to the other question - is there a good way to get hold of the corpus?)

5 comments

jcrvor 11 Jahren

There's the main HackerNews API [1] via firebase.com, and there's also the Algolia HN Search API [2]. Over the years I've seen quite a few collections of data [3, 4, 5, 6], but how complete they are and whether or not they've been maintained is unknown.

[1] https://github.com/HackerNews/API

[2] https://github.com/algolia/hn-search

[3] https://archive.org/details/HackerNewsStoriesAndCommentsDump

[4] https://ia902503.us.archive.org/33/items/HackerNewsStoriesAn...

[5] http://shitalshah.com/p/downloading-all-of-hacker-news-posts...

[6] https://news.ycombinator.com/item?id=7835605

dansovor 11 Jahren

There was this last week: a dump of the 10M comments and posts so far: https://news.ycombinator.com/item?id=10002791

Aeolus98vor 11 Jahren

I particularly like Andrej Karpathy's analysis: https://cs.stanford.edu/people/karpathy/hn_analysis.html

minimaxirvor 11 Jahren

I have a repository of scripts for downloading all Hacker News data using Python and storing in PostgreSQL: https://github.com/minimaxir/get-all-hacker-news-submissions...

gwernvor 11 Jahren

Here's a list of relevant links I've compiled over the past year or two:

- http://nathanael.hevenet.com/the-best-time-to-post-on-hacker... - http://minimaxir.com/2014/02/hacking-hacker-news/ - http://minimaxir.com/2014/10/hn-comments-about-comments/ - http://karpathy.ca/myblog/2013/11/27/quantifying-hacker-news... https://cs.stanford.edu/people/karpathy/hn_analysis.html - http://metamarkets.com/2011/hacking-hacker-news-headlines/ - http://danluu.com/randomize-hn/ - http://www.bayesianwitch.com/blog/2013/why_hn_shouldnt_use_r... - http://camdp.com/blogs/multi-armed-bandits - http://gkosev.blogspot.com/2012/08/fixing-hacker-news-mathem... - http://blog.rjmetrics.com/2012/10/17/surprising-hacker-news-... - http://blog.rjmetrics.com/2012/10/24/how-to-get-on-the-front... - http://blog.datadive.net/which-topics-get-the-upvote-on-hack... - https://news.ycombinator.com/item?id=8790134 - https://porter.io/blog/hackernews-cheaters-catch-me-if-you-c... https://news.ycombinator.com/item?id=9332889 - http://www.righto.com/2013/11/how-hacker-news-ranking-really... - https://news.ycombinator.com/item?id=9336759 https://news.ycombinator.com/item?id=9333611 - http://www.almostinfinite.com/other/hacker-news-new-page-scr...?