Reducing server load with Redis(crashlytics.com)

http://www.crashlytics.com/blog/reducing-mongodb-traffic-by-78-with-redis-caching/

4 comments

There is nothing specific to MongoDB here.

Also, using appropriate cache headers and putting a Varnish cache in front of the Rack server would be far easier and faster and would also reduce the load on the Rack server itself. Oh, but then I couldn't say I created a DSL...

meritt14년 전

There's also nothing specific to Redis here.

HN: Do we really need new articles demonstrating how caching works?

anderse14년 전

Calling it a DSL is bit weird to me, it's a single instance method. You'd use the same kind of thing to set the appropriate caching headers for Varnish.

LeonidBugaev14년 전

Quite wrong title not relevant to MongoDB. And it can be done much easier using redis-store and standart caches_action method.

https://github.com/jodosha/redis-store

http://stackoverflow.com/questions/1988658/rails-action-cach...

ttol14년 전

Thanks Leonid! Have you used these in production?

antirez14년 전

IMHO this other use of Redis inside Crashlytics, doing heavy use of bitmaps, is more interesting:

http://www.slideshare.net/crashlytics/crashlytics-on-redis-a...

thezilch14년 전

Indeed... as presented before:

http://blog.getspool.com/2011/11/29/fast-easy-realtime-metri...

And the HN posts / comments:

https://news.ycombinator.com/item?id=3292542 http://news.ycombinator.com/item?id=3748239

And the Redis warning on setting large bitmaps (Re: split your bitmaps):

http://redis.io/commands/setbit

Note: I know I'm responding to someone who is probably already aware of this information, but the crashly slides are lite on the techniques technical side.

js4all14년 전

I totally agree, tracking using bitmaps is something where Redis really shines and it is relevant for nearly every site.

nchuhoai14년 전

Leonid is bringing up some good points, but I was always wondering: How do you get to do auto-expiring page-caching.

While Leonid is right that Action Caching with Rails.cache is much easier to do, action caching still lets the request hit the stack, while it does not do so with this proposed solution. Page caching makes the expiration of the cache harder then this solution.

Question: It seems this solution has nearly the ease of action caching, but the performance gain like page caching. Is there a low-level gem/solution available to do something like this?

gingerlime14년 전

I'm really not sure, so please don't shoot me if I'm wrong. I'd be happy to learn more/be proven wrong.

I think the redis-store cache in rails also uses a rack middleware, and supports setting ttl on keys which will auto-expire on redis...?

https://github.com/jodosha/redis-store/blob/master/redis-rac...