moatra · HackerTrans

vor 10 Jahrendiscuss

Amazon Cetrificate Manager seems to do this, but it's only available in one region right now.

vor 11 Jahrendiscuss

When did the rename happen?

vor 11 Jahrendiscuss

Just in time! This will be nice reference. I recently started working on a new Scala driver that uses the v0_4 asynchronous protocol, built on top of Akka's IO module and Play's JSON module. I think I have the performance where I want it, but now I need to flesh out the DSL for proper ReQL support.

moatra

vor 11 Jahrendiscuss

They just announced a cron-like scheduler for Lambda, so that may make for a decent alternative.

moatra

vor 11 Jahrendiscuss

Exponential back off is a good idea, but to make it even better you'll want to add some random jitter to the delay period. Especially in the case of deadlocks this helps avoid another deadlock when two things would have retried at exactly the same time.

moatra

vor 11 Jahrendiscuss

Do Continuous Views work with table-table joins, or must there always be at least one stream present? The documentation[1] doesn't specify.

If so, this could be an interesting alternative to RethinkDB's changefeeds, as RethinkDB doesn't support joins on the change stream.

[1] http://docs.pipelinedb.com/joins.html

moatra

vor 11 Jahrendiscuss

Is rate limiting state stored in Cassandra?

One of the main graphics on the KONG docs shows a Caching plugin (http://getkong.org/assets/images/homepage/diagram-right.png), but the list of available plugins doesn't include such an entry. Is that because caching is built in? Is the cache state stored in Cassandra? Or is the plugin yet to be built?

moatra

vor 11 Jahrendiscuss

KONG definitely looks interesting, and I'd love to know more about it. However, there's definitely not a lot written about it yet.

For example: I've gone searching through the blog posts, github readme, and KONG documentation, but I still have no idea _why_ it needs Cassandra. What does it store in there?

moatra

vor 11 Jahrendiscuss

That sounds great if your messages in the logs are the complete state for that key, but I'm not seeing how to use that compaction system if the messages are change events.

Is there a system designed for snapshotting the aggregate and logging the delta?

moatra

vor 11 Jahrendiscuss

Paper - https://www.fiftythree.com/paper

moatra

vor 11 Jahrendiscuss

  if you want to build a new derived datastore, you can just start a new consumer
  at the beginning of the log, and churn through the history of the log, applying
  all the writes to your datastore.

For high-throughput environments with lots of appends to the log, how do you get around the ever-increasing size of your log file? I know the traditional answer is to take a periodic snapshot and compact the previous data, but is that built in to tools like Kafka?

moatra

vor 11 Jahrendiscuss

Ah, thanks. It looks like only a few query types actually return an initial result set: between, min, max, and order_by/limit ( http://rethinkdb.com/docs/changefeeds/python/ )

Is there a way to get an entire table as the initial result set before getting update diffs? Something like:

  r.table("users").between(-Infinity, Infinity).changes().run()  // Not actually valid

moatra

vor 11 Jahrendiscuss

Regarding changefeeds - is there a way to tell when you've consumed all the initial data and are now receiving update diffs?

moatra

vor 12 Jahrendiscuss

10 seconds

moatra

vor 13 Jahrendiscuss

Google offers three geocoders:

The first[1] converts ip to location, and allows 100 free queries per day.

The second[2] converts physical addresses to location as part of it maps JavaScript api, and is part of its 25,000 free requests/day.

The third[3] is its http version of geocoding, which also converts physical addresses to locations or visa-versa. This api has the 2,500 req/day limit.

[1]https://developers.google.com/maps/documentation/business/ge...

[2]https://developers.google.com/maps/documentation/javascript/...

[3]https://developers.google.com/maps/documentation/geocoding/

moatra

vor 14 Jahrendiscuss

I'm somewhat confused. If both the django and flask app are running and you visit "mygreatstartup.com", which app will you see?

comments