I'm glad this exists but at ~1k EUR I would be interested if it could scan 120 medium format negatives...but the fact that it does not is an absolute deal breaker for me. It seems like they are considering it. I hope they do figure that out sooner than later.
lol cheeky reply aside (I lead the ClickHouse team here at PostHog). We have two of the largest self hosted ClickHouse clusters out there (and growing rapidly) each with Petabytes of data. We are working on really interesting solutions to problems that we would love to open source for the broader CH ecosystem:
- Declarative, cluster aware migrations
- Iceberg and S3 backed merge tree's on ClickHouse (as performant as local MergeTrees)
- ClickHouse on K8s, but on Metal instances w/ NVMe used for caching and compaction.
- Load shedding query scheduler and eventually query optimizer
We have a broad charter when it comes to ClickHouse. It's one of the things that enables us to build so many products that share the same underlying data and context. Our goal is to enable all developers at PostHog to continue building these products quickly as the team and user-base scales.
It's honestly an exciting time to be working at this company and on the beating heart of what drives it. Chat with me if you have any questions!
Using ClickHouse is one of the best decisions we've made here at PostHog. It has allowed us to scale performance all while allowing us to build more products on the same set of data.
Since we've been using ClickHouse long before this JSON functionality was available (or even before the earlier version of this called `Object('json')` was avaiable) we ended up setting up a job that would materialize json fields out of a json blob and into materialized columns based on query patterns against the keys in the JSON blob. Then, once those materialized columns were created we would just route the queries to those columns at runtime if they were available. This saved us a _ton_ on CPU and IO utilization. Even though ClickHouse uses some really fast SIMD JSON functions, the best way to make a computer go faster is to make the computer do less and this new JSON type does exactly that and it's so turn key!
The team over at ClickHouse Inc. as well as the community behind it moves surprisingly fast. I can't recommend it enough and excited for everything else that is on the roadmap here. I'm really excited for what is on the horizon with Parquet and Iceberg support.
100% agree. One of the biggest assets we had at <driver and rider marketplace app> was the data we collected. We built models on it that would determine how markets were run and whether drivers and passengers were safe. These were key features that enabled us to bring a quality service to customers (over ye ol' taxi). The same applied to the autonomous cars, bikes, and scooters. We used data to improve placement of vehicles to help us anticipate and meet demand. It was insane how much data used to build these models.
To say big data is dead sounds to me like someone desperate for eyeballs.
I do think there is a huge opportunity for DuckDB - running analytics on 'not quite big data' is a market that has always existed and is arguably growing. I've seen way too many people trying to use Postgres for analyzing 10 Billion row tables and people booting up an EMR cluster to hit the same 10 Billion rows. There is a huge sweet spot for DuckDB here were you can grab a slice of the data you are interested in, take it home and slice and dice it as you please on your local computer. I did this just this weekend on DuckDB _and_ ClickHouse!
Disclaimer: I work at a company that is entirely based on ClickHouse.
PostHog | Remote (US/Europe timezones) | Senior Backend Engineer, SRE & more! https://posthog.com/
PostHog is open-source product analytics. Graduated YC W20, we were the most popular B2B software HN launch since 2012. Our GitHub repo [0] has 9k stars and a growing and active community. We've raised significant funding, default alive, and are growing quickly. We're 30+ people. Our stack is Django/React/Redux (Kea -- main contributor works at PostHog too!).
Our mission is to build tools that will increase the number of successful products that exist in the world.
We are looking for Backend Engineers & SREs to take care of scaling to 1 Trillion+ events, both for our cloud offering and larger customers who are self hosting. If you are interested in processing data reliably at scale and love databases like ClickHouse, this is your role!
We have a culture of written async communication (see our handbook [1]), lots of individual responsibility and an opportunity to make a huge impact. Being fully remote means we're able to create a team that is truly diverse. We're based all over the world, and the team includes former YC founders, CTOs turned developers and recent grads.
For anyone managing a k8s cluster and are fatigued with memorizing and reciting kubectl commands should definitely take a look at k9s[0]. It provides a curses like interface for managing k8s which makes it really easy to operate and dive into issues when debugging. Move from grabbing logs for a pod to being at a terminal on the container and then back out to looking at or editing the yaml for the resource definition in only a few key presses.
PostHog | Remote (US/Europe timezones) | Head of Product, Senior Backend Engineer, SRE & more!
https://posthog.com/
PostHog is open-source product analytics. Graduated YC W20, we were the most popular B2B software HN launch since 2012. Our GitHub repo [0] has 8.5k stars and a growing and active community. We've raised significant funding, default alive, and are growing quickly. We're 30+ people. Our stack is Django/React/Redux (Kea -- main contributor works at PostHog too!).
We are looking to fill our Head of Product role to help us stay focussed in executing our vision of building tools that will increase the number of successful products that exist in the world.
We are also looking for Backend Engineers & SREs to take care of scaling to 1 Trillion+ events, both for our cloud offering and larger customers who are self hosting. If you are interested in processing data reliably at scale and love databases like ClickHouse, this is your role!
We have a culture of written async communication (see our handbook [1]), lots of individual responsibility and an opportunity to make a huge impact. Being fully remote means we're able to create a team that is truly diverse. We're based all over the world, and the team includes former YC founders, CTOs turned developers and recent grads.
This is one of the reasons why we chose ClickHouse as our backend at PostHog. We wanted something that was relatively simple to operate for our users who deploy PostHog on-prem. We've been super happy with it so far. Still not turn key in many ways, but it's been pretty great.
PostHog is open-source product analytics. Graduated YC W20, we were the most popular B2B software HN launch since 2012. Our GitHub repo [0] has 8k stars and a growing and active community. We've raised significant funding, default alive, and are growing quickly. We're 30+ people. Our stack is Django/React/Redux (Kea -- main contributor works at PostHog too!).
We are looking for Senior Product Managers to help us stay focussed in executing against our vision of building tools that will increase the number of successful products that exist in the world.
We are also looking for DEs & SREs to take care of scaling to 1 Trillion+ events, both for our cloud offering and larger customers.
We have a culture of written async communication (see our handbook [1]), lots of individual responsibility and an opportunity to make a huge impact. Being fully remote means we're able to create a team that is truly diverse. We're based all over the world, and the team includes former YC founders, CTOs turned developers and recent grads.
PostHog is open-source product analytics. Graduated YC W20, we were the most popular B2B software HN launch since 2012. Our GitHub repo [0] has 8k stars and a growing and active community. We've raised significant funding, default alive, and are growing quickly. We're 30+ people. Our stack is Django/React/Redux (Kea -- main contributor works at PostHog too!).
We are looking for Senior Product Managers to help us stay focussed in executing against our vision of building tools that will increase the number of successful products that exist in the world.
We are also looking for DEs & SREs to take care of scaling to 1 Trillion+ events, both for our cloud offering and larger customers.
We have a culture of written async communication (see our handbook [1]), lots of individual responsibility and an opportunity to make a huge impact. Being fully remote means we're able to create a team that is truly diverse. We're based all over the world, and the team includes former YC founders, CTOs turned developers and recent grads.
PostHog | SWE, SRE, and TLM | Remote | Full Time | https://posthog.com We're an open source platform for product analytics that took off after a launch HN (https://news.ycombinator.com/item?id=22376732). Our mission is to increase the number of successful products in the world. We've raised nearly $30M since that post under 2 years ago, and have around 15K developers in our community.
There are two key roles open at the moment:
* Kubernetes SRE - We are looking for someone to help us refine how we deploy our stack to Kubernetes across multiple cloud providers. Ideally you would be someone who loves a performance challenge and has experience operating high performance stateful workloads on k8s.
* Tech Lead Manager (TLM) - If you are are someone who loves working with a small tight nit group of people, helping them grow professionally and personally while also wanting to stay sharp as an IC, this is the role for you. We are looking for someone who can lead our core analytics team technically, as well as some light management duties to keep the team sharp and focussed. Technically you should be very comfortable with reading and writing complex SQL queries that are designed to hit TBs to PBs of data. You should also feel totally at home working with the frontend and backend of a web service. The team is a full stack team - but the crux of the work is in writing efficient queries.
* Full Stack Eng - If you are someone who loves wearing multiple hats with a dynamic team dealing with huge amounts of streaming data with the goal of making more of that data actionable and insightful we are looking for you :)
What it's like:
* Fast and direct! * Focus is on written and asynchronous communication. * Autonomous. You choose your quest. Small team structure to enable this. * Transparent - almost all our work is open source, public handbook, public compensation, internally shared board meetings and investment updates before they happen.
PostHog | SWE and TLM | Remote | Full Time | https://posthog.com
We're an open source platform for product analytics that took off after a launch HN (https://news.ycombinator.com/item?id=22376732). Our mission is to increase the number of successful products in the world. We've raised nearly $30M since that post under 2 years ago, and have around 15K developers in our community.
There are two key roles open at the moment:
* Kubernetes Software Engineer - We are looking for someone to help us refine how we deploy our stack to Kubernetes across multiple cloud providers. Ideally you would be someone who loves a performance challenge and has experience operating high performance stateful workloads on k8s.
* Tech Lead Manager (TLM) - If you are are someone who loves working with a small tight nit group of people, helping them grow professionally and personally while also wanting to stay sharp as an IC, this is the role for you. We are looking for someone who can lead our core analytics team technically, as well as some light management duties to keep the team sharp and focussed. Technically you should be very comfortable with reading and writing complex SQL queries that are designed to hit TBs to PBs of data. You should also feel totally at home working with the frontend and backend of a web service. The team is a full stack team - but the crux of the work is in writing efficient queries.
What it's like:
* Fast and direct! * Focus is on written and asynchronous communication. * Autonomous. You choose your quest. Small team structure to enable this. * Transparent - almost all our work is open source, public handbook, public compensation, internally shared board meetings and investment updates before they happen.
PostHog | Remote (US/Europe timezones) | Senior Backend, SRE, ClickHouse/C++ Engineers | https://posthog.com PostHog is open-source product analytics. Graduated YC W20, we were the most popular B2B software HN launch since 2012. Our GitHub repo [0] has 4k stars and a growing and active community. We've raised significant funding with 10 years of runway and are growing quickly. We're 30+ people and will be 50 by the end of the year. We're looking for senior Backend and ClickHouse/C++ engineers, someone who geeks out on scale and doing crazy fun stuff with a ton of data. Our stack is Django/Node/C++ and of course ClickHouse. We are also looking for a senior SRE to help us level up scaling to 100B+ events and beyond for both our cloud offering and our on-prem customers.
We have a culture of written async communication (see our handbook [1]), lots of individual responsibility and an opportunity to make a huge impact. Being fully remote means we're able to create a team that is truly diverse. We're based all over the world, and the team includes former YC founders, CTOs turned developers and recent grads.
PostHog | Remote (US/Europe timezones) | Senior Full Stack, SRE, Frontend Engineers | https://posthog.com PostHog is open-source product analytics. Graduated YC W20, we were the most popular B2B software HN launch since 2012. Our GitHub repo [0] has 4k stars and a growing and active community. We've raised significant funding with 10 years of runway and are growing quickly. We're 30+ people and will be 50 by the end of the year. We're looking for frontend & full-stack engineers, someone who knows what a good product should look like. Our stack is Django/React/Redux (Kea -- main contributor works at PostHog too!).
Also looking for an SRE to take care of scaling to 100B+ events, both for our cloud offering and larger customers.
We have a culture of written async communication (see our handbook [1]), lots of individual responsibility and an opportunity to make a huge impact. Being fully remote means we're able to create a team that is truly diverse. We're based all over the world, and the team includes former YC founders, CTOs turned developers and recent grads.