Know compute cost of every pipeline and model in your BigQuery(mastheadata.com)

10 pointsby austingunter3 anni fa4 comments

Know compute cost of every pipeline and model in your BigQuery

https://mastheadata.com/data-cost-insights-landing/

4 comments

Interestingly costs were mostly ignored in the last years. We had credits, plenty of credits. But now GCP has reduced them and adapted their pricing to the current situation.

Therefore costs become an optimization item. Reducing costs initially is really not that hard, but to find the queries that generate these costs is harder. Therefore I really like Mastheads approach to make these visible.

And big plus - since the work on my metadata, then don't need to access my real data.

whoiskatrin3 anni fa

pretty cool, seems well executed, interesting to see how the product will evolve

PascalUnger3 anni fa

This is pretty awesome!

sramji3 anni fa

I got to speak with Yuliia Tkachova two months ago (https://podcasts.apple.com/us/podcast/the-human-right-to-pri...) and what Masthead is building is technically different and powerful: metadata logs at the center of the architecture for operational analysis of BigQuery workloads, without ever accessing data. Pretty cool.