Learnings from Analyzing 20.2M CI Jobs to Find Flaky Tests – Part 1
trunk.io7 pointsby trunksuzieross0 comments
* Merge Queue: Ensure your PRs keep the builds you care about green at any scale.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Merge Queue: Ensure your PRs keep the builds you care about green at any scale.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Merge Queue: Ensure your PRs keep the builds you care about green at any scale.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged.
*Flaky Tests: Detect and eliminate Flaky Tests.
* AI DevOps Assistant: Automate Reccurring DevOps tasks in chat.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged.
*Flaky Tests: Detect and eliminate Flaky Tests.
* AI DevOps Assistant: Automate Reccurring DevOps tasks in chat.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
*Flaky Tests: Detect and eliminate Flaky Tests. * Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
*Flaky Tests: Detect and eliminate Flaky Tests.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
*Flaky Tests: Detect and eliminate Flaky Tests. * Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
*Flaky Tests: Detect and eliminate Flaky Tests.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
*Flaky Tests: Detect and eliminate Flaky Tests.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Code Quality: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Merge Queue: a merge queue, to ensure that PRs are tested in order before they're merged; and
* CI Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
* Flaky Tests: Detect and eliminate Flaky Tests. * Trunk Check: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Trunk Merge: a merge queue, to ensure that PRs are tested in order before they're merged; and
* Trunk Test Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Trunk Check: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Trunk Merge: a merge queue, to ensure that PRs are tested in order before they're merged; and
* Trunk Test Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Trunk Check: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Trunk Merge: a merge queue, to ensure that PRs are tested in order before they're merged; and
* Trunk Test Analytics: detects, quarantines, and eliminates flaky tests from your code base. Prevents flakey tests from producing noise and blocking CI.
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
* Trunk Check: a universal linter/formatter, available as a CLI, VSCode extension, and CI check;
* Trunk Merge: a merge queue, to ensure that PRs are tested in order before they're merged; and
* Trunk CI Analytics: timing & pass/fail stats for GH Actions (e.g. "how often does this workflow step actually succeed?")
* Frontend: Typescript, React, Redux, Next.js
* Backend: Typescript, Node, AWS, CDK, k8s, gRPC
* Observability: Prometheus, Grafana, Kiali, Jaeger
* CLI: C++20, Bazel
* VSCode Extension: Typescript
* CI/CD: GitHub Actions
* General: GitHub, Slack, Linear, Slite
Trunk is an a16z funded (25M) Series A dev tools startup, redefining software development at scale. At Trunk, our mission is to help teams create high-quality software quickly. AI has made writing code 10x faster, but shipping is still painfully slow. The bottleneck has shifted downstream - to merge conflicts, flaky tests, inconsistent code quality, and dozens of other frictions that drain productivity and morale. Engineering teams that can stay focused on designing, implementing, and delivering software will build magical, high-quality projects - and they'll be happier doing it. We're building a CI Reliability Platform that empowers teams to land code faster and develop happier!
Our products:
Our tech stack:
Frontend: Typescript, React, Next.js, AWS Backend: Typescript, Node, AWS Data pipelines: Dagster, Python, polars CI/CD: GitHub Actions
Unlimited PTO (and we all actually take PTO), competitive salary and equity packages! Please apply here: https://trunk.io/jobs.