Senior Software Engineer - Compute Infrastructure

1w1 week ago

Databricks

San Francisco, US · Full-time · $164,200 – $205,200

About this role

Databricks builds and runs the world's best data and AI infrastructure platform to help data teams solve tough problems like medical breakthroughs. The Compute Infrastructure organization operates the foundation for all Data, AI, and stateful workloads across major clouds. It launches tens of millions of VMs per day and thousands of Kubernetes clusters with extreme elasticity, reliability, and cost efficiency.

As a Senior Software Engineer on the Compute Infra team, you design and build systems powering Databricks’ compute infrastructure. This enables engineers to quickly launch and scale world-class products. You focus on compute abstractions, workload orchestration, and fleet management for high performance.

The team delivers powerful capabilities for serving, batch, stateful, and GPU workloads. Founded by engineers and customer obsessed, Databricks tackles challenges from next-gen UI/UX to scaling services across millions of VMs. It fosters a culture of engineering excellence and platform mindset.

You raise the technical bar through strong design practices, testing, and operational excellence. Lead cross-team initiatives spanning product and infrastructure areas. Help enable high-velocity product development with best-in-class performance as Databricks continues to grow.

Requirements

BS (or higher) in Computer Science or related field
5+ years of experience designing and building large-scale distributed systems
Strong proficiency in one or more languages such as Java, Scala, Go, or C++
Experience with service-oriented architectures and large scale distributed systems
Familiarity with cloud platforms (AWS, Azure, GCP) and container/orchestration technologies (Kubernetes, Docker)
Track record of shipping infrastructure that supports mission-critical workloads at scale

Responsibilities

Develop the compute abstractions that provide powerful capabilities for all Databricks workloads
Design the workload orchestration and scheduling systems that handle all types of workloads with high performance and efficiency
Scale the fleet management systems that launch and configure millions of VMs every day across cloud providers
Raise the technical and operational bar through strong design practices, testing, and a culture of engineering excellence
Lead cross-team initiatives that span product and infrastructure surface areas