We have an open headcount on the Compute Lifecycle team at Databricks for a senior or staff engineer. This role requires 5+ years of experience, experience with distributed systems, and ideally experience running Kubernetes at scale. The team maintains systems that automate cluster provisioning and manage Kubernetes clusters for Databricks' serverless products across major clouds. The tech stack includes Go and Scala.
Remote Conditions
Applicants must be able to commute to one of the offices at least two days a week.
Databricks started out building a platform based on Apache Spark. Over the last few years, they've built an all-encompassing platform for enterprises to make use of all structured and unstructured data, including tools for data querying and visualization. They have integrated machine learning and generative AI technologies into the product, acquiring MosaicML, a leader in LLM infrastructure.
