Staff Software Engineer - Observability
Databricks
3 months ago
Gardena, CA, USA
Staff+
H1B Sponsor
Base Salary
$191k - $254k/yr
Responsibilities
- Design and scale the next-generation logging platform for Databricks.
- Develop and optimize log delivery pipelines for efficient log ingestion and querying.
- Enhance log accessibility and usability for engineers.
- Collaborate with teams to define best practices for structured logging.
- Optimize log retention, indexing, and query performance.
- Mentor engineers and promote a culture of technical excellence.
Requirements
- BS (or higher) in Computer Science or a related field.
- 7+ years of production-level experience in languages such as Scala, Rust, Go, Python, Java, or C++.
- Deep experience in software development for large-scale distributed systems.
- Experience managing complex projects with multiple teams and stakeholders.
- Familiarity with log collection, health monitoring, and observability tools.
Tech Stack
Apache SparkC++GoJavaMLflowPythonRustScala
Categories
AI & MLBackendData Engineering