Senior Software Engineer - Ingestion
Databricks7 days ago
Responsibilities
- Build and operate a highly scalable, available, and fault-tolerant ingestion engine processing hundreds of terabytes of data daily across thousands of customers.
- Develop systems that extract data from OLTP systems while minimizing load on production databases using incremental data capture and log parsing techniques.
- Perform low-level systems debugging, performance measurement, and optimization on large production clusters.
- Design architectures, influence the product roadmap, and own new technical projects.
- Investigate and help prevent production issues across the full development and operations lifecycle.
- Plan and lead complex technical projects involving multiple internal teams.
- Prototype and validate solutions to break down complex technical problems and reduce risk.
Requirements
- Bachelor’s degree or higher in computer science or a related field.
- At least five years of production-level experience with Python, Java, Scala, C++, or a similar language.
- Experience developing large-scale distributed systems from scratch.
- Hands-on experience developing and operating backend systems.
- Ability to contribute across design, development, implementation, and ongoing operations.
- Experience with database replication, backup, or transaction recovery at a major database vendor such as Microsoft SQL Server, Oracle, or IBM is preferred.
Benefits
- Databricks offers comprehensive employee benefits and perks, with details varying by region.
- The company emphasizes an inclusive culture and equal employment opportunity.
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).