Sr. Designated Support Engineer, Apache Spark™
Databricks17 days ago
Responsibilities
- Manage large strategic accounts and provide a high-touch, proactive support experience.
- Troubleshoot complex Apache Spark and data engineering issues, including performance bottlenecks, data skew, out-of-memory errors, serialization problems, and slow broadcast joins.
- Analyze Spark UI, thread dumps, and driver/executor logs to diagnose and resolve critical issues.
- Advise customers on data engineering best practices, ETL/ELT pipelines, data modeling, and Databricks Lakehouse architecture.
- Project manage open support cases and coordinate resolution across Engineering, Product, subject-matter experts, and account teams.
- Engage senior customer and internal stakeholders to remove roadblocks, mitigate issues, and restore customer functionality.
- Review customer cases to identify trends and proactive optimization opportunities.
- Champion customer needs, chair stakeholder roundtables, and promote customer self-sufficiency with Databricks Support.
Requirements
- At least 3 years of dedicated experience building, deploying, and maintaining large-scale data pipelines in data engineering.
- At least 3 years of experience designing, developing, testing, and sustaining applications based on Python, Java, or Scala.
- Deep architectural knowledge of Apache Spark internals, including drivers, executors, memory management, DAGs, Catalyst Optimizer, and the Tungsten execution engine.
- Proven experience troubleshooting complex Spark and big data issues.
- Strong project management, analytical, problem-solving, written, and verbal communication skills.
- Ability to translate complex technical concepts for non-technical stakeholders and demonstrate executive presence.
- Customer-facing experience as a Support Engineer, Technical Account Manager, Designated Support Engineer, or in related production support is preferred.
Benefits
- Databricks offers comprehensive benefits and perks tailored to employees' needs, with specific details varying by region.
Tech Stack
Categories
Solutions Engineering
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).