3 days ago
Base Salary
$236k - $339k/yr
Responsibilities
- Lead the technical design and implementation of Spark query compilation and runtime integration, including intermediate representations, type resolution, semantic compatibility, query-plan transformations, and SQL generation.
- Own complex engineering initiatives from problem definition and architecture through implementation, validation, and production rollout.
- Provide technical leadership by aligning contributors, reviewing designs and code, resolving blockers, and guiding engineering trade-offs without formal management authority.
- Improve workload performance and cost-efficiency through profiling, compilation-latency reduction, metadata-access improvements, and collaboration with query-engine teams.
- Establish correctness and compatibility practices, including differential testing against Apache Spark, regression coverage, and handling of unsupported behavior.
- Drive production quality through observability, incident investigation, fault recovery, and safe rollout practices.
- Mentor engineers through design discussions, code reviews, debugging, and knowledge sharing.
- Partner with technical leaders and Product Management to prioritize investments, identify dependencies, and define engineering milestones.
- Validate changes against customer workloads and measure improvements in compatibility, latency, reliability, and cost-efficiency.
Requirements
- 10+ years of hands-on software engineering experience, including substantial work on compilers, query-processing systems, or runtime infrastructure.
- Experience serving as a technical lead for complex engineering initiatives and guiding engineers without formal management authority.
- Track record of designing, implementing, and delivering production systems with ownership of major architectural and implementation decisions.
- Deep expertise in compiler architecture and IR transformations, relational query processing, language semantics and type systems, runtime integration, or a related area.
- Proficiency in Scala, Java, C++, or a comparable implementation language, with the ability to write and review production code.
- Strong systems fundamentals in concurrency, memory behavior, and performance analysis, plus experience debugging complex production issues.
- Ability to translate technical and customer requirements into engineering priorities and collaborate across teams and locations.
- Strong technical communication and mentorship skills, including explaining complex trade-offs and building architectural alignment.
- Preferred experience with Apache Spark internals, Catalyst, Spark Connect, or DataFrame APIs.
- Preferred experience with relational algebra, SQL generation, query optimization, database execution systems, Scala/JVM performance, native runtime functions, metadata caching, compilation optimization, compatibility testing, performance benchmarks, production observability, customer adoption, production hardening, and staged releases.
- A degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience, is preferred.
Benefits
- The role is based in Bellevue, Washington or Menlo Park, California.
- Salary and benefits information is provided through the Snowflake Careers Site for U.S.-located jobs.
Tech Stack
Categories
About Snowflake
Snowflake builds a cloud-native data platform used by enterprises to store, integrate, share, and analyze data across AWS, Azure, and Google Cloud. Its core products span data warehousing, data lakes, data engineering, and governed data sharing, sold via consumption-based subscriptions. Founded in 2012 and publicly traded on the NYSE (SNOW) following a 2020 IPO, Snowflake supports analytics and data application workloads across industries.