Senior Staff Data Platform Engineer - Apache Iceberg - Apache Spark
ServiceNow1 day ago
Base Salary
$201k - $352k/yr
Responsibilities
- Architect, design, and build high-performance distributed systems and platform components.
- Develop scalable data ingestion solutions and fault-tolerant ingestion and transformation workflows.
- Build and operate Data Lake solutions using Apache Iceberg, Apache Spark, and large-scale streaming platforms.
- Create foundational libraries, frameworks, and tools emphasizing modularity, extensibility, configurability, and maintainability.
- Provide technical leadership for complex, high-risk projects and define engineering best practices.
- Collaborate across engineering teams to deliver end-to-end solutions and refine requirements.
- Research and adopt technologies that improve platform capabilities.
- Troubleshoot and diagnose complex production issues across distributed systems.
Requirements
- 10+ years of software development experience with a bachelor's degree, 8+ years with a master's degree, 6+ years with a PhD, or equivalent work experience.
- Deep expertise in distributed systems architecture, design patterns, algorithms, concurrency, networking, sockets, operating system internals, and performance optimization.
- Strong Java programming expertise, including JVM internals, memory models, garbage collection, profiling, and performance tuning.
- Hands-on experience building and operating large-scale distributed systems and Kafka or similar streaming platforms.
- Experience designing stream processing systems, including topic design, partitioning, replication, and high-availability strategies.
- Experience operating distributed platforms in DevOps environments.
- Experience architecting and delivering full-stack Data Lake solutions and data ingestion pipelines.
- Expertise with Apache Iceberg tables, catalogs, schema evolution, and metadata management.
- Expertise with Apache Spark batch and streaming jobs, optimization, and partitioning.
- Experience with relational databases such as Oracle, MySQL, or PostgreSQL.
- Knowledge of Parquet, ORC, Avro, compaction, governance, analytics engines, query services, or ML platforms.
- Experience integrating AI into engineering work through AI-powered coding or operational tooling, workflow automation, or analysis of AI-driven changes to software and infrastructure.
- Applicants must be U.S. citizens, naturalized citizens, or permanent residents holding a green card, and must pass the required federal background screening, credit check, criminal/misdemeanor check, and drug test.
Benefits
- Flexible hybrid work arrangement requiring two days per week in a ServiceNow office, with flexible or remote work personas depending on eligibility.
- Health plans, including flexible spending accounts.
- 401(k) plan with company match.
- Employee Stock Purchase Plan (ESPP).
- Matching donations, flexible time away, and family leave programs.
- Regular employee position supporting US regulated markets.
Tech Stack
Categories
BackendData Engineering
About ServiceNow
ServiceNow (NYSE: NOW) makes the world work better for everyone. Our cloud-based platform and solutions help digitize and unify organizations so that they can find smarter, faster, better ways to make work flow. So employees and customers can be more connected, more innovative, and more agile. And we can all create the future we imagine. The world works with ServiceNow. For more information, visit www.servicenow.com.