Senior Staff Data Platform Engineer - Apache Iceberg - Apache Spark
ServiceNow1 day ago
Base Salary
$181k - $317k/yr
Responsibilities
- Architect, design, and build high-performance distributed systems and platform components.
- Develop scalable data ingestion solutions and fault-tolerant ingestion and transformation workflows.
- Build foundational libraries, frameworks, and tools emphasizing modularity, extensibility, configurability, and maintainability.
- Deliver clean, reusable code while applying code reviews, unit testing, automation, and design reviews.
- Lead complex technical initiatives and provide technical leadership for projects with significant complexity and risk.
- Collaborate across engineering teams to define requirements and deliver end-to-end solutions.
- Research, evaluate, and adopt technologies that improve platform capabilities.
- Troubleshoot and diagnose complex production issues across distributed systems.
- Design and operate Data Lake solutions integrating analytics engines, query services, or ML platforms.
Requirements
- 10+ years of software development experience with a bachelor's degree, 8+ years with a master's degree, 6+ years with a PhD, or equivalent work experience.
- Strong knowledge of distributed systems architecture, design patterns, algorithms, concurrency, networking, sockets, operating-system internals, and performance optimization.
- Deep Java programming expertise, including JVM internals, memory models, garbage collection, profiling, and JVM performance tuning.
- Hands-on experience building and operating large-scale distributed systems.
- Experience with relational databases such as Oracle, MySQL, or PostgreSQL.
- Experience deploying and operating Kafka or similar streaming platforms, including stream processing, topic design, partitioning, replication, and high-availability strategies.
- Experience working in DevOps environments to operationalize distributed platforms.
- Demonstrated experience architecting and delivering full-stack Data Lake solutions.
- Strong expertise designing and operating data ingestion pipelines with Apache Iceberg and Apache Spark.
- Knowledge of Parquet, ORC, Avro, compaction, and governance strategies.
- Ability to integrate Data Lakes with analytics engines, query services, or ML platforms.
- Experience evaluating how AI can be integrated into engineering work, operational tooling, or workflow automation.
- Applicants must meet the stated US citizenship, naturalized citizenship, or permanent-resident eligibility requirements for US Regulated Markets and pass the required federal personnel screening.
Benefits
- Flexible hybrid work arrangement requiring two days per week in a ServiceNow office.
- Health plans including flexible spending accounts.
- 401(k) plan with company match.
- Employee Stock Purchase Plan (ESPP).
- Matching donations, flexible time away plan, and family leave programs.
- Regular employee position supporting US Regulated Markets.
Tech Stack
Categories
BackendData Engineering
About ServiceNow
ServiceNow (NYSE: NOW) makes the world work better for everyone. Our cloud-based platform and solutions help digitize and unify organizations so that they can find smarter, faster, better ways to make work flow. So employees and customers can be more connected, more innovative, and more agile. And we can all create the future we imagine. The world works with ServiceNow. For more information, visit www.servicenow.com.