Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
ServiceNow2 months ago
Base Salary
$181k - $317k/yr
Responsibilities
- Architect, design, and build high-performance distributed systems and platform components.
- Build scalable, reliable data ingestion solutions and Data Lake architectures.
- Develop modular, reusable libraries, frameworks, and tools for platform extensibility and maintainability.
- Write high-quality code and enforce code reviews, unit testing, automation, and design review practices.
- Lead complex technical initiatives and provide technical leadership for projects with significant complexity and risk.
- Collaborate across engineering teams to define requirements and deliver end-to-end solutions.
- Research and adopt technologies that improve platform capabilities.
- Troubleshoot and diagnose complex production issues across distributed systems.
Requirements
- 10+ years of software development experience with a bachelor’s degree, 8+ years with a master’s degree, 6+ years with a PhD, or equivalent work experience.
- Deep expertise in Java, including JVM internals, memory models, garbage collection, performance tuning, and profiling.
- Strong knowledge of distributed systems architecture, concurrency, networking, sockets, operating system internals, and performance optimization.
- Hands-on experience building and operating large-scale distributed systems.
- Experience with relational databases such as Oracle, MySQL, or PostgreSQL.
- Experience deploying and operating Kafka or similar large-scale streaming platforms, including topics, partitioning, replication, and high availability.
- Experience working in DevOps environments to operationalize distributed platforms.
- Demonstrated ability to architect and deliver full-stack Data Lake solutions and data ingestion pipelines.
- Expertise with Apache Iceberg, Kafka Connect, Apache Kafka, Apache Flink, and Apache Spark.
- Knowledge of Parquet, ORC, and Avro data formats, as well as compaction and governance strategies.
- Ability to build scalable, fault-tolerant ingestion and transformation workflows and integrate Data Lakes with analytics engines, query services, or ML platforms.
- Experience evaluating how AI can be integrated into engineering work, operational tooling, or workflow automation.
Benefits
- Flexible hybrid work arrangement requiring two days per week in a ServiceNow office; the role is listed as Flexible or Remote depending on work persona and location.
- Health plans including flexible spending accounts.
- 401(k) plan with company match.
- Employee Stock Purchase Plan (ESPP).
- Matching donations program.
- Flexible time away plan.
- Family leave programs.
Tech Stack
Categories
BackendData Engineering
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.