Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
ServiceNow7 days ago
Base Salary
$181k - $317k/yr
Responsibilities
- Architect, design, and build high-performance distributed systems and platform components.
- Build scalable, reliable data ingestion solutions and Data Lake architectures.
- Develop modular, reusable libraries, frameworks, and tools for platform extensibility and maintainability.
- Write high-quality code and enforce code reviews, unit testing, automation, and design review practices.
- Lead complex technical initiatives and provide technical leadership for projects with significant complexity and risk.
- Collaborate across engineering teams to define requirements and deliver end-to-end solutions.
- Research and adopt technologies that improve platform capabilities.
- Troubleshoot and diagnose complex production issues across distributed systems.
Requirements
- 10+ years of software development experience with a bachelor’s degree, 8+ years with a master’s degree, 6+ years with a PhD, or equivalent work experience.
- Deep expertise in Java, including JVM internals, memory models, garbage collection, performance tuning, and profiling.
- Strong knowledge of distributed systems architecture, concurrency, networking, sockets, operating system internals, and performance optimization.
- Hands-on experience building and operating large-scale distributed systems.
- Experience with relational databases such as Oracle, MySQL, or PostgreSQL.
- Experience deploying and operating Kafka or similar large-scale streaming platforms, including topics, partitioning, replication, and high availability.
- Experience working in DevOps environments to operationalize distributed platforms.
- Demonstrated ability to architect and deliver full-stack Data Lake solutions and data ingestion pipelines.
- Expertise with Apache Iceberg, Kafka Connect, Apache Kafka, Apache Flink, and Apache Spark.
- Knowledge of Parquet, ORC, and Avro data formats, as well as compaction and governance strategies.
- Ability to build scalable, fault-tolerant ingestion and transformation workflows and integrate Data Lakes with analytics engines, query services, or ML platforms.
- Experience evaluating how AI can be integrated into engineering work, operational tooling, or workflow automation.
Benefits
- Flexible hybrid work arrangement requiring two days per week in a ServiceNow office; the role is listed as Flexible or Remote depending on work persona and location.
- Health plans including flexible spending accounts.
- 401(k) plan with company match.
- Employee Stock Purchase Plan (ESPP).
- Matching donations program.
- Flexible time away plan.
- Family leave programs.
Tech Stack
Categories
BackendData Engineering
About ServiceNow
ServiceNow (NYSE: NOW) makes the world work better for everyone. Our cloud-based platform and solutions help digitize and unify organizations so that they can find smarter, faster, better ways to make work flow. So employees and customers can be more connected, more innovative, and more agile. And we can all create the future we imagine. The world works with ServiceNow. For more information, visit www.servicenow.com.