Data Engineer II, JVM

6 days ago

San Mateo, CA, USAMid Level

H1B sponsor

Base Salary

$164k - $246k/yr

Responsibilities

Design and implement high-throughput middleware and backend systems.
Develop and maintain stateful and stateless Flink stream-processing jobs and scalable ETL jobs.
Optimize the performance, reliability, and monitoring of the data pipeline stack.
Support migration from on-premises Apache Kafka to new cloud technologies.
Analyze functional and business requirements and contribute to architectural decisions for the cloud streaming data pipeline.
Collaborate with Business Intelligence and product domain teams to turn data into business value.

Bachelor’s or master’s degree in Computer Science or a related field, or equivalent practical experience.
At least 3 years of experience developing and maintaining high-throughput, concurrent, highly available, and fault-tolerant systems.
Proficiency in JVM languages including Kotlin, Scala, and Java, as well as Python.
Experience with Apache Kafka, Flink, Spark, and SQL.
Knowledge of functional programming, object-oriented programming, and TDD.
Knowledge of REST, JSON, gRPC, and WebSockets.
Expertise with JSON, Avro, and Protobuf, including unstructured and semi-structured data.
Experience with ETL, stream processing, real-time pipelines, and batch processing.
Familiarity with Git and CI/CD development tools and processes.
Experience monitoring and analyzing system performance and isolating reliability, performance, and scalability issues.
Strong interpersonal and communication skills, self-motivation, and the ability to work with geographically distributed teams.
Experience with enterprise-scale Amazon Web Services, including OpenSearch, MSK, and EKS, is preferred.
Experience with Kubernetes, Docker, and cloud deployment technologies is preferred.