4 days ago
Base Salary
$145k - $165k/yr
Responsibilities
- Design, build, and operate high-volume data ingestion and orchestration pipelines for network, device, satellite terminal, and third-party vendor telemetry.
- Build and evolve stateful real-time event processing and detection logic at scale.
- Extend workflow and rule engines with configurable client-specific flows, authoring, validation, and versioning.
- Own data models, APIs, and services supporting event and incident monitoring views.
- Implement observability, retry semantics, end-to-end tracing, and data lineage.
- Contribute to lakehouse table and partition design, schema evolution, storage lifecycle, and query performance.
- Build and operate services on containerized infrastructure using the team’s deployment and infrastructure patterns.
- Write technical designs, participate in code reviews, collaborate with stakeholders, and share a light on-call rotation.
- Use AI-assisted engineering tools as a primary development workflow and validate their output.
Requirements
- A degree in Computer Science, Engineering, or a similar field, or equivalent work experience.
- At least 5 years of professional software engineering experience, including substantial production data-pipeline and workflow or rule-engine development.
- Strong Java or Python skills, ideally both.
- Production stream-processing experience with technologies such as Apache Flink, Kafka Streams, Spark Structured Streaming, or Beam.
- Practical Apache Kafka knowledge including partitioning, compaction, consumer groups, and schema evolution with Avro or Schema Registry.
- Experience with Dagster or a comparable workflow or ETL orchestrator such as Airflow or Prefect.
- SQL fluency and production experience with a columnar or lakehouse query engine.
- Experience operating Kubernetes workloads and troubleshooting distributed systems under pressure.
- Familiarity with unit testing, automated testing, and CI/CD practices.
- Proficiency with AI-assisted development tools such as Claude Code, Copilot, or Cursor.
- Strong communication skills for explaining technical decisions to technical and non-technical stakeholders.
Benefits
- The position is based in NYC.
- The U.S. base salary range is $145,000.00 to $165,000.00 annually, varying by work location and qualifications.
- The role includes a light on-call rotation.
- MetTel offers a collaborative environment focused on professional growth, skill development, and knowledge sharing.
Tech Stack
Apache AirflowApache BeamApache FlinkApache KafkaApache SparkClickHouseGoogle BigQueryJavaKubernetesPrestoPythonSnowflakeSQL
Categories
BackendData Engineering
