about 3 hours ago
Waltham, MA, USAMid Level / Senior
H1B Sponsor
Base Salary
$112k - $176k/yr
Responsibilities
- Design and build backend data pipelines for high-volume raw data.
- Develop ETL/ELT workflows using technologies like Apache Airflow and Spark.
- Implement features in Java-based services for data acquisition.
- Work with batch and streaming architectures for data flows.
- Improve data quality through validation and monitoring.
- Contribute to observability for pipeline health and performance.
- Collaborate with teams to translate business requirements into technical solutions.
- Help design and execute the roadmap for data acquisition technologies.
Requirements
- 3+ years of professional software engineering experience.
- Solid experience with production data pipelines and ETL workflows.
- Strong proficiency in Java and object-oriented programming.
- Hands-on experience with data processing technologies like Apache Beam.
- Experience with streaming technologies such as Kafka.
- Understanding of data modeling, schema design, and data quality practices.
- Experience building backend services and distributed systems.
- Familiarity with cloud providers, preferably GCP.
- Practical knowledge of SQL and large-scale storage systems.
- Bachelor's degree in Computer Science or related field.
Tech Stack
Apache AirflowApache BeamApache KafkaApache SparkGoogle BigQueryGoogle Cloud PlatformJavaKubernetesSnowflakeSQLTerraform
Categories
BackendData Engineering