2 months ago
Vancouver, CanadaMid Level
Responsibilities
- Build and own batch and near-real-time data pipelines across Trails and Non-Trails sources, evolving them to production using AWS Glue.
- Transform raw signals into versioned feature groups and help operate the Feature Store across S3 and OpenSearch.
- Develop and operate Apache Flink applications and streaming systems using Kinesis and Kafka for low-latency bot-detection features.
- Partner with Applied Scientists and ML Platform engineers to define data contracts and SLAs and integrate feature pipelines with training and inference systems.
- Implement data quality checks, drift detection, governance frameworks, monitoring, reliability improvements, and cost-efficiency initiatives.
- Participate in on-call support and perform root-cause analysis for data issues.
Requirements
- At least 3 years of data engineering experience.
- Experience with data modeling, data warehousing, and ETL pipeline development.
- Experience building large-scale, high-throughput, 24x7 data systems.
- Experience with at least one modern scripting or programming language such as Python, Java, Scala, or NodeJS.
- Knowledge of batch and streaming architectures such as Kafka, Kinesis, Flink, Storm, or Beam.
- Knowledge of professional software engineering practices across the full software development lifecycle, including coding standards, software architecture, code reviews, source control, continuous deployments, testing, and operational excellence.
- Preferred experience with AWS Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
- Preferred experience with non-relational databases and data stores, including object storage, document or key-value stores, graph databases, or column-family databases.
Benefits
- Benefits include medical, dental, vision, prescription, basic life and AD&D insurance, RRSP, DPSP, paid time off, and other health and well-being resources.
- The position is based in Vancouver, British Columbia, Canada.
Tech Stack
Categories
Data Engineering
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.