Senior Data Platform Engineer, Data Cloud
Chainalysis
about 1 month ago
Toronto, Canada
Senior
H1B Sponsor
Responsibilities
- Define the technical vision for the data platform and architecture.
- Design, implement, and optimize a scalable data serving platform for data querying.
- Create and maintain a high-performance data storage and transformation platform.
- Build integrations between Data Cloud and various databases.
- Develop batch and streaming data pipelines for core blockchain datasets.
- Deploy cloud infrastructure at scale and maintain CI/CD pipelines.
- Establish observability, security, and data governance solutions.
Requirements
- 6+ years of experience as a Data Platform Engineer or similar role.
- Hands-on expertise in building cloud-based data platforms at large scale.
- Experience with batch and streaming data pipelines using relevant technologies.
- Expertise in AWS services and cloud architecture.
- Deep understanding of modern data lakehouse architectures.
- Proficiency in Python/Java and SQL.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSClickHouseDatabricksdbtJavaPythonSnowflakeSQLTerraform
Categories
AI & MLData EngineeringData Science