about 5 hours ago
Remote, Canada
Senior
H1B Sponsor
Responsibilities
- Design, build, and operate foundational data-heavy services including storage, orchestration, and processing.
- Build and maintain data integration and process SDKs for internal services and product teams.
- Create self-service applications for users to manage and troubleshoot data pipelines.
- Develop services for data security and observability, including access controls and data quality tracking.
- Convert functional requests into reusable patterns and assemble data microservices for business needs.
Requirements
- At least 5+ years of experience in software engineering.
- Strong backend development skills in Python, Go, or Java.
- General experience with data systems or data pipelines.
- Familiarity with design patterns such as scale-out, caching, and key/value.
- Proficiency in SQL, Python, Airflow, and BI for operational insights.
- Ability to responsibly use generative AI tools in workflows.
Tech Stack
Apache AirflowApache KafkaApache SparkGoJavaPythonSQL
Categories
AI & MLBackendData EngineeringData Science