Data Engineering, Cloud Migration & Platforms Engineer
General Motors20 hours ago
Markham, CanadaMid Level
Base Salary
$98k - $147k/yr
Responsibilities
- Assess Oracle-based data architectures, dependencies, data flows, workloads, and operational processes to plan and execute migrations.
- Design and implement batch and near-real-time data pipelines for ingestion, transformation, validation, reconciliation, and publishing.
- Migrate data, schemas, ETL/ELT workloads, stored procedures, interfaces, and downstream consumers while maintaining quality and continuity.
- Build cloud data-platform and lakehouse capabilities across Azure, Google Cloud Platform, Databricks, and comparable services.
- Develop reusable Terraform infrastructure and manage cloud, networking, data-platform, Databricks, remote-state, and environment-specific configurations.
- Design CI/CD workflows and automate deployment and promotion across development, test, staging, and production environments.
- Implement data security, identity and access management, encryption, secrets management, key rotation, governance, cataloging, lineage, retention, and auditability.
- Create monitoring, logging, alerting, data-quality checks, dashboards, reliability improvements, incident response processes, and operational targets.
- Develop automated unit, integration, data-quality, regression, and end-to-end tests for pipelines and platform components.
- Collaborate with architects, application teams, analytics and AI practitioners, security partners, product owners, and global technology teams.
- Produce architecture diagrams, data-flow and interface documentation, runbooks, onboarding guides, README files, and production-readiness materials.
- Participate in two-week sprints, backlog refinement, estimation, delivery planning, demos, and continuous improvement.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Engineering, or a related discipline, or equivalent practical experience.
- At least 3 years of professional experience in data engineering, cloud platform engineering, DevOps, software engineering, or a related field.
- Professional experience delivering production data solutions and supporting data pipelines and ETL/ELT workloads.
- Strong Python experience for automation, developer tooling, data engineering, and PySpark processing.
- Experience with SQL, relational data modeling, schema design, query optimization, and data reconciliation.
- Experience with at least one major cloud platform, preferably Azure or Google Cloud Platform.
- Experience with Terraform infrastructure as code, reusable modules, remote state, and environment-specific configuration.
- Experience with Git, branching strategies, pull requests, code reviews, and automated CI/CD practices.
- Experience with a cloud data platform or lakehouse technology such as Databricks, Delta Lake, BigQuery, or Synapse.
- Understanding of cloud networking, identity and access management, encryption, secrets management, and secure service-to-service integration.
- Experience implementing monitoring, logging, alerting, operational dashboards, and data-quality controls.
- Preferred experience includes Oracle and enterprise data migrations, Databricks Workflows, Unity Catalog, Delta Lake, MLflow, Asset Bundles, Azure services, Google Cloud services, streaming technologies, Kubernetes, observability platforms, secrets-management tools, and production reliability practices.
- Strong troubleshooting, analytical, communication, and cross-functional collaboration skills.
Benefits
- Hybrid work requires reporting to the Markham Elevation Centre or Oshawa Elevation Centre at least three times per week.
- The role is not eligible for relocation benefits, and relocation costs are the selected candidate’s responsibility.
- The role does not provide immigration-related sponsorship now or in the future.
Tech Stack
Apache KafkaAzureDatabricksDatadogGitGitHub ActionsGoogle BigQueryGoogle Cloud PlatformKubernetesMLflowPythonSQLTerraform
Categories
Data EngineeringDevOps
About General Motors
General Motors designs, manufactures, and sells cars, trucks, and electric vehicles for consumers and commercial fleets under brands including Chevrolet, GMC, Cadillac, and Buick. A public company on the NYSE headquartered in Detroit and founded in 1908, it operates globally and is developing EVs on its Ultium battery platform. Revenue comes from vehicle and parts sales, connected services such as OnStar, and financing through GM Financial.