Encora

Lead Data Engineer (DBT, Databricks, Azure)

Encora
Apply
2 months ago
Remote, AmericasStaff+
H1B sponsor

Responsibilities

  • Lead the RTS delivery squad and own end-to-end delivery of strategic data products.
  • Design and oversee low-latency, API-driven data solutions from backend data models through serving layers and API consumption.
  • Build and maintain scalable Python backend services and REST APIs.
  • Design, develop, and optimize data pipelines using Azure Databricks, dbt, SQL, and cloud-native technologies.
  • Own the architecture and implementation of highly available, scalable, and performant curated data layers.
  • Lead infrastructure deployment and management using Terraform and Infrastructure as Code practices.
  • Mentor and develop data and machine learning engineers through technical guidance, coaching, and career development support.
  • Conduct code reviews and establish engineering standards, best practices, and architectural guidelines.
  • Collaborate with product, engineering, business, and project stakeholders on technical solutions and delivery roadmaps.
  • Ensure data quality, observability, monitoring, alerting, and SLA compliance across data products and services.
  • Drive CI/CD adoption and oversee release management for pipelines, services, and platform components.
  • Troubleshoot complex production issues as the primary technical escalation point and maintain platform stability.
  • Maintain technical documentation, architectural decisions, and implementation standards.

Requirements

  • At least 8 years of experience in data engineering, software engineering, or related technical roles.
  • At least 3 years of experience leading engineering teams comprising senior, mid-level, and junior professionals.
  • Strong backend development experience delivering production-grade REST APIs and backend services.
  • Expert-level Python programming and strong object-oriented programming skills.
  • Extensive experience with PyTest, unit testing, automated testing frameworks, and software quality practices.
  • Strong hands-on experience with Azure Databricks and dbt.
  • Advanced SQL skills and experience building scalable data solutions.
  • Deep knowledge of data modeling, dimensional modeling, and consumption-oriented data architectures.
  • Extensive experience with Terraform and Infrastructure as Code deployments.
  • Experience designing and delivering low-latency data products, serving layers, or API-driven data solutions.
  • Strong knowledge of CI/CD pipelines, Git-based version control, and modern software engineering practices.
  • Ability to lead technical delivery while remaining hands-on with architecture, development, and code reviews.
  • Strong communication and stakeholder management skills.
  • Preferred experience in insurance, financial services, or other regulated industries.
  • Preferred knowledge of insurance concepts including policy administration, claims, underwriting, and customer data.
  • Preferred experience with Snowflake, Snowflake-to-Databricks integration or migration, Azure AI Search, Lakebase, feature stores, Kafka, Event Hubs, Delta Live Tables, data governance, security, compliance, terabyte-scale dbt pipelines, AWS-to-Azure migrations, and machine learning platforms.

Benefits

  • Open to candidates across LATAM.

Tech Stack

Apache KafkaAWSAzureDatabricksdbtGitpytestPythonSnowflakeSQLTerraform

Categories

BackendData Engineering
Encora

About Encora

5,001-10,000 employees

Encora provides software and digital product engineering services for technology companies and enterprises, including cloud-native development, data engineering, and QA. It operates a global delivery model and supports outsourced product development and managed engineering teams. Headquartered in Santa Clara, California, Encora is privately held and was acquired by Coforge; it previously raised $200 million in private equity funding in 2019.

Contact me