14 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Translate business problems and requirements into data-driven solutions and concrete projects.
- Identify and vet data sources against service-level and quality standards.
- Design, automate, deploy, and operate ETL/ELT pipelines across diverse data sources.
- Build and maintain logical, physical, relational, dimensional, and NoSQL data models.
- Define dimensional models including facts, dimensions, grain, SCD Type 1/2 patterns, snapshots, event models, and data-product contracts.
- Design and govern semantic layers, certified metrics, reusable dimensions, governed views, and documentation.
- Establish standards for naming, keys, lineage, partitioning, clustering, retention, audit columns, and data-quality controls.
- Implement data governance, privacy controls, row- and column-level security, metadata, lineage, and access patterns.
- Define quality and observability measures for reconciliation, freshness, completeness, metric consistency, and schema changes.
- Review architecture, designs, and code; identify scalability risks; and guide teams toward maintainable solutions.
- Mentor engineers and analysts and lead cross-functional technical initiatives.
- Influence enterprise data architecture and technology decisions across data platforms, BI tools, and AI applications.
Requirements
- 12+ years of professional data engineering experience or equivalent demonstrated impact.
- Deep hands-on expertise in dimensional modeling, including facts, dimensions, grain, surrogate keys, conformed dimensions, SCD Type 1/2 patterns, and snapshot modeling.
- Proven experience designing and governing semantic models and certified metrics for BI and self-service analytics platforms, including tools such as Erwin.
- Extensive experience building logical and physical data models across relational, dimensional, and NoSQL platforms.
- Strong hands-on expertise in Python and SQL.
- Production experience with Apache Spark, Apache Hive, and Scala for large-scale data processing.
- Hands-on experience with Azure and Google BigQuery.
- Experience building, deploying, and operating pipelines with orchestration frameworks such as Airflow or Dagster.
- Hands-on experience with Apache Kafka or an equivalent real-time streaming platform.
- Experience implementing data-quality frameworks, compliance, and data governance across the data lifecycle.
- Ability to review and guide engineers without formal management authority and influence senior technical and business stakeholders.
- Experience with agentic AI frameworks such as LangChain, LangGraph, or AutoGen for autonomous or LLM-driven data workflows.
- Working knowledge of automated deployment pipelines using tools such as Jenkins, GitHub Actions, or Azure DevOps.
- Preferred experience with Looker/LookML, Cube, AtScale, Power BI, or Tableau.
- Preferred experience designing data products for AI, machine learning, agentic applications, or retrieval-based systems.
- Preferred experience with regulated data domains, privacy-aware access patterns, event-driven data, CDC pipelines, streaming platforms, lakehouse architectures, data catalogs, lineage, observability, and data-quality platforms.
- Working knowledge of Java or React.js is preferred.
- Minimum qualifications include a qualifying combination of a bachelor’s degree and 4 years of experience, 6 years of experience without the listed degree, or a master’s degree and 2 years of experience, plus 3 years of experience in data engineering, database engineering, business intelligence, or business analytics.
Benefits
- Incentive awards may be available based on performance.
- Benefits include maternity and parental leave, paid time off, and health benefits.
- The role is based in the Bangalore office for daily work, with flexibility for associates to manage their personal lives.
Tech Stack
Apache AirflowApache HiveApache KafkaApache SparkAzureGitHub ActionsGoogle BigQueryJavaJenkinsPythonReactScalaSQL
Categories
Data Engineering
About Walmart
Walmart is a global omnichannel retailer that sells groceries, general merchandise, and services through Walmart and Sam's Club stores and online marketplaces for consumers and small businesses. Its model spans physical retail, e-commerce, advertising, and a vast supply chain, plus pharmacy, health, and financial services. Founded in 1962 and headquartered in Bentonville, Arkansas, Walmart Inc. is a public company on the NYSE (WMT) operating in the U.S. and multiple international markets.