2 days ago
Hyderābād, IndiaMid Level
Responsibilities
- Design, develop, and operate petabyte-scale ingestion and transformation pipelines.
- Architect large-scale data platforms with attention to modeling, layering, scalability, reliability, and cost trade-offs.
- Transform raw data into canonical and curated data products with reusable semantic and logical models.
- Instrument, collect, and analyze telemetry and operational logs to identify anomalies, root causes, and optimization opportunities.
- Build AI-native agents that decompose natural-language questions, route them to domain skills, and return grounded insights and recommendations.
- Partner with stakeholders to define and deliver KPIs, persona dashboards, and business-outcome measurements.
- Rapidly prototype, validate, and prioritize ideas.
- Apply dimensional and semantic modeling, schema design, normalization and denormalization trade-offs, and reusable cross-domain models.
- Maintain enterprise-grade logging, telemetry, evaluation, regression, performance testing, security, and continuous learning.
- Implement data tagging, RBAC and attribute-grained policies, lineage, audit telemetry, compliance, and data-quality standards.
Requirements
- 3–5 years of software or data engineering experience building production data pipelines at scale.
- Strong programming skills in Python and/or Scala and strong SQL skills.
- Hands-on experience with Spark or Databricks, Synapse, and cloud data lakes such as ADLS Gen2 or Fabric OneLake.
- Experience designing curated or semantic data models and delivering KPIs to business stakeholders.
- Strong grounding in data governance, security, lineage, and data quality.
- Ability to translate ambiguous business questions into robust, well-modeled data products.
- Preferred: experience building LLM or agentic applications involving orchestration, RAG or grounding, NL2SQL or NL2DAX, skill routing, or MCP-based integrations.
- Preferred: familiarity with Azure AI Foundry, Copilot Studio, and agent evaluation or fine-tuning workflows.
Benefits
- The position is open for a minimum of five days, with applications accepted on an ongoing basis until filled.
- Microsoft is an equal opportunity employer and provides consideration without regard to legally protected characteristics.
- Religious and disability-related accommodations are available during the application process.
Tech Stack
Categories
AI ApplicationsData Engineering
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.