18 hours ago
Gurgaon, IndiaMid Level
Responsibilities
- Design, build, debug, migrate, and optimize data ingestion and transformation pipelines using Azure Data Factory and Databricks notebooks.
- Partner with architects, business teams, and data science teams to design scalable Azure solutions.
- Build and maintain data transformation processes, data structures, metadata management, and workload and dependency orchestration.
- Design conceptual, logical, and physical data models and warehouse schemas for analytics.
- Provide technical expertise and thought leadership on Azure cloud architecture and infrastructure strategy.
- Maintain and evolve Azure infrastructure while planning for scale and future needs.
- Author specifications covering design, testing, and support processes.
- Translate business requirements into development plans, effort estimates, and project timelines.
- Identify and mitigate risks across design, implementation, and delivery with cross-functional project teams.
Requirements
- At least 3 years of professional IT experience with a strong foundation in data engineering.
- At least 3 years of hands-on experience with Azure Data Lake Storage, Azure Data Factory, Databricks, Azure SQL Data Warehouse, and Azure Functions.
- Strong proficiency in Python for data engineering workflows.
- Experience designing and building solutions on Azure, including Azure SQL Data Warehouse or Azure SQL Database, Data Factory, Data Lake Store or Blob Storage, and Databricks.
- Hands-on Databricks experience with notebooks, Delta Lake, cluster management, and job orchestration.
- Production experience implementing lakehouse architecture principles.
- Strong SQL skills across relational and NoSQL databases, especially T-SQL and Azure SQL Data Warehouse.
- Ability to develop and maintain conceptual, logical, and physical data models.
- Familiarity with large language models and retrieval-augmented generation architecture is preferred.
- Experience in HR analytics is preferred.
Benefits
- Hybrid work environment with flexibility to work virtually and collaborate in person.
- Gartner offers competitive compensation, world-class benefits, professional growth opportunities, and an inclusive workplace.
About Gartner
Gartner is a public research and advisory firm that sells subscription research, consulting, and conferences to CIOs and business leaders at large enterprises and governments. Its offerings include market analysis (e.g., Magic Quadrant), peer benchmarks, expert advisory, and events. Founded in 1979 and headquartered in Stamford, Connecticut, Gartner trades on the NYSE (ticker: IT) and is a member of the S&P 500.