3 days ago
USA (city not specified)Mid Level
H1B sponsor
Base Salary
$102k - $219k/yr
Responsibilities
- Design, develop, test, and maintain secure, scalable data pipelines and processing solutions for UDP and enterprise analytics workloads.
- Develop data engineering solutions using PySpark, SQL, Spark notebooks, Microsoft Fabric, and Azure Synapse.
- Build curated data models and reusable datasets using dimensional modeling, data transformation, and data architecture practices.
- Implement automated data quality, validation, monitoring, production support, security, privacy, access controls, and governance capabilities.
- Optimize pipelines and processing workloads for performance, scalability, reliability, and efficient resource utilization.
- Apply source control, code reviews, testing, CI/CD, documentation, and maintainable software engineering practices.
- Troubleshoot production data issues, perform root-cause analysis, and implement durable fixes.
- Partner with analysts, engineering teams, and business stakeholders to translate analytics and reporting requirements into data solutions.
- Improve the UDP engineering platform by simplifying pipelines, increasing reuse, improving architecture, and reducing operational complexity.
Requirements
- Bachelor's degree in Computer Science, Math, Software Engineering, Computer Engineering, or a related field plus 2+ years of relevant experience, or a master's degree plus 1+ year of relevant experience, or equivalent experience.
- Ability to pass Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
- Experience with data engineering, analytics engineering, production data solutions, data modeling, software development, or related work.
- Experience with Apache Spark and PySpark notebooks for large-scale ingestion, transformation, enrichment, and processing.
- Experience with Azure Synapse Analytics or similar distributed data platforms and secure ETL workloads.
- Proficiency in SQL and dimensional data modeling, including creating curated datasets for analytics and Power BI.
- Experience building reliable production pipelines with validation, error handling, performance optimization, monitoring, and troubleshooting.
- Experience with Microsoft Fabric Data Engineering, including Lakehouses, notebooks, Delta tables, OneLake, and SQL analytics endpoints.
- Experience designing medallion or lakehouse architectures and understanding enterprise data security and governance.
- Experience with Git, code reviews, testing, CI/CD, and deployment across development, UAT, and production.
- Experience using AI-assisted development tools and reusable AI skills to improve engineering productivity, testing, and troubleshooting.
- Preferred qualifications include a master's degree with 3+ years of relevant experience or a bachelor's degree with 5+ years of relevant experience, plus at least one year of data governance, compliance, or security experience.
Benefits
- The typical U.S. base pay range is USD $102,100-$202,200 per year; the San Francisco Bay Area and New York City metropolitan area range is USD $133,800-$219,200 per year.
- Certain roles may be eligible for benefits and other compensation.
- Candidates living within 50 miles of Microsoft's Redmond campus must work in the office three days per week.
- The position is open for a minimum of five days, with applications accepted on an ongoing basis until filled.
Tech Stack
Categories
Data Engineering
About Microsoft
Microsoft develops operating systems, productivity software, cloud services, developer tools, and consumer devices for individuals, enterprises, and governments. Its main products include Windows, Microsoft 365, Azure, Visual Studio/GitHub, Xbox, and LinkedIn; revenue comes from software subscriptions and licenses, cloud consumption, hardware sales, and advertising. Founded in 1975 and headquartered in Redmond, Washington, Microsoft is a public company traded on Nasdaq.