4 hours ago
Chicago, IL, USA or Detroit, MI, USASenior
Responsibilities
- Work directly with clients to understand business goals, data challenges, and technical requirements.
- Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews.
- Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
- Implement medallion and lakehouse architectures, dimensional models, and data transformation workflows for analytics and reporting.
- Engineer solutions using PySpark, Spark SQL, SQL, Python, Delta Lake, Azure, and Databricks.
- Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security.
Requirements
- Bachelor’s degree in computer science or a related field.
- At least 6 years of experience in data engineering, data platform development, or cloud data solutions.
- At least 3 years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies.
- Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL.
- Expertise designing enterprise-level Databricks strategy and architecture, including Unity Catalog, data warehousing, data sharing, and Mosaic AI.
- Experience with DevOps for data, GitHub, automated testing, and containers such as AKS and Docker.
- Excellent communication skills and the ability to explain concepts clearly to teammates and customers and learn new technologies quickly.
- Preferred experience working directly with clients, business stakeholders, or cross-functional teams in consulting or professional services.
- Preferred experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents.
- Preferred experience with data governance, data security, master data management, and industry-specific security requirements.
- Preferred broad experience with data and reporting tools, architectures, cloud vendors, and data and AI concepts beyond Microsoft.
Tech Stack
Categories
Data Engineering
About Reply
Reply [EXM, STAR: REY] specialises in the design and implementation of solutions based on new communication channels and digital media. As a network of highly specialised companies, Reply defines and develops business models enabled by the new models of AI, big data, cloud computing, digital media and the internet of things. Reply delivers consulting, system integration and digital services to organisations across the telecom and media; industry and services; banking and insurance; and public sectors.