Cloud Data Engineer
AmTrust Financial Services, Inc.3 months ago
Dallas, TX, USASenior
Responsibilities
- Design, develop, and maintain scalable Azure cloud data engineering solutions, including ETL/ELT pipelines, data integration processes, reports, and analytics workflows.
- Design and optimize cloud data lakehouse and data warehousing architectures, evaluating technical alternatives and their operational and business impacts.
- Develop, tune, troubleshoot, test, deploy, and document complex SQL, T-SQL, Spark SQL, PySpark, Python, and Scala workloads and Databricks notebooks.
- Build cloud-native applications, APIs, and data pipelines using Git, Azure DevOps, and automated deployment practices.
- Manage the full lifecycle of complex data initiatives, from requirements gathering and solution design through production support and continuous improvement.
- Support AI, machine learning, and Generative AI initiatives through curated datasets, feature engineering pipelines, scalable data platforms, model integration, and MLOps processes.
- Collaborate with stakeholders, architects, developers, and leadership to translate business requirements into scalable technical solutions and communicate complex concepts effectively.
- Research emerging cloud, data engineering, AI, Databricks, Azure, automation, and analytics technologies and recommend solutions that create business value.
Requirements
- 7+ years of experience in cloud data engineering, ETL/ELT development, data warehousing, and enterprise analytics solutions.
- Hands-on experience with Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and modern cloud-based data lakehouse architectures.
- Experience implementing Medallion Architecture with Bronze, Silver, and Gold layers.
- Advanced proficiency in Python, PySpark, Spark SQL, SQL, T-SQL, and Scala.
- Experience designing, developing, and tuning complex queries and large-scale distributed data processing solutions across high-volume datasets.
- Experience implementing Git-based source control, Azure DevOps, CI/CD pipelines, and automated deployment frameworks.
- Strong understanding of dimensional modeling, Star and Snowflake schemas, data governance, metadata management, and data quality practices.
- Experience supporting AI, machine learning, and Generative AI initiatives, including data preparation, feature engineering, model integration, vectorized data architectures, and MLOps.
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Mathematics, Statistics, or a related technical discipline, or equivalent work experience.
- Experience with large datasets, data cleansing, data transformation, reporting, statistical analysis, and advanced analytics.
- Strong analytical, problem-solving, communication, technical documentation, requirements gathering, presentation, independent-work, and collaboration skills.
- Preferred experience in Property & Casualty Insurance, Financial Services, Accounting, or Actuarial domains.
- Preferred Microsoft Azure or Databricks certifications, including Azure Data Engineer Associate, Azure AI Engineer Associate, or Databricks Data Engineer Associate/Professional.
Benefits
- Medical and dental plans.
- Life insurance for eligible employees, spouses, and children.
- Health Care Flexible Spending and Dependent Care plans.
- 401k savings plans.
- Paid time off.
- Competitive compensation package and career advancement opportunities.
- Diverse and inclusive workplace culture.
About AmTrust Financial Services, Inc.
AmTrust Financial Services is a multinational property and casualty insurer focused on small commercial lines, workers’ compensation, specialty risk, and extended-warranty programs. It sells coverage through agents, brokers, and partnerships with manufacturers and retailers, serving businesses across the U.S. and internationally. Founded in 1998 and headquartered in New York City, AmTrust is privately held after previously trading on NASDAQ.