Cloud Data Engineer, AVP
State Street4 days ago
Base Salary
$90k - $158k/yr
Responsibilities
- Assess application and data infrastructure, identify improvement opportunities, and recommend scalable, reliable cloud solutions.
- Build reusable data solutions and optimize data engineering and machine learning pipelines in Databricks using AWS services.
- Define best practices for application deployment, cloud infrastructure, and production support.
- Develop cost-effective cloud migration strategies and migrate databases, applications, and machine learning solutions to Databricks and AWS.
- Partner with technology teams, business stakeholders, vendors, and senior management to deliver engineering solutions.
- Develop proofs of concept and evaluate emerging technologies for broader adoption.
- Analyze data and systems, identify root causes, and translate findings into actionable recommendations.
Requirements
- Bachelor’s degree in computer science, information systems, or a related field, or equivalent practical experience.
- Five or more years of experience in data engineering, including hands-on cloud technology experience.
- Strong Databricks architecture knowledge and hands-on experience with Databricks Data Engineering, Machine Learning, and SQL warehouses.
- Strong programming experience in Scala, Python, and/or Java for data engineering workloads.
- Strong knowledge of Medallion architecture, Delta Live Tables, Unity Catalog, AWS architecture, Apache Airflow, and deployment automation.
- Experience with database architecture, business intelligence, machine learning, advanced analytics, big data, and migrating relational databases and applications.
- Experience migrating Java and Python applications, machine learning model code, and Elasticsearch-based solutions.
- Docker and Kubernetes experience is preferred.
- AWS and/or Databricks certification is preferred but not required.
- Strong analytical, problem-solving, communication, collaboration, and stakeholder-management skills.
Benefits
- Comprehensive benefits include a 401(k) retirement savings plan with company match, life, medical, dental, vision, and disability insurance, paid time off, family-care leave, and an Employee Assistance Program.
- Eligible employees may receive annual performance-based incentive awards and access to tax-advantaged savings plans.
- The company provides inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks.
Tech Stack
Categories
Data Engineering
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.