
Data Engineering - Assistant Vice President
State Street2 days ago
Bengaluru, India or Hyderābād, IndiaStaff+
Responsibilities
- Lead the architecture, design, development, and production support of scalable batch and near-real-time data pipelines.
- Build reusable ETL/ELT frameworks with Python, SQL, Alteryx, monitoring, exception handling, orchestration, scheduling, and dependency management.
- Own relational and dimensional data models, data marts, semantic-ready datasets, metadata, lineage, and documentation.
- Optimize queries, pipelines, and storage through partitioning, indexing, incremental loads, parallel processing, and workload management.
- Establish data quality, reconciliation, auditability, security, retention, privacy, and access-management controls.
- Provide technical leadership through design reviews, code reviews, development standards, release governance, incident resolution, root-cause analysis, and continuous improvement.
- Partner with business, reporting, analytics, architecture, infrastructure, and vendor teams on roadmaps, dependencies, estimates, and delivery outcomes.
- Mentor engineers and analysts and communicate solution options, risks, and trade-offs to senior stakeholders.
- Evaluate data science, machine learning, and AI use cases that may improve data quality, anomaly detection, forecasting, classification, or operational efficiency.
Requirements
- 12–16 years of relevant technology experience, including substantial hands-on data engineering experience and at least 3 years leading complex data solutions or engineering workstreams.
- Advanced SQL skills including complex joins, window functions, stored procedures, query plans, indexing, performance tuning, and large-scale transformations.
- Strong Python engineering experience for data processing, automation, API integration, reusable libraries, testing, logging, and production pipeline development.
- Experience designing ETL/ELT pipelines, orchestration, scheduling, restartability, dependency management, monitoring, and production support.
- Strong knowledge of data modeling, relational databases, dimensional modeling, schema design, slowly changing dimensions, data marts, and master/reference data patterns.
- Hands-on Alteryx experience and experience with at least one modern engineering stack such as Azure Data Factory, Microsoft Fabric, Azure Synapse, Databricks, Apache Spark, AWS Glue, or equivalent.
- Experience with APIs, JSON, CSV, Parquet, database extracts, file-based feeds, structured and semi-structured data, and secure data-transfer patterns.
- Practical experience with Git-based version control, testing, environment promotion, release management, and technical documentation.
- Strong understanding of data quality, reconciliation, lineage, metadata, security, privacy, audit controls, and regulated data-management practices.
- Proven leadership, stakeholder management, problem-solving, written communication, and ability to manage competing priorities in a global delivery environment.
- Working knowledge of data science methods and familiarity with scikit-learn, TensorFlow, PyTorch, generative AI concepts, MLOps or LLMOps, Power BI, DAX, Docker, Kubernetes, graph databases, Kafka, or infrastructure-as-code is advantageous.
- A bachelor's or master's degree in Computer Science, Information Technology, Engineering, Data Science, Statistics, or a related discipline is required.
- Cloud or data-engineering certifications from Microsoft Azure, Databricks, AWS, Google Cloud, or equivalent are advantageous.
- Financial-services experience in banking operations, payments, transaction management, reconciliation, controls, or regulatory reporting is preferred.
Benefits
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks are offered.
- The employer is an equal opportunity employer and supports an inclusive workplace.
Tech Stack
Apache KafkaApache SparkAWSAzureDatabricksDockerGitGoogle CloudKubernetesPythonPyTorchscikit-learnSQLTensorFlow
Categories
Data Engineering
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.