Data Platform Engineer, VP II - State Street Investment Management
State Street2 months ago
Base Salary
$120k - $203k/yr
Responsibilities
- Execute the long-term vision, target architecture, and roadmap for a unified cloud-native data platform spanning ingestion, transformation, storage, governance, and secure access.
- Define data strategies and logical and physical data models aligned with analytical workloads in collaboration with enterprise and application architects.
- Develop core Lakehouse, batch, event, streaming, metadata, catalog, observability, and security platform capabilities.
- Design, implement, and optimize Apache Iceberg-based tables, including partitioning, compaction, and metadata management.
- Establish engineering practices covering CI/CD, infrastructure as code, automated testing, schema and versioning practices, data quality, and end-to-end observability.
- Define data semantics, data product contracts, governance, stewardship, compliance standards, and backward-compatibility practices with Product, Analytics, ML, and domain teams.
- Build curated semantic-layer models, governed BI endpoints, and consumption APIs.
- Optimize pipeline and query performance through partitioning, clustering, caching, archiving, and data lifecycle management.
- Evaluate agentic AI frameworks and AI-assisted development tools for use across the software development life cycle.
Requirements
- Master’s degree in Computer Science or a related engineering discipline.
- 15+ years of technology experience in the financial services industry.
- Strong hands-on programming experience with Python and SQL; Java or Scala is a plus.
- Experience designing, debugging, and optimizing distributed data processing and using AI-assisted development tools such as GitHub Copilot, Codex, or Anthropic tools.
- Deep experience with Spark batch and streaming, including performance tuning, troubleshooting, and cost-aware optimization.
- Hands-on experience building and operating modern Lakehouse platforms with Snowflake and Databricks on AWS; Azure experience is acceptable.
- Working knowledge of Apache Iceberg, open table formats, and metadata ecosystems such as Unity Catalog or equivalent services.
- Experience designing modern open-architecture data platforms supporting OLAP, OLTP, and near-real-time workloads across multiple compute engines.
- Extensive experience architecting enterprise DevOps and CI/CD pipelines with cloud-agnostic solutions across AWS, GCP, and Azure.
- Expertise in zero-copy data sharing, data virtualization, catalog federation, and governed data-access patterns.
- Experience with structured and unstructured data sources and processing patterns.
- Experience establishing SDLC standards, CI/CD, observability, reliability engineering, incident management, and continuous-improvement practices for mission-critical platforms.
- Preferred experience in data or platform development within a financial institution.
- Preferred familiarity with governance frameworks and tools including Unity Catalog, Collibra, and Alation.
- Preferred expertise in AI-assisted coding with GitHub Copilot or Claude Code Assistant.
Benefits
- Annual base salary range of $120,000–$202,500, with the applicable range potentially differing by primary work location.
- Retirement savings plan with company match.
- Insurance coverage including basic life, medical, dental, vision, long-term disability, and optional additional coverages.
- Paid time off including vacation, sick leave, short-term disability, and family-care leave.
- Employee Assistance Program.
- Eligibility for incentive compensation and annual performance-based awards, excluding certain sales roles.
- Eligibility for certain tax-advantaged savings plans.
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks.
Tech Stack
Categories
BackendData Engineering
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.