Lead Data Platform Engineer
College Board7 days ago
Remote, United StatesStaff+
Base Salary
$185k - $200k/yr
Responsibilities
- Own the technical direction, architecture, evolution, reliability, and escalation handling for a shared enterprise data and analytics platform.
- Lead hands-on design and implementation of streaming and batch data pipelines for real-time and historical analysis.
- Write production infrastructure-as-code with AWS CDK and TypeScript while setting team coding standards.
- Design curated, governed analytical data products for continuous, year-round data loads.
- Establish data contracts covering schemas, data quality, service levels, and change management.
- Embed security, access controls, lineage, classification, auditability, monitoring, and operational readiness into the platform.
- Design for scalability, performance, availability, reliability, cost efficiency, and safe recovery from retries and failures.
- Partner with domain, product, operations, security, and governance stakeholders to translate needs into sustainable technical solutions.
- Lead code and design reviews, mentor engineers, and improve practices in data engineering, automation, observability, and platform reliability.
- Establish guardrails and review standards for responsible AI-assisted coding.
- Respond to incidents, drive platform reliability, and evaluate emerging tools and architectural patterns.
Requirements
- Strong current hands-on coding experience in TypeScript and/or JavaScript with AWS CDK.
- Experience owning the technical direction and architecture of a scalable cloud data platform in production.
- Experience with technologies such as Kinesis, Data Firehose, Flink, Lambda, EventBridge, SNS, SQS, Redshift, Athena, Glue, EMR, S3, DynamoDB, or comparable tools.
- Strong experience with analytical data modeling, curated layered data architectures, and monitoring or observability.
- Experience designing for scalability, performance, cost efficiency, data integrity, and recovery from retries or failures, including production debugging of out-of-order processing, duplicate delivery, or hot partitions.
- Experience establishing data contracts and implementing schema evolution, data quality, access control, classification, lineage, and auditability practices.
- Ability to set responsible AI coding guardrails and review standards at the team level.
- Experience mentoring engineers, leading code and design reviews, serving as an escalation point, and communicating with technical and nontechnical stakeholders.
- Helpful qualifications include SaaS or multi-tenant architecture, cell-based architecture, DuckDB, SageMaker or other ML/AI-enabled analytics tools, regulated or high-governance data environments, growing a data team, presenting technical roadmaps, multi-account AWS at organizational scale, or education technology experience.
- Authorization to work in the United States.
Benefits
- Full-time, fully remote role with optional hybrid work on Tuesdays and Wednesdays for candidates near College Board offices.
- Occasional travel is required for in-person business purposes.
- College Board offers a comprehensive benefits package and a mission-driven nonprofit work environment.
- Compensation is adjusted by location and discussed transparently throughout the hiring process.
Tech Stack
Categories
Data Engineering