Data Engineer 4 (Manager, IC)
Capital One18 days ago
Cambridge, MA, USA +2 moreStaff+
Base Salary
$179k - $225k/yr
Responsibilities
- Design, develop, test, implement, and support technical solutions using full-stack tools and technologies.
- Influence developers, data analysts, and data scientists working with distributed data, machine learning, microservices, lakehouse architecture, and full-stack systems.
- Design, build, and deliver scalable cloud data solutions, applications, platforms, and pipelines with limited supervision.
- Architect and enforce reusable data engineering design patterns across data platforms and pipelines.
- Design and support data pipelines and platforms for scalability, resilience, operational efficiency, and increasing data volumes.
- Implement data security standards including encryption and fine-grained access controls to support privacy compliance.
- Collaborate with product managers and software engineers to deliver cloud-first data solutions.
- Communicate technical concepts and data outcomes to internal and external stakeholders.
- Mentor members of the data community and participate in technology communities.
Requirements
- Bachelor's degree or higher in Computer Science or a related quantitative field such as Statistics, Economics, Operations Research, Analytics, Mathematics, or Engineering.
- At least 4 years of application development experience; internship experience does not apply.
- At least 2 years of experience in distributed data, SQL, a programming language, and data pipeline design and development.
- At least 1 year of experience in data modeling and end-to-end data solutions using relational and non-relational databases.
- Preferred: 7+ years of application development experience with Python, SQL, Scala, or Java.
- Preferred: 4+ years designing, deploying, and operating data workloads in AWS, Microsoft Azure, or Google Cloud.
- Preferred: 4+ years building or supporting distributed data or compute workloads using EMR, Spark, Glue, or Databricks.
- Preferred: 4+ years designing, implementing, and operating real-time or streaming data pipelines.
- Preferred: 2+ years with data observability or orchestration tools such as Monte Carlo, Splunk, Airflow, or Dagster.
- Preferred: 4+ years with unstructured or semistructured data and NoSQL databases such as MongoDB, Cassandra, or DynamoDB.
- Preferred: 4+ years designing and supporting data warehousing solutions such as Snowflake or Redshift.
- Preferred: 2+ years in an Agile development environment and 2+ years developing reusable user-centric data products.
Benefits
- Capital One offers health, financial, and other benefits supporting employee well-being, with eligibility varying by employment status and management level.
- The position is full-time and may be performed in listed locations including Cambridge, Massachusetts; McLean, Virginia; and Richmond, Virginia.
- The role is expected to accept applications for a minimum of 5 business days.
- Capital One provides reasonable workplace accommodations upon request.
Tech Stack
Categories
Data Engineering
About Capital One
Capital One is a U.S. consumer and commercial bank that offers credit cards, checking and savings accounts, auto financing, and lending to small and large businesses. It earns revenue from interest income and interchange/fees across its card and banking products, and develops cloud-based digital services. Founded in 1994, Capital One is publicly traded on the NYSE (COF) and is headquartered in McLean, Virginia.