Data Engineer 5
Capital One8 days ago
Base Salary
$251k - $286k/yr
Responsibilities
- Design, build, test, implement, and support cloud-first data solutions and applications.
- Lead large-scale cross-cloud migration initiatives and centralize multi-cloud datasets in a data lake.
- Architect and operate scalable, resilient data pipelines and platforms for increasing data volume and business demand.
- Use Python, Spark, Databricks, Snowflake, relational databases, and NoSQL databases to develop distributed data solutions.
- Establish reusable data engineering design patterns that improve code quality, maintainability, and platform consistency.
- Make independent architectural and platform decisions, including evaluating Snowflake versus Databricks.
- Mentor junior engineers and elevate the capabilities of data engineering peers and the broader data community.
- Collaborate with product managers, software engineers, developers, analysts, and data scientists.
- Communicate technical concepts and data outcomes clearly to internal and external stakeholders.
Requirements
- Bachelor’s degree or higher in Computer Science or a related quantitative field such as Statistics, Economics, Operations Research, Analytics, Mathematics, or Engineering.
- At least 6 years of application development experience; internship experience does not apply.
- At least 4 years of experience in distributed data, SQL, programming, and data pipeline design and development.
- At least 2 years of experience in data modeling and end-to-end data solutions using relational and non-relational databases.
- Preferred: master’s degree in Computer Science or a related field.
- Preferred: 8+ years of data engineering experience and 9+ years of application development experience.
- Preferred: 5+ years designing, deploying, and operating data workloads in AWS, Microsoft Azure, or Google Cloud.
- Preferred: experience with EMR, Spark, Glue, Databricks, streaming pipelines, data observability, orchestration, NoSQL, data warehousing, Agile development, and reusable data products.
- Preferred: experience with Monte Carlo, Splunk, Airflow, Dagster, MongoDB, Cassandra, DynamoDB, Snowflake, and Redshift.
Benefits
- Comprehensive health, financial, and other benefits supporting employee well-being, with eligibility varying by employment and management status.
- The role is eligible for performance-based incentive compensation, including cash bonuses and/or long-term incentives.
- The position is expected to accept applications for a minimum of 5 business days.
Tech Stack
Categories
Data Engineering
About Capital One
Capital One is a U.S. consumer and commercial bank that offers credit cards, checking and savings accounts, auto financing, and lending to small and large businesses. It earns revenue from interest income and interchange/fees across its card and banking products, and develops cloud-based digital services. Founded in 1994, Capital One is publicly traded on the NYSE (COF) and is headquartered in McLean, Virginia.