Data Engineer 4 (Python, PySpark, AWS)
Capital One2 months ago
McLean, VA, USAStaff+
Base Salary
$197k - $225k/yr
Responsibilities
- Design, build, test, implement, and support cloud-first data solutions and applications.
- Design and operate scalable, resilient data pipelines and platforms for increasing data volume and business demands.
- Architect and enforce reusable data engineering design patterns across data platforms and pipelines.
- Develop data solutions using Python, Spark, relational and NoSQL databases, Databricks, and Snowflake.
- Implement data security standards including encryption at rest and in transit and fine-grained access controls.
- Collaborate with developers, data analysts, data scientists, product managers, and software engineers.
- Communicate technical concepts and data outcomes to internal and external stakeholders.
- Mentor data community members and influence teams working with distributed systems, machine learning, lakehouse architecture, and full-stack systems.
Requirements
- Bachelor's degree or higher in Computer Science or a related quantitative field.
- At least 4 years of application development experience; internship experience does not apply.
- At least 2 years of experience in distributed data, SQL, a programming language, and data pipeline design and development.
- At least 1 year of experience in data modeling and end-to-end data solutions using relational and non-relational databases.
- Preferred: 7+ years of application development experience with Python, SQL, Scala, or Java.
- Preferred: 4+ years designing, deploying, and operating workloads in AWS, Microsoft Azure, or Google Cloud.
- Preferred: 4+ years building distributed data or compute workloads with EMR, Spark, Glue, or Databricks.
- Preferred: experience with streaming pipelines, data observability, orchestration, NoSQL databases, data warehousing, Agile development, and reusable data products.
Benefits
- Comprehensive health, financial, and other benefits supporting employee well-being, with eligibility varying by employment and management status.
- Full-time annual salary range of $197,300-$225,100 for the McLean, Virginia location.
- Eligible for performance-based incentive compensation, including cash bonuses and/or long-term incentives.
- Applications are expected to remain open for a minimum of 5 business days.
Tech Stack
Categories
Data Engineering
About Capital One
Capital One is a U.S. consumer and commercial bank that offers credit cards, checking and savings accounts, auto financing, and lending to small and large businesses. It earns revenue from interest income and interchange/fees across its card and banking products, and develops cloud-based digital services. Founded in 1994, Capital One is publicly traded on the NYSE (COF) and is headquartered in McLean, Virginia.