Data Engineer 5
Capital One14 days ago
Cambridge, MA, USA +2 moreStaff+
Base Salary
$230k - $286k/yr
Responsibilities
- Design, build, test, implement, and support full-stack technical solutions and cloud data applications.
- Design and operate scalable, resilient, and efficient data pipelines and platforms.
- Architect and enforce reusable data engineering design patterns across data platforms and pipelines.
- Lead large-scale data initiatives and make independent architectural and platform decisions.
- Evaluate data platforms such as Snowflake and Databricks against technical and business requirements.
- Build and support distributed, real-time, streaming, relational, NoSQL, and data warehousing solutions.
- Communicate technical concepts and data outcomes to internal and external stakeholders.
- Mentor engineers and elevate the skills of peers and junior team members.
- Collaborate with product managers, software engineers, data analysts, and data scientists.
Requirements
- Bachelor’s degree or higher in Computer Science or a related quantitative field such as Statistics, Economics, Operations Research, Analytics, Mathematics, or Engineering.
- At least 6 years of application development experience; internship experience does not apply.
- At least 4 years of experience in distributed data, SQL, programming with Python, Java, or Scala, and designing and developing data pipelines.
- At least 2 years of experience in data modeling and end-to-end data solutions using relational and non-relational databases.
- Preferred: master’s degree in Computer Science or a related field.
- Preferred: 8+ years of data engineering experience and 5+ years designing, deploying, and operating AWS data workloads.
- Preferred: experience with EMR, Spark, Glue, Databricks, real-time or streaming pipelines, NoSQL databases, Snowflake or Redshift, and data modeling.
- Preferred: experience with Agile development, reusable data products, data observability, and data orchestration tools.
Benefits
- Capital One offers comprehensive health, financial, and other benefits supporting total well-being, with eligibility varying by employment status and management level.
- The role is eligible for performance-based incentive compensation, including cash bonuses and/or long-term incentives.
- The position is expected to accept applications for a minimum of 5 business days.
Tech Stack
Amazon DynamoDBAmazon RedshiftApache AirflowApache CassandraApache SparkAWSDatabricksJavaMongoDBPythonScalaSnowflakeSplunkSQL
Categories
Data Engineering
About Capital One
Capital One is a U.S. consumer and commercial bank that offers credit cards, checking and savings accounts, auto financing, and lending to small and large businesses. It earns revenue from interest income and interchange/fees across its card and banking products, and develops cloud-based digital services. Founded in 1994, Capital One is publicly traded on the NYSE (COF) and is headquartered in McLean, Virginia.