Data Engineer II
American Express21 hours ago
Gurgaon, IndiaMid Level
Responsibilities
- Evaluate data requirements and document them for integration into existing architectures.
- Maintain data models to support business needs.
- Build and enhance scalable, performant, and secure data pipelines and database designs.
- Work hands-on with GCP technologies, including BigQuery and Dataproc.
- Use SQL and data evaluation tools to analyze and support data systems.
- Collaborate on design reviews and testing and provide production environment support.
- Implement partitioning and indexing solutions for Big Data, Spark, and other distributed frameworks.
- Communicate with product and business teams to facilitate changes and technology implementations.
- Perform performance tuning for large-scale batch and real-time data processing.
- Support database development for online transaction processing and online analytical processing systems.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or comparable experience.
- At least 4 years of development experience in data engineering.
- Knowledge of Big Data, NoSQL design and development, database management systems, distributed systems, algorithms, and relational and non-relational databases.
- Experience with SQL and Python, or another programming language such as Java.
- Experience designing and developing with database management systems such as HBase, Hive, GCP tools, NoSQL databases, Bigtable, BigQuery, or Cloud Spanner.
- Experience with NoSQL databases such as HBase and Bigtable.
- Experience tuning performance in the Big Data space and in large-scale batch and real-time processing.
- Experience with distributed systems, algorithms, application development, and database support for transactional or analytical processing.
- Advanced degree preferred.
- GCP certification is a preferred additional qualification.
- Experience with software delivery methodologies such as Agile, Scrum, Agile XP, or Test-Driven Development.
Benefits
- Competitive base salaries and bonus incentives.
- Financial well-being and retirement support.
- Medical, dental, vision, life insurance, and disability benefits, depending on location.
- Flexible hybrid, onsite, or virtual work arrangements depending on the role and business need.
- Paid parental leave, depending on location.
- Access to onsite wellness centers staffed with nurses and doctors, depending on location.
- Confidential counseling support through the Healthy Minds program.
- Career development and training opportunities.
Tech Stack
Categories
Data Engineering
About American Express
American Express builds a global payments network and issues consumer, small-business, and corporate cards, plus merchant acquiring and travel services. Revenue comes from card fees, interest and lending, discount/merchant fees, and network services. Founded in 1850 and headquartered in New York City, it operates the Amex acceptance network worldwide and offers co-branded cards and membership rewards across millions of cardmembers and merchants; ticker NYSE: AXP.