27 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and test scalable ETL processes that move data from databases, APIs, and flat files into the data warehouse.
- Implement complex data transformations and business logic to cleanse, standardize, and enrich data.
- Own the end-to-end data pipeline lifecycle, including monitoring, troubleshooting, optimization, and reliability.
- Document ETL processes, data source mappings, transformation rules, and data lineage.
- Collaborate with Data Modelers, Data Architects, and source system owners to align integrations with data structures and extraction requirements.
- Implement data quality checks and validation steps to ensure data accuracy and integrity.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, a science discipline, or a similar field.
- At least 6 years of dedicated experience as an ETL Developer or Engineer.
- At least 4 years of intensive development experience with a major ETL tool such as AWS Glue, Informatica, DataStage, or Fivetran.
- At least 4 years of experience writing complex SQL for data-intensive applications.
- Hands-on experience with enterprise ETL tools including AWS Glue, AWS S3, Informatica, HVR, or Fivetran.
- Advanced SQL skills, including complex queries, stored procedures, and functions.
- Strong scripting skills in Python, Perl, or Shell scripting.
- Experience building and maintaining ETL solutions in data warehousing environments.
- Understanding of database fundamentals and experience with relational databases, NoSQL, APIs, and SFTPs.
- Experience performance tuning and optimizing long-running ETL jobs.
- At least 1 year of experience with Snowflake and its data loading features, including Snowpipe and the COPY command.
- Experience with cloud-native ETL/ELT services such as AWS Glue, Azure Data Factory, or Google Dataflow is preferred.
- Familiarity with Change Data Capture techniques and tools is preferred.
- Exposure to Spark or Hadoop is preferred.
- Basic understanding of data modeling concepts such as star schema and snowflake schema is preferred.
- Strong troubleshooting, problem-solving, independent work, and project management abilities.
Benefits
- Bangalore work location with a hybrid work arrangement.
- No travel required.
Tech Stack
Categories
Data Engineering