18 hours ago
Remote, Peru +3 moreSenior
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines integrating data from multiple sources into AWS, Snowflake, and Salesforce.
- Build and optimize hourly and daily incremental batch data pipelines across large-scale datasets.
- Develop and maintain workflow orchestration processes using Airflow or similar tools.
- Design scalable analytical data models and optimize query performance.
- Implement automated data quality validation, monitoring, alerting, and pipeline testing.
- Improve pipeline reliability, performance, and maintainability through automation, version control, and CI/CD.
- Integrate SaaS platforms and APIs while managing incremental loads, rate limits, schema changes, and data synchronization.
- Use AI-powered development tools such as Cursor and Claude for coding, debugging, and documentation.
- Collaborate with cross-functional teams to deliver reliable and scalable data solutions.
Requirements
- Bachelor's degree and 5+ years of related experience, or a Master's degree and 3+ years of experience.
- Extensive experience with relational, SQL, and NoSQL databases.
- Strong SQL skills and proficiency in Python, Java, or Scala.
- Hands-on experience with Snowflake and AWS cloud data platforms.
- Experience with workflow orchestration and pipeline tools such as Airflow.
- Strong understanding of data pipelines, performance tuning, large-scale distributed processing, and scalable analytical data modeling.
- Experience handling large-scale batch workloads involving tens of millions of rows and hundreds of gigabytes to low terabytes of data.
- Experience implementing ETL/ELT pipelines and integrating multi-source data into AWS, Snowflake, and Salesforce.
- Experience with data quality, reliability, monitoring, alerting, query optimization, and engineering best practices.
- Experience using AI-powered development tools such as Cursor and Claude.
- Preferred: Salesforce-to-Snowflake extraction at scale, SaaS API integrations, Kafka or similar streaming technologies, dbt, data catalogs, data observability tools, ML pipelines, feature stores, marketplace/search/advertising/recommendation systems, Terraform, or Kubernetes.
Benefits
- Remote work arrangement.
- Role available to candidates located in Costa Rica, Peru, Colombia, or Bolivia.
Tech Stack
Categories
Data Engineering
About Encora
Encora provides software and digital product engineering services for technology companies and enterprises, including cloud-native development, data engineering, and QA. It operates a global delivery model and supports outsourced product development and managed engineering teams. Headquartered in Santa Clara, California, Encora is privately held and was acquired by Coforge; it previously raised $200 million in private equity funding in 2019.
