Senior Data Engineer
Codest Ltd.30 days ago
Remote, PolandSenior
Responsibilities
- Design and implement data processing pipelines based on business and technical requirements.
- Build and maintain integrations between APIs, SQL databases, S3 buckets, SFTP servers, and other data sources and destinations.
- Develop and modify ETL workflows and data flows.
- Process and synchronize data across multiple systems and formats.
- Conduct testing and validation to ensure data accuracy, integrity, and reliable delivery.
- Provide post-deployment support and troubleshoot data integration issues.
- Collaborate with business stakeholders to gather requirements and support production processes.
Requirements
- Advanced spoken and written English for international collaboration.
- At least five years of hands-on professional experience with ETL tools and data engineering processes.
- Strong SQL skills and experience with databases and data integration workflows.
- Commercial experience using Python for data processing and scripting.
- Experience designing, developing, and maintaining data pipelines across multiple sources and destinations.
- Ability to understand complex data flows, coding structures, and logical workflows.
- Experience collaborating with developers and business stakeholders in an international environment.
- Strong attention to detail, data accuracy, reliability, and stakeholder communication skills.
- Experience with Apache NiFi is preferred.
- Familiarity with Databricks, particularly for implementing new data integrations, is preferred.
- Experience with cloud-based data storage and services, including AWS S3, is preferred.
About Codest Ltd.
Codest Ltd. is an IT services and consulting firm that supplies senior software developers and product teams to fintech, digital banking, and scaling tech companies, via staff augmentation and end-to-end project delivery. Founded in 2009 and privately held, it is headquartered in London with delivery hubs in Poland. The company’s track record includes building its own product, Yieldbird, recognized in Deloitte growth rankings.