11 months ago
Warsaw, PolandMid Level / Senior
Responsibilities
- Design and maintain data pipelines using ETL and/or ELT approaches.
- Choose between batch, micro-batch, and streaming architectures based on latency, correctness, and operational complexity.
- Build reliable data systems with clear raw, cleaned, and curated layers, including support for idempotency, backfills, late data, and corrected data.
- Develop readable, robust, tested backend software using sound software engineering practices.
- Participate in software architecture design, regular design sessions, code reviews, and collaborative team work.
- Contribute across product, internal platform, and client integration projects.
- Explore technologies outside the primary area of expertise and optionally travel to better understand project needs.
Requirements
- Strong software engineering background, including version control, readable code, testing, robust design, and basic data structures and algorithms.
- Experience designing and maintaining data pipelines with ETL and/or ELT approaches.
- Understanding of data pipeline reliability, layered data systems, and batch, micro-batch, and streaming trade-offs.
- Ability to conceive logical software architectures and communicate clearly verbally and in writing.
- Willingness to work across a wide range of problems and technologies and collaborate with people from other cultures.
- Working proficiency in spoken, written, and typed English at least at C1 level, including typing at least 45 words per minute.
- Development experience primarily on UNIX-based or OSX-Darwin platforms.
- Bonus experience with analytical data modeling, Python, Django, DBT, Dagster, Luigi, ClickHouse, Docker, Terraform, Kubernetes, Nix, data warehousing, OLAP, metadata management, dimensional modeling, or relational database theory.
- Interest in or knowledge of sustainable development goals, particularly public health, agriculture, and assisting developing countries.
Benefits
- Full-time hybrid work physically based in Warsaw, Poland, with at least two to three days per week in the office.
- Flexible working hours, including the ability to handle short personal errands during the day without approval.
- Significant ownership and opportunities to work on unusual, socially conscious projects.
- Encouragement to explore technologies beyond the employee's main expertise.
- Optional travel to learn more about the problems being addressed.
Tech Stack
Categories
BackendData Engineering
