Senior Software Engineer - Data Pipeline
Bloomreach
7 months ago
Prague, Czechia
Senior
H1B Sponsor
Responsibilities
- Develop a data pipeline for processing large amounts of data reliably and at high rates.
- Improve the efficiency of data processing and monitoring.
- Enhance the throughput and reliability of data imports.
- Export data to Google BigQuery using DataFlows and PySpark.
- Support services in production handling high-volume traffic.
- Participate in code reviews to maintain high code quality standards.
- Engage in on-call rotation to ensure service uptime.
Requirements
- Experience with Python and solid engineering practices.
- Experience with Go is a significant advantage.
- Familiarity with ETL pipelines and data ingestion at scale.
- Ability to thrive in a remote-first work environment.
- Willingness to learn and adapt to new technologies.
Benefits
- Flexible working hours to accommodate personal styles.
- Opportunities for personal development through workshops and education budgets.
- Employee Assistance Program for non-work-related challenges.
- Subscription to Calm for sleep and meditation support.
- Paid volunteering days to engage in community service.
Tech Stack
Apache BeamApache FlinkApache KafkaGoGoogle BigQueryGoogle Cloud PlatformKubernetesMongoDBPythonRedis
Categories
AI & MLData Engineering