over 1 year ago
Remote, PolandMid Level
Responsibilities
- Develop and maintain scalable, high-performance data processing platforms for automotive and other enterprise datasets.
- Design and implement data pipelines supporting both streaming and batch processing.
- Optimize data ingestion, processing, storage, and workflows using Spark, Cloudera, Airflow, and Iceberg.
- Manage structured and unstructured data with data lake technologies.
- Collaborate with cross-functional teams and clients to understand data requirements and integrate data sources.
- Monitor and troubleshoot platforms to maintain availability, performance, scalability, and data accuracy.
- Use AWS and other cloud services to manage infrastructure and scale processing workloads.
- Write and maintain clean, high-quality Python, Java, or Scala code for data processing and automation.
Requirements
- At least 4 years of commercial experience implementing, developing, or maintaining Big Data systems, data governance, and data management processes.
- Strong programming skills in Python, Java, or Scala, including clean code and object-oriented design.
- Hands-on experience with Spark, Cloudera, Kafka, data platforms, Airflow, NiFi, Docker, and Iceberg.
- Strong understanding of dimensional data and data modeling techniques.
- Experience implementing and deploying solutions in cloud environments.
- Consulting experience with strong communication and client management skills, including direct client interaction.
- Ability to work independently and take ownership of project deliverables.
- Fluent English at least at C1 level.
- Bachelor’s degree in technical or mathematical studies.
- Experience with Kubeflow or MLflow is preferred.
- Familiarity with Databricks and/or dbt is preferred.
Benefits
- Supportive team focused on AI and Big Data.
- International projects with global enterprises and startups.
- Flexible work arrangements with remote work or access to offices and coworking spaces.
- Career development paths, knowledge sharing, language classes, sponsored training, and conferences.
- Access to Databricks and Anthropic training materials and certification programs.
- Team-building events and an integration budget.
- Medical and sports packages, eye care, psychotherapy, coaching, and other well-being support.
- Full work equipment, including a laptop and other necessary devices.
- Opportunities to build a personal brand through conferences, blog writing, and meetups.
- Dedicated onboarding buddy and a supportive, friendly, autonomous culture.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureDatabricksdbtDockerGoogle BigQueryJavaMLflowPythonScala
Categories
Data Engineering
About Addepto
Addepto provides AI consulting and data engineering services for enterprises, covering machine learning, generative AI, MLOps, NLP, and computer vision, and also develops ContextClue, an AI-driven knowledge management platform for industrial engineering. Founded in 2018 and headquartered in Warsaw, it operates as a privately held company within KMS Technology. The firm engages across sectors such as manufacturing, finance, e-commerce, and real estate to move AI initiatives from discovery to production.