Data Engineer
Sigma Software1 month ago
Remote, EMEAMid Level
Responsibilities
- Design and develop scalable data platforms and data pipelines for analytical and operational use cases.
- Implement distributed data processing workflows using Apache Spark, PySpark, and Databricks.
- Contribute to the Azure cloud data platform using Azure Data Factory, Synapse, Microsoft Fabric, Databricks, Event Hub, and Azure Data Lake Storage.
- Design data models, ETL/ELT workflows, data lake architectures, and production-scale analytical systems.
- Integrate data from internal and external sources while maintaining consistency, quality, and reliability.
- Own pipeline monitoring, reliability, performance, scalability, and maintainability.
- Collaborate with data analysts, data scientists, and engineering teams to build data solutions.
- Improve data engineering standards, testing approaches, and operational reliability.
- Evaluate and introduce tools and technologies within the data engineering ecosystem.
Requirements
- At least 4 years of hands-on experience in data engineering or building data processing platforms.
- Strong SQL skills and solid Python experience for building and maintaining data pipelines.
- Experience with distributed data processing frameworks such as Apache Spark and PySpark; Databricks experience is advantageous.
- Practical experience designing and implementing cloud-based data pipelines, preferably in Azure.
- Experience designing production-scale data pipelines and data models for analytical systems.
- Understanding of ETL/ELT design, dimensional modeling, data warehousing, modern data lake architectures, Parquet, and JSON.
- Experience with workflow orchestration tools such as Airflow and with database development and performance optimization.
- Ability to design scalable, maintainable data solutions with minimal supervision.
- Strong collaboration and communication skills and professional working proficiency in English.
- Preferred experience with Snowflake, BigQuery, Redshift, Event Hub, Kafka, Spark Streaming, Delta Lake, CI/CD practices, Git-based development workflows, and agile development environments.
Tech Stack
Amazon RedshiftApache AirflowApache KafkaApache SparkAzureDatabricksGitGoogle BigQueryPythonSnowflakeSQL
Categories
Data Engineering
About Sigma Software
Sigma Software is a London-headquartered, privately held IT consultancy that designs and builds custom software for startups and enterprises. The company provides end-to-end services—engineering, web and mobile development, .NET/Java platforms, AR/VR, and UI/UX—delivered via outsourcing, managed teams, and consulting. Founded in 2002, it supports long-term product development and modernization projects across multiple industries for global clients.