Data Platform Engineer
Camlin Group12 days ago
Belgrade, SerbiaMid Level
Responsibilities
- Design, implement, support, and continuously improve scalable data platform solutions and pipelines on AWS.
- Develop and optimize large-scale data processing workloads using Apache Spark and Databricks.
- Build and maintain streaming data solutions using Apache Kafka and Amazon MSK.
- Manage cloud infrastructure with an Infrastructure as Code approach using automation and repeatability.
- Develop and maintain CI/CD pipelines for reliable deployment of platform components and data workloads.
- Implement identity and access management controls and other security best practices.
- Design and support disaster recovery, backup, high availability, and business continuity strategies.
- Monitor platform health, performance, and reliability while improving scalability, observability, and operational excellence.
- Select and standardize Big Data technologies, develop reusable framework components, and mentor software and data engineers.
Requirements
- At least 3 years of experience in data engineering or data platform engineering roles.
- Strong knowledge of Apache Spark and experience with Databricks for large-scale data processing and analytics.
- Good knowledge of AWS services including S3, AWS IAM, EC2, RDS, and MSK.
- Strong understanding of Apache Kafka, including its concepts, architecture, and operations.
- Experience designing and supporting event-driven and streaming data solutions.
- Proficiency in Terraform and a strong Infrastructure as Code-first approach.
- Experience developing and maintaining CI/CD pipelines using modern DevOps tools and practices.
- Solid proficiency in Python for automation, platform engineering, and data processing.
- Understanding of cloud architecture, security, disaster recovery, backup strategies, high availability, and business continuity planning.
- Fluency in written and verbal English.
- A bachelor's degree in computer software engineering or equivalent is desirable.
- Desirable qualifications include SaaS application development, secure software development, Datadog, and operating production data platforms.
Tech Stack
Categories
Data EngineeringDevOps
About Camlin Group
Camlin Group builds monitoring and analytics systems for electricity grids and rail infrastructure, combining sensors, embedded devices, and software to improve asset performance and reliability. It sells hardware, software, and support services under brands such as Camlin Energy and Camlin Rail to utilities and rail operators. The company is privately held and headquartered in Lisburn, Northern Ireland.