2 months ago
Newcastle, United KingdomMid Level
Responsibilities
- Build, optimize, and maintain scalable data pipelines primarily with Java and support real-time streaming and event-driven integrations.
- Integrate streaming, batch, and API data sources using AWS managed services including Kinesis, MSK, Lambda, and Glue.
- Contribute to data modeling, architecture standards, medallion architecture, data quality, lineage, governance, and security controls.
- Deploy and maintain data applications using Azure DevOps, GitHub Actions, Jenkins, Terraform, CloudFormation, Docker, and Kubernetes-based workloads.
- Collaborate with analytics, ML/AI, product, client, and internal teams to deliver reliable, well-structured datasets.
- Participate in code reviews and knowledge-sharing sessions and provide guidance to junior engineers.
Requirements
- At least 3 years of experience working in data engineering or on large-scale data solutions.
- Strong programming proficiency in Java or Python and hands-on experience with Kafka, Flink, or Spark.
- Knowledge of stream processing concepts including event time, state, and backpressure.
- Experience building ETL/ELT or streaming data pipelines and understanding distributed compute, large-scale data systems, and performance considerations.
- Understanding of software engineering practices, testing, design patterns, CI/CD, Git, microservices, and distributed systems.
- Experience with cloud platforms, ideally AWS, with Azure or GCP also acceptable.
- Experience with CI/CD tools, Infrastructure as Code, containerization, and orchestration platforms such as Docker and Kubernetes/EKS.
- Exposure to enterprise data platforms such as Databricks, Snowflake, or BigQuery.
- Cloud or data engineering certifications, client-facing or consulting experience, mentoring experience, and real-time low-latency systems experience are desirable.
- Ability to collaborate with technical and non-technical stakeholders and work in Agile delivery teams.
Benefits
- Hybrid working requires 3 days per week at the Newcastle, Cobalt business park office.
- Employment is subject to satisfactory BPSS and SC security clearance, requiring 5 years of continuous UK address history and the stated passport or Indefinite Leave to Remain eligibility.
- The role offers hands-on experience with modern data technologies, large-scale data solutions, learning, and career progression within a global expert network.
Tech Stack
Apache FlinkApache KafkaApache SparkAWSAzureDatabricksDockerGitGitHub ActionsGoogle BigQueryGoogle Cloud PlatformJavaJenkinsKubernetesPythonSnowflakeTerraform
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.