Full-Stack Data Engineer
Marks & Spencer Group plc24 hours ago
Glasgow, United KingdomMid Level
Responsibilities
- Design and develop scalable on-premises and multi-cloud database solutions using Java, Spring Boot, Angular, and Python.
- Build high-performance, concurrent, asynchronous, multi-threaded, and multi-process Python solutions for large-scale data and metadata operations.
- Develop full-stack applications, including responsive user interfaces, APIs, backend services, database integrations, dashboards, workflow automation, and metadata-driven capabilities.
- Design and maintain secure database, ETL, ELT, data pipeline, data movement, backup and restore, schema management, and database access solutions.
- Implement Spark-based processing and streaming, replication, partitioning, clustering, change data capture, time travel, and pushdown optimization.
- Develop AI-enabled solutions for discovering, classifying, and protecting sensitive information in unstructured data.
- Build automation and tooling for data engineering and application development teams and contribute to modernization, standardization, observability, and cost-efficiency initiatives.
Requirements
- At least 4 years of relevant experience designing and implementing complex database, data, and full-stack application solutions.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- Strong expertise across database platforms such as PostgreSQL, DB2, SQL Server, Sybase, Snowflake, Azure SQL, MongoDB, Teradata, and Oracle.
- Hands-on experience with Java, Spring Boot, Python, APIs, and Angular for full-stack application development.
- At least 2 years of experience writing complex Python scripts, especially multi-threaded, multi-process, concurrent, and asynchronous solutions.
- Strong understanding of API design, microservices architecture, OAuth, service principals, token-based authentication, and secure application development.
- Experience building and optimizing data pipelines and data architectures; Talend, Kafka, and Informatica experience is preferred.
- Experience with Apache Spark is a plus, and experience with LLMs, retrieval-augmented generation, and agentic workflows is preferred.
- Expertise in performance optimization, scalability, troubleshooting, analytical problem-solving, and software design.
Benefits
- Hybrid work arrangement with flexible working opportunities.
- Employee benefits and perks supporting employees and their families throughout their work-life journey.
- Opportunities for career mobility across the business.
- Equal opportunity workplace with a strong commitment to diversity, inclusion, and professional development.
Tech Stack
AngularApache KafkaApache SparkIBM DB2InformaticaJavaMicrosoft SQL ServerMongoDBPostgreSQLPythonSnowflakeSpring BootTalend
Categories
Data EngineeringFull Stack
About Marks & Spencer Group plc
Marks & Spencer Group plc is a British retailer selling clothing, home goods, and food to consumers through stores and ecommerce, with a focus on own-brand products. The company is listed on the London Stock Exchange, was founded in 1884, and is headquartered in London. In the UK, its online grocery offering runs via Ocado Retail, a joint venture in which M&S holds a significant stake.