Full-Stack Data Engineer
Marks & Spencer Group plc29 days ago
Glasgow, United KingdomMid Level
Responsibilities
- Design and develop resilient on-premises and multi-cloud database solutions using Java, Spring Boot, Angular, and Python.
- Build high-performance concurrent and asynchronous Python solutions using threading, multiprocessing, and robust resource and error management.
- Deliver secure database, ETL, full-stack application, REST API, backend service, and integration capabilities.
- Build self-service tools, operational dashboards, workflow automation, metadata-driven solutions, and microservices.
- Develop AI-driven solutions for sensitive-information discovery, classification, protection, and automated data masking.
- Create tooling and automation for data engineering and application development teams.
- Design and optimize data pipelines and ETL/ELT processes using pushdown optimization, Spark processing, streaming, replication, partitioning, clustering, change data capture, and time travel.
- Develop database backup and restore, DDL, access management, schema/object-level data movement, modernization, observability, and cost-efficiency solutions.
Requirements
- At least 4 years of relevant experience is generally expected.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- Proven experience designing complex database and data solutions alongside full-stack application development.
- Strong database and data-engineering experience across platforms including PostgreSQL, DB2, SQL Server, Sybase, Snowflake, Azure SQL, MongoDB, Teradata, and Oracle.
- Hands-on experience with Java/Spring Boot, Python, REST APIs, and Angular for full-stack development.
- Understanding of API design, microservices architecture, OAuth, service principals, token-based authentication, and secure application development.
- At least 2 years of experience writing complex Python scripts, particularly multithreaded, multiprocess, concurrent, and asynchronous solutions.
- Experience with Apache Spark for Python is a plus.
- Experience designing AI-powered solutions using LLMs, retrieval-augmented generation, and agentic workflows is preferred.
- Extensive data-pipeline and data-architecture experience, preferably with Talend, Kafka, and/or Informatica.
- Expertise in performance optimization, scalability, troubleshooting, analytical problem-solving, and software design.
Benefits
- Hybrid and flexible working arrangements are available.
- Morgan Stanley offers employee and family benefits and perks, with opportunities for career mobility and development.
Tech Stack
AngularApache KafkaApache SparkIBM DB2InformaticaJavaMicrosoft SQL ServerMongoDBPostgreSQLPythonSnowflakeSpring BootTalend
Categories
Data EngineeringFull Stack
About Marks & Spencer Group plc
Marks & Spencer Group plc is a British retailer selling clothing, home goods, and food to consumers through stores and ecommerce, with a focus on own-brand products. The company is listed on the London Stock Exchange, was founded in 1884, and is headquartered in London. In the UK, its online grocery offering runs via Ocado Retail, a joint venture in which M&S holds a significant stake.