Data Engineer – Unified Data Layer (UDL) (f/m/div.)
Bosch Global7 hours ago
Braga, PortugalMid Level
Responsibilities
- Develop, automate, monitor, and maintain resilient data pipelines connecting laboratory equipment, test benches, and edge systems to Microsoft Azure.
- Investigate, parse, and normalize proprietary, undocumented, binary, scientific, sensor, telemetry, and operational data formats.
- Clean, validate, transform, and optimize raw data into partitioned Delta Lake and Parquet tables for analytics and ML model training.
- Deploy and maintain Azure pipeline resources using Terraform, Databricks, and containerized workflows.
- Collaborate with experimental scientists, lab engineers, technicians, solution architects, and senior engineers to clarify data semantics and implement ingestion, cataloguing, and governance standards.
- Document technical solutions and support proof-of-concept work involving metadata integration, AI assistants, data discovery catalogs, and modern data tools.
Requirements
- Bachelor’s, master’s, or Ph.D. degree in Data Engineering, Computer Science, Software Engineering, Applied Physics, Electrical Engineering, or a related field.
- At least 3 years of professional data engineering experience building automated and reliable data pipelines.
- 1–2 years of practical experience handling heterogeneous, non-standard, binary, laboratory, sensor, hardware telemetry, or raw byte-stream data sources.
- At least 1 year of hands-on Apache Spark, preferably Databricks, and Microsoft Azure experience in production environments.
- Experience deciphering, parsing, or converting non-standard, legacy, or custom data formats into structured data.
- Strong Python and Bash skills, including binary data handling with tools such as struct, NumPy, Pandas, and PySpark.
- Understanding of Lakehouse concepts, Delta Lake, distributed data processing, SQL, and NoSQL or document datastores.
- Proficiency with Git and GNU/Linux, plus working knowledge of Terraform and Infrastructure as Code.
- Experience with transport mechanisms such as REST APIs, SFTP, Kafka, Event Hubs, or IoT and streaming protocols.
- Strong analytical problem-solving and cross-functional communication skills, with the ability to work across laboratory, scientific, and software teams.
- C2 CEFR English proficiency is stated in the mindset requirements, while the languages section specifies B2 English; fluent Portuguese is required and B2 German is a plus.
- Preferred experience includes HDF5, NetCDF, Parquet, Protobuf, industrial telemetry, time-series historian protocols, OPC UA, MQTT, Azure Data Factory, Azure Event Hubs, Azure Data Explorer, and vectorial databases.
Benefits
- International environment and career opportunities at Bosch.
- Flexible hours.
- Medical services, employee discounts, sports and health activities.
- Canteen and good access to public transportation.
- Space for creativity.
Tech Stack
Categories
Data Engineering
About Bosch Global
Bosch Global (Robert Bosch GmbH) develops and sells mobility components and software, industrial automation and sensors, home appliances and power tools, and energy and building technologies to automakers, manufacturers, builders, and consumers. It monetizes through product sales and connected services spanning IoT, AI, and embedded software. Founded in 1886 and headquartered in Gerlingen-Schillerhöhe, Germany, the privately held Bosch Group operates worldwide across Mobility, Industrial Technology, Consumer Goods, and Energy and Building Technology sectors.