6 days ago
Sibiu, Romania +2 moreMid Level
Responsibilities
- Design and implement automated data quality controls within Microsoft Fabric.
- Translate governance and quality requirements into validation rules, monitoring checks, and quality gates.
- Build checks for data freshness, completeness, duplicates, schema changes, data volumes, key-field validity, and business rules.
- Develop centralized monitoring and logging for pipeline runs, source arrivals, row counts, errors, and quality results.
- Create alerting, operational views, reusable quality-gate patterns, quarantine and reprocessing actions, and escalation workflows.
- Support Microsoft Fabric pipelines, Dataflows Gen2, notebooks, and SQL/Python-based processes.
- Implement retries, incremental loads, backfills, error handling, and controlled reprocessing.
- Support ingestion from APIs, files, ADX/Kusto, databases, and other enterprise sources.
- Apply configuration-driven engineering, environment separation, Git, and deployment practices.
- Troubleshoot incidents, perform root cause analysis, and support controlled recovery.
- Document thresholds, dependencies, data contracts, runbooks, and recovery procedures.
- Collaborate with Data Governance, Data Architecture, Data Engineering, Semantic Model, and BI teams.
Requirements
- At least 3 years of professional experience in Data Engineering, DataOps, Data Quality Automation, Analytics Engineering, or a related back-end data role.
- Hands-on experience with Microsoft Fabric or Azure data platforms.
- Practical experience with Microsoft Fabric Pipelines, Dataflows Gen2, Lakehouse/Warehouse, notebooks, and SQL-based processing.
- Experience implementing automated data quality checks, monitoring, logging, alerting, or operational controls for production data pipelines.
- Strong SQL skills and working knowledge of Python and/or PySpark for validation, automation, and transformation.
- Experience supporting API, file, database, or enterprise-source ingestion.
- Understanding of error handling, incremental loads, retries, backfills, and controlled reprocessing.
- Strong troubleshooting and root cause analysis skills.
- Structured approach to documentation and operational procedures.
- Ability to collaborate across Governance, Architecture, Data Engineering, and BI teams.
- Good English communication skills.
- Preferred experience with ADX/Kusto integration, Power BI, Azure Data Factory, Azure Functions, Eventstream, CDC, or mirroring patterns.
- Preferred experience with dbt tests, Great Expectations, Soda, or similar data testing and observability tools.
- Preferred experience with Git, environment promotion, and automated deployment practices for data assets.
- Preferred knowledge of Microsoft Purview, lineage, metadata management, sensitivity labels, or enterprise governance tooling.
- Preferred experience in production reporting environments with strong operational and reliability requirements.
About NTT DATA
NTT DATA is a Tokyo‑headquartered, publicly traded IT services firm within the NTT Group. It provides consulting, application development, system integration, cloud and enterprise application services, and managed/outsourcing services for large enterprises and public-sector organizations. The company operates in more than 50 countries and is listed on the Tokyo Stock Exchange.