4 days ago
Irvine, CA, USAMid Level
H1B sponsor
Base Salary
$120 - $150/yr
Responsibilities
- Design and maintain reusable, metadata-driven data pipelines and configuration frameworks in Microsoft Fabric.
- Build and refactor Bronze, Silver, and Gold medallion architecture layers in Fabric Lakehouse/Warehouse environments.
- Develop parameterized Python and PySpark notebooks for scalable, parallel, restartable, incremental, and schema-aware processing.
- Implement data validation, quality checks, operational evidence, troubleshooting controls, and performance optimization across pipeline layers.
- Support Fabric-native services including Dataflows Gen2 and Fabric Data Factory, as well as migration from legacy ETL platforms.
- Document architecture, code, and runbooks and transfer operating knowledge to the existing data-engineering team.
- Collaborate with data, reporting, governance, and platform stakeholders to support trusted enterprise reporting.
Requirements
- At least 3 years of hands-on data-engineering experience building production ETL/ELT pipelines.
- Demonstrated experience designing metadata-driven, parameterized, and configuration-based data pipelines.
- Strong Python proficiency, including notebook-based processing with PySpark or an equivalent distributed-processing technology.
- Hands-on experience with Microsoft Fabric and/or Databricks, including notebooks, Lakehouse/Warehouse objects, and pipeline orchestration.
- Experience implementing Bronze/Silver/Gold medallion architecture, data validation, deduplication, and historization patterns.
- Working knowledge of SQL and relational data warehousing concepts.
- Experience with cloud-based analytics platforms, preferably Azure.
- Strong troubleshooting, technical documentation, and communication skills with technical and non-technical stakeholders.
- Preferred: experience migrating Azure Data Factory or similar legacy ETL pipelines into Fabric-native services.
- Preferred: familiarity with Power BI semantic models and downstream reporting consumption.
- Preferred: Microsoft Fabric certifications such as DP-600 or DP-700, equivalent Databricks certifications, or consulting/client-delivery experience.
Benefits
- Comprehensive medical, dental, and vision plans; retirement and savings programs including 401(k) matching, a 529 plan, and HSA; life insurance; and long-term disability coverage.
- Training and development programs, snacks and beverages at major offices, collaborative culture, work-life balance, and generous paid time off.
- The role is associated with Trace3 offices across the United States; no specific remote or hybrid arrangement is stated.
About Trace3
Trace3 is an IT solutions integrator and consulting firm that designs, implements, and operates data, security, and cloud infrastructure for enterprises. Its offerings span advisory services, systems integration, and managed operations across networking, storage, backup, and data platforms. Founded in 2002 and headquartered in Irvine, California, Trace3 is privately held and backed by American Securities.