Senior Data Engineer
Tiger Analytics Inc.2 months ago
Remote, United States +2 moreSenior
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Synapse, and Azure Databricks.
- Architect and manage secure enterprise cloud storage using ADLS Gen2, Delta Lake, and relational or NoSQL databases.
- Ingest and process high-volume batch data and real-time streaming workloads.
- Optimize database queries, PySpark jobs, and data pipeline performance to reduce execution time and cloud costs.
- Model dimensional data marts using Star and Snowflake schemas for reporting.
- Implement data governance, automated data quality validation, and end-to-end lineage tracking with tools such as Microsoft Purview.
- Secure data pipelines and storage using Azure Role-Based Access Control, Key Vaults, and encryption standards.
- Automate infrastructure deployments and code releases using Azure DevOps and GitHub Actions.
- Collaborate with BI, analytics, data science, and AI teams to support analytics, machine learning, and Generative AI initiatives.
Requirements
- Experienced Data Engineer with expertise in designing and maintaining scalable data pipelines and infrastructure.
- Experience with Azure Data Factory, Azure Synapse, Azure Databricks, ADLS Gen2, Delta Lake, and PySpark.
- Experience processing batch and real-time streaming data workloads.
- Experience with dimensional data modeling, Star schemas, and Snowflake schemas.
- Knowledge of data governance, data quality validation, data lineage, and Microsoft Purview.
- Experience securing cloud data using Azure Role-Based Access Control, Key Vaults, and encryption standards.
- Experience automating deployments and releases with Azure DevOps and GitHub Actions.
- Ability to collaborate with data scientists, analysts, BI teams, and AI teams.
Benefits
- Remote workplace arrangement.
- Significant career development opportunities.
- Small, challenging, and entrepreneurial environment with a high degree of individual responsibility.
Tech Stack
Categories
Data Engineering
About Tiger Analytics Inc.
Tiger Analytics Inc. provides data and AI consulting services that deliver machine learning, analytics, and cloud data engineering solutions for large enterprises across industries, including life sciences. The company engages on strategy and implementation projects, from modern BI and data platforms to MLOps, helping Fortune 100 clients turn data into business outcomes. Founded in 2011 and headquartered in Santa Clara, it is privately held with operations across North America, Europe, and Asia-Pacific.