9 hours ago
Warsaw, PolandSenior
Responsibilities
- Own the Apache Airflow platform, including environments, deployments, upgrades, configuration, connections, variables, pools, DAG standards, reliability, monitoring, alerting, retries, and backfills.
- Lead the migration from Azure Data Factory to Airflow and evolve metadata-driven orchestration through DAG generation, reusable operators, dependency patterns, and scheduling patterns.
- Manage Azure resources with Terraform, including Databricks workspaces, Data Lake Storage, Data Factory, Key Vault, networking, and supporting services.
- Own secrets, identity, access management, Azure RBAC, Entra ID groups, Unity Catalog grants, least-privilege controls, access requests, and periodic access reviews.
- Own Azure DevOps repositories, pipelines, branch policies, multi-environment promotion, deployment validation, and Terraform state.
- Drive Azure cost and governance practices including tagging, budgets, right-sizing, cost attribution, and query tagging.
- Operate and improve the Databricks platform, including Unity Catalog, cluster and job policies, Auto Loader ingestion patterns, and workload performance and cost optimization.
- Contribute to data catalog, data quality, lineage, observability, debugging, alerting, and clear failure ownership across the platform.
- Participate in architecture and design reviews, communicate trade-offs, define engineering standards, and collaborate with architects, product owners, and data engineers.
- Build and maintain developer tooling and automation, including AI-assisted engineering workflows.
- Provide second-line support for complex production issues, lead incident troubleshooting, root cause analysis, post-mortems, handover, documentation, runbooks, and operational readiness.
Requirements
- Hands-on experience with data platform engineering and Azure-based Lakehouse foundations.
- Experience owning Apache Airflow platforms and working with Azure Data Factory migration or orchestration patterns.
- Experience managing Azure resources, identity and access, networking, storage, Key Vault, Azure RBAC, Entra ID, and managed identities.
- Experience with Terraform, Azure DevOps, Databricks, Unity Catalog, Data Lake Storage, and platform governance.
- Ability to design reliable, observable, debuggable, and cost-efficient data platforms.
- Experience with architecture reviews, technical decision-making, engineering standards, code reviews, and design reviews.
- Experience troubleshooting production incidents, leading root cause analysis, and improving operational processes.
About MARGO
Founded in 2019 and headquartered in Lancaster, Pennsylvania, MARGO operates a network of Bitcoin ATMs that let consumers convert cash to digital currencies. The company also runs a private client desk for high‑volume trading in assets like Bitcoin and Ethereum. Its business model centers on transaction fees from ATM usage and over‑the‑counter trades.