Data Platform Engineer
Greystar Real Estate Services, LLC16 days ago
Remote, United StatesSenior
Base Salary
$125k - $150k/yr
Responsibilities
- Administer Databricks workspaces, including upgrades, cluster policies, compute configuration, Delta table lifecycle management, and Unity Catalog governance.
- Operate and support Azure data services and related platforms, including ADLS Gen2, Azure Data Factory, Azure Monitor, Log Analytics, Key Vault, Event Hub, Synapse Analytics, Cosmos DB, and Azure SQL Server.
- Tune Spark and Delta Lake workloads for performance, reliability, storage efficiency, and compute cost.
- Define and enforce platform standards for naming, schema evolution, partitioning, Z-ordering, medallion architecture, SLAs, data contracts, and environment parity.
- Manage Azure identity and access, including service principals, RBAC assignments, Unity Catalog permissions, secret rotation, and resource provisioning.
- Build and maintain CI/CD workflows and deployment pipelines for data workflows across development, staging, and production environments.
- Maintain Terraform and other infrastructure-as-code configurations for Databricks workspaces, Azure resources, Unity Catalog, and environment-specific infrastructure.
- Build AI-powered observability and self-healing capabilities for pipeline drift, anomaly detection, SLA risk, automated incident summaries, retries, circuit breakers, and remediation.
- Design and maintain disaster recovery and business continuity strategies, including backups, geo-redundancy, workspace recovery, RTO/RPO targets, and failover testing.
- Create runbooks, deployment playbooks, architecture decision records, incident post-mortems, and platform documentation.
- Participate in on-call coverage, SLA support, ticket queue management, sprint and release tracking, and cross-functional platform planning.
Requirements
- At least 5 years of platform engineering, infrastructure engineering, or production data operations experience.
- Expert Databricks administration experience with Unity Catalog, workspace management, cluster policies, compute configuration, and Delta Lake internals.
- Strong experience with Azure data services, including ADLS Gen2, Azure Data Factory, Azure Monitor, Log Analytics, Key Vault, Cost Management, and Event Hub.
- Experience with Azure Active Directory, service principals, RBAC, and Unity Catalog governance policies.
- Hands-on experience designing and orchestrating Azure Data Factory pipelines at scale.
- Experience tuning Spark workloads through partitioning, Z-ordering, bottleneck profiling, and compute optimization.
- Proven CI/CD and release management experience with GitHub Enterprise and Azure DevOps Pipelines.
- Programming or automation experience with Python and/or SQL.
- Knowledge of medallion and lakehouse architecture patterns and multi-environment deployment practices.
- Terraform and infrastructure-as-code experience for Databricks, Azure resources, Unity Catalog, and environment-specific infrastructure.
- Experience with Azure networking, including VNets, private endpoints, NSG rules, firewall policies, and DNS resolution.
- Experience authoring KQL queries, configuring Azure Monitor alerts and diagnostics, creating workbooks, and monitoring cluster events.
- Knowledge of Delta Lake lifecycle operations, including VACUUM, OPTIMIZE, ZORDER, time travel, table statistics, and transaction logs.
- Preferred experience with Synapse Analytics, Cosmos DB, Azure SQL Server, Databricks Mosaic AI, Genie, data lineage, metadata management, or Unity Catalog governance.
- Preferred experience with Yardi, Entrata, or RealPage integrations, legacy BI migrations, platform modernization, and Linear.
- Experience managing on-call responsibilities, ServiceNow or Asana ticket queues, Linear or DevOps work items, runbooks, and post-incident documentation.
Benefits
- Remote work is available anywhere in the United States except Alaska.
- Competitive compensation, comprehensive medical, dental, vision, disability, and life insurance benefits are offered.
- Full-time employees receive paid time off, including vacation, personal days, sick days, paid holidays, and a birthday day off after one year.
- Onsite team members may receive housing discounts at Greystar-managed communities, subject to availability.
- Employees are eligible for a paid six-week sabbatical after 10 years of service and every five years thereafter.
- A 401(k) plan offers a company match of up to 6% of pay after six months of service.
- Paid parental leave and lifetime fertility benefit reimbursement of up to $10,000 are available.
- Additional benefits include an Employee Assistance Program, critical illness, accident, hospital indemnity, pet insurance, legal plans, and charitable giving benefits.
About Greystar Real Estate Services, LLC
Greystar Real Estate Services is a privately held global real estate firm focused on institutional‑quality rental housing, providing property management, investment management, development, and construction services for owners and investors. Founded in 1993 and headquartered in Charleston, South Carolina, it manages and operates over $350 billion of real estate across 260+ markets and is the largest apartment operator in the United States, overseeing more than one million units/beds worldwide.