Databricks Platform & Database Engineer
CoStar GroupBase Salary
$136k - $177k/yr
Responsibilities
- Deploy, administer, configure, secure, upgrade, migrate, and maintain Databricks workspaces on AWS across development, staging, and production environments.
- Manage Unity Catalog, workspace identities and permissions, enterprise identity-provider integrations, cluster policies, SQL warehouse governance, audit logs, lineage, and compliance reporting.
- Monitor and optimize Databricks clusters, SQL warehouses, jobs, Spark execution, and platform costs.
- Design and operate ingestion and end-to-end data workflows distributing curated data to SQL Server, DynamoDB, S3, and other enterprise consumers.
- Administer SQL Server, Aurora, PostgreSQL, MySQL, DynamoDB, and other relational and non-relational databases across AWS and on-premises data centers.
- Manage database provisioning, patching, backups, replication, failover, version upgrades, cross-platform migrations, encryption, access control, and auditing.
- Develop Terraform infrastructure-as-code for Databricks workspaces, AWS RDS, Aurora, and supporting resources.
- Automate cluster lifecycle, database provisioning, job scheduling, backup management, and other operational tasks across cloud and on-premises environments.
- Build and maintain CI/CD workflows, monitoring, alerting, operational runbooks, and platform configuration and pipeline code.
- Support SLA-driven 24/7 production environments, lead root-cause analysis, troubleshoot incidents, and partner with data scientists, business analysts, DBAs, and DevOps engineers.
Requirements
- Bachelor’s degree from an accredited, not-for-profit, in-person university or college.
- At least 5 years of experience in database engineering or data platform roles spanning relational and non-relational database administration and Databricks platform ownership.
- Hands-on experience administering enterprise Databricks environments, including Unity Catalog, workspace security, cluster management, and Auto Loader on AWS.
- Strong relational database engineering skills covering schema design, query optimization, indexing, stored procedures, replication, and failover across SQL Server, Aurora, PostgreSQL, and/or MySQL.
- Advanced SQL and proficiency in PySpark and Python.
- Infrastructure-as-code experience with Terraform and CI/CD pipeline management.
- Knowledge of data governance, compliance practices, cloud cost optimization, and 24/7 operational support.
- Familiarity with large language models, prompt engineering, or agent-based architectures.
- Ability to retrieve, synthesize, and present critical data for specific ad-hoc questions, plus a record of commitment to prior employers.
- Preferred: Looker, Power BI, DynamoDB, MongoDB or equivalent NoSQL platforms, AI governance, Kafka or other real-time streaming platforms, Snowflake administration, FinOps, AI workload access controls and privacy protections, MLflow, TensorFlow, PyTorch, Scikit-learn, Lakehouse AI, ML pipelines, Unity Catalog, and Delta Lake.
- Preferred: Experience managing large consumer datasets and deriving insights from them.
Benefits
- The position is located in Arlington, VA, with in-office work Monday through Thursday and work from home on Friday.
- Base compensation is stated as $136,000–$177,000 annually.
- The employer does not provide visa sponsorship for this position.
- CoStar Group offers an equal employment opportunity workplace, maintains a drug-free workplace, and performs pre-employment substance abuse testing.
Tech Stack
Categories
About CoStar Group
CoStar Group (NASDAQ: CSGP) is a global leader in commercial real estate information, analytics, online marketplaces, and 3D digital twin technology. Founded in 1986, CoStar Group is dedicated to digitizing the world’s real estate, empowering all people to discover properties, insights, and connections that improve their businesses and lives. CoStar Group’s major brands include CoStar, a leading global provider of commercial real estate data, analytics, and news; LoopNet, the most trafficked commercial real estate marketplace; Apartments.com, the leading platform for apartment rentals; Homes.com, the fastest-growing residential real estate marketplace; and Domain, one of Australia’s leading property marketplaces. CoStar Group’s industry-leading brands also include Matterport, a leading spatial data company whose platform turns buildings into data to make every space more valuable and accessible, STR, a global leader in hospitality data and benchmarking; Ten-X, an online platform for commercial real estate auctions and negotiated bids; and OnTheMarket, a leading residential property portal in the United Kingdom. CoStar Group’s websites attracted over 143 million average monthly unique visitors in the third quarter of 2025, serving clients around the world. Headquartered in Arlington, Virginia, CoStar Group is committed to transforming the real estate industry through innovative technology and comprehensive market intelligence. From time to time, we plan to utilize our corporate website as a channel of distribution for material company information. For more information, visit CoStarGroup.com.