Senior Data Engineer
CoStar GroupBase Salary
$133k - $172k/yr
Responsibilities
- Design, build, and maintain scalable data pipelines and data platforms.
- Develop and optimize ETL/ELT processes for large, complex datasets.
- Build repeatable, customizable, and recurring data migration and transformation processes from heterogeneous external sources.
- Normalize inconsistent third-party schemas into standardized enterprise data models, including source-to-target mapping, deduplication, and entity resolution.
- Implement data quality, validation, and reconciliation controls for externally sourced data.
- Collaborate with engineering, product, DevOps, and DBA teams to deliver production systems.
- Contribute to technical design decisions and mentor other engineers.
- Standardize the data environment across billing systems to improve visibility into payment patterns, errors, and business optimizations.
Requirements
- Bachelor's degree from an accredited, not-for-profit, in-person college or university.
- 5+ years of data engineering experience, including setting technical direction and influencing design across a team.
- Experience building batch and incremental ingestion pipelines from REST/GraphQL APIs, flat-file and SFTP feeds, third-party data vendors, and database replication or CDC.
- Advanced SQL and strong data modeling skills, including dimensional/star schema, normalized, or Data Vault models.
- Proficiency in Python, Scala, Java, or C#/.NET.
- Production experience with a distributed processing engine, cloud data warehouse or lakehouse platform, and pipeline orchestration tooling.
- Experience implementing data quality, validation, and reconciliation controls with version control and CI/CD in AWS, Azure, or GCP.
- Experience using AI-assisted development tools such as Claude Code or similar tools for software delivery.
- Preferred experience with Databricks, Delta Lake, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows, Apache Iceberg, Apache Hudi, dbt, SQLMesh, Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect, Kafka, Kinesis, Spark Structured Streaming, Flink, Great Expectations, Soda, dbt tests, Monte Carlo, AWS Glue Data Catalog, Collibra, Alation, master data management, entity resolution, record linkage, address and geospatial standardization, Terraform, AI/ML pipelines, and feature engineering.
- Track record of commitment to prior employers.
Benefits
- Comprehensive medical, vision, dental, and prescription drug coverage.
- Life, legal, and supplementary insurance.
- Virtual and in-person mental health counseling for individuals and families.
- Commuter and parking benefits.
- 401(k) retirement plan with matching contributions.
- Employee stock purchase plan.
- Paid time off.
- Tuition reimbursement and internal professional and academic training.
- On-site fitness center or reimbursed fitness center membership costs, with yoga, Pelotons, personal training, and group exercise classes depending on location.
- Employee Resource Groups.
- Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks.
- Richmond, VA position with Monday through Thursday in the office and Friday working from home.
Tech Stack
Categories
About CoStar Group
CoStar Group (NASDAQ: CSGP) is a global leader in commercial real estate information, analytics, online marketplaces, and 3D digital twin technology. Founded in 1986, CoStar Group is dedicated to digitizing the world’s real estate, empowering all people to discover properties, insights, and connections that improve their businesses and lives. CoStar Group’s major brands include CoStar, a leading global provider of commercial real estate data, analytics, and news; LoopNet, the most trafficked commercial real estate marketplace; Apartments.com, the leading platform for apartment rentals; Homes.com, the fastest-growing residential real estate marketplace; and Domain, one of Australia’s leading property marketplaces. CoStar Group’s industry-leading brands also include Matterport, a leading spatial data company whose platform turns buildings into data to make every space more valuable and accessible, STR, a global leader in hospitality data and benchmarking; Ten-X, an online platform for commercial real estate auctions and negotiated bids; and OnTheMarket, a leading residential property portal in the United Kingdom. CoStar Group’s websites attracted over 143 million average monthly unique visitors in the third quarter of 2025, serving clients around the world. Headquartered in Arlington, Virginia, CoStar Group is committed to transforming the real estate industry through innovative technology and comprehensive market intelligence. From time to time, we plan to utilize our corporate website as a channel of distribution for material company information. For more information, visit CoStarGroup.com.