CoreWeave

Senior Data Platform Engineer - Weights & Biases

CoreWeave
Apply
11 months ago
Remote, United States +4 moreSenior
H1B sponsor

Base Salary

$165k - $242k/yr

Responsibilities

  • Architect, develop, test, and maintain scalable distributed batch and streaming data pipelines.
  • Build and optimize data transformation and workflow-orchestration frameworks using dbt, Dagster, Airflow, or comparable tools.
  • Establish workflow standards for testing, deployment, dependency management, data quality, and observability.
  • Design data models, schemas, partitioning strategies, and storage patterns for large-scale analytical workloads.
  • Diagnose and resolve performance, scalability, availability, and cost-efficiency issues in multi-petabyte data environments.
  • Define event schemas and implement logging, telemetry, and instrumentation for web applications, backend services, and distributed systems.
  • Develop data catalog, metadata, lineage, governance, and semantic-layer capabilities.
  • Create data interfaces and platform foundations for internal AI applications, including data discovery, workflow assistance, customer-growth analysis, churn-risk modeling, and abuse detection.
  • Monitor production systems, troubleshoot incidents, document operational procedures, and participate in an on-call rotation after onboarding and training.
  • Evaluate architectural alternatives and select appropriate data structures, algorithms, database designs, and distributed-processing patterns.

Requirements

  • Bachelor’s degree or foreign equivalent in Computer Science, Computer Engineering, Data Science, Information Systems, or a closely related technical or quantitative field involving substantial Engineering coursework.
  • At least five years of progressive professional experience in software engineering, data engineering, data infrastructure, or a closely related occupation.
  • Professional experience designing and implementing production data pipelines and distributed data-processing systems.
  • Professional experience with data transformation or workflow-orchestration technologies such as dbt, Dagster, Airflow, or comparable platforms.
  • Professional experience designing data models, schemas, and storage strategies for large-scale analytical databases or cloud data warehouses.
  • Professional programming experience in Python, Go, Java, Scala, or another general-purpose language used for production data systems.
  • Professional experience with SQL, database performance optimization, data-quality testing, and production monitoring.
  • Knowledge of version control, automated testing, code review, continuous integration, deployment automation, and technical documentation.
  • Knowledge of web-application telemetry, event instrumentation, logging systems, APIs, and distributed-service architecture.
  • Ability to communicate technical designs, risks, and tradeoffs to engineering, data science, analytics, and business stakeholders.
  • Preferred qualifications include experience operating multi-petabyte or other high-volume business-critical data systems.
  • Preferred qualifications include experience with AWS, Google Cloud Platform, or Microsoft Azure data services.
  • Preferred qualifications include experience with data catalogs, metadata management, lineage systems, governance frameworks, or semantic layers.
  • Preferred qualifications include knowledge of machine-learning workflows, model-development terminology, or production AI application data requirements.
  • Preferred qualifications include experience supporting internal platform users and turning user feedback into platform improvements.
  • Preferred qualifications include self-directed work and cross-functional collaboration across engineering and business teams.

Benefits

  • US full-time employees receive medical, dental, and vision insurance fully paid by CoreWeave.
  • Benefits include company-paid life insurance, voluntary supplemental life insurance, short- and long-term disability insurance, Flexible Spending Account, and Health Savings Account.
  • Benefits include tuition reimbursement, Employee Stock Purchase Program eligibility, mental wellness benefits through Spring Health, family-forming support through Carrot, paid parental leave, and childcare support through Kinside.
  • Benefits include a 401(k) with employer match and flexible paid time off.
  • Catered lunch is provided daily in office and data center locations.
  • The role offers a casual work environment and a culture focused on innovative disruption.

Tech Stack

Categories

Data Engineering
CoreWeave

About CoreWeave

1,001-5,000 employees

CoreWeave provides a GPU-accelerated cloud for AI training and inference, VFX, and rendering, with bare-metal instances, Kubernetes orchestration, and managed services to scale workloads. It sells on-demand and reserved capacity to AI labs, startups, and enterprises, and offers SaaS tools and hands-on support for deployment. Founded in 2017 and headquartered in New York, it is publicly traded on Nasdaq under the ticker CRWV.

Contact me