4 hours ago
Base Salary
$182k - $242k/yr
Responsibilities
- Own the evaluation, procurement support, tenant design, rollout, configuration, and ongoing operation of employee-facing AI platforms.
- Establish CoreWeave’s AI operating framework, including intake and review processes, standards, runbooks, supported-service pathways, and employee enablement.
- Implement enforceable AI guardrails through SSO, SCIM provisioning, entitlement controls, retention and training settings, browser and desktop policies, and device trust.
- Build and operate connector and MCP allowlists with data-source scoping across enterprise platforms.
- Translate acceptable-use, data-classification, privacy, and regulatory requirements into technical controls and audit evidence.
- Own the internal AI control layer, including gateways, identity, secrets, MCP allowlisting, logging, rate limiting, cost attribution, agent hosts, and developer AI tooling.
- Operate AI services to SRE standards with automation, infrastructure-as-code, reliability targets, on-call, and incident response.
- Build telemetry, dashboards, and alerting for AI usage, cost, quality, risk, and executive visibility.
- Serve as the senior escalation point for AI tooling issues and lead cross-functional technical communication.
Requirements
- 6+ years in software engineering, site reliability engineering, or IT systems engineering involving building and operating systems in code.
- 2+ years of hands-on experience building with or administering LLM-based products, including API integration, prompt and tool design, retrieval pipelines, agent frameworks, multi-agent workflows, agent loops, or enterprise AI tools.
- Strong software engineering skills in Python, Go, Rust, or TypeScript, with experience building and operating dependable services and integrations.
- Production service operations experience involving containers, infrastructure-as-code, CI/CD, secrets management, and observability, or equivalent code-based automation of enterprise systems.
- Working understanding of enterprise identity and access, including SSO, SCIM, SAML/OIDC, OAuth, Conditional Access, Device Trust, and Zero Trust.
- Working understanding of endpoint and device management, MDM, device-trust tooling, and SaaS permission and data-sharing models.
- Ability to produce clear technical documentation and lead complex, cross-functional technical initiatives.
- Preferred experience administering Okta or Entra ID, Apple MDM/DDM, Jamf, Kandji, Munki, Intune, Chrome Enterprise, Google Workspace, Slack, Atlassian, or GitHub at enterprise scale.
- Preferred experience deploying and governing enterprise AI tools across an organization of 1,000+ people.
- Preferred hands-on experience building MCP servers and integrations, reusable agent skills, system prompts, and repository-level instruction files.
- Preferred knowledge of AI data governance, including data classification, retention, training opt-out, DLP, auditing, and logging.
- Preferred experience self-hosting and serving models.
- Preferred familiarity with SOC 2, ISO 27001, SOX, GDPR, NIST AI RMF, and ISO/IEC 42001.
Benefits
- Medical, dental, and vision insurance fully paid by CoreWeave for US-based full-time employees.
- Company-paid life insurance, voluntary supplemental life insurance, and short- and long-term disability insurance.
- Flexible Spending Account, Health Savings Account, tuition reimbursement, and employee stock purchase program eligibility.
- Mental wellness benefits through Spring Health and family-forming support through Carrot.
- Paid parental leave and flexible full-service childcare support through Kinside.
- 401(k) with employer match and flexible PTO.
- Catered lunch at office and data center locations, a casual work environment, and an innovation-focused culture.
- Benefits vary by location for roles outside the United States.
Tech Stack
Categories
About CoreWeave
CoreWeave provides a GPU-accelerated cloud for AI training and inference, VFX, and rendering, with bare-metal instances, Kubernetes orchestration, and managed services to scale workloads. It sells on-demand and reserved capacity to AI labs, startups, and enterprises, and offers SaaS tools and hands-on support for deployment. Founded in 2017 and headquartered in New York, it is publicly traded on Nasdaq under the ticker CRWV.