1 day ago
Base Salary
$238k - $322k/yr
Responsibilities
- Set the AI technical vision, architecture, and multi-year roadmap for LLM and agentic systems across Rapid7’s security products.
- Define company-wide model strategy, including model selection, fine-tuning, distillation, post-training, and investment in new capabilities.
- Lead complex technical initiatives involving LLM fine-tuning, distillation, post-training, inference optimization, and production AI platforms.
- Establish standards for context engineering, inference optimization, and evaluation, using evaluations as release gates for AI systems.
- Lead design reviews, resolve complex technical trade-offs, and prototype and build critical model, training, and inference code.
- Mentor Principal, Staff, and Senior engineers and represent AI engineering to executives, customers, and the external community.
Requirements
- 14+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems.
- Track record of building scalable, production-grade AI systems and shared platforms adopted across multiple products.
- Advanced expertise in transformer architecture, attention, tokenization, positional encodings, model training, and model serving.
- Advanced PyTorch skills, including custom model code, mixed precision, and distributed training with technologies such as FSDP and DeepSpeed.
- Hands-on experience with full and parameter-efficient fine-tuning, including LoRA and QLoRA, as well as distillation and preference- or reinforcement-learning-based methods such as DPO and GRPO.
- Deep experience with context engineering, retrieval, memory, long-running agent workflows, evaluation strategy, and benchmarks for LLM and agent systems.
- Deep knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding, quantization, and serving at scale.
- Experience with vLLM, SGLang, or TensorRT-LLM, ideally on AWS, and ideally including GPU kernel work with CUDA or Triton.
- Strong predictive AI, classical ML, distributed systems, and Python fundamentals, with sound judgment about choosing between these approaches and LLMs.
- Organization-wide technical leadership, mentoring, consensus building, strategic decision-making, and the ability to influence product and platform investments.
- Recognition as an AI expert through publications, patents, open-source contributions, or industry engagement.
- A PhD in Computer Science, Machine Learning, AI, or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions.
Benefits
- Remote work is indicated by the #LI-Remote designation.
- The stated United States annual base salary range is $238,200.00-$322,200.00, excluding variable or incentive compensation, equity, and benefits.
- Rapid7 provides a collaborative, inclusive workplace committed to fair and equitable employment practices.
Categories
About Rapid7
Rapid7 builds a cloud security operations platform and services for enterprises, combining vulnerability management, detection and response (SIEM/XDR and MDR), application security testing, and security automation. Its Insight platform products include InsightVM, InsightIDR, InsightAppSec, and InsightConnect, sold as subscriptions with optional managed services. Founded in 2000 and headquartered in Boston, the NASDAQ-listed company (RPD) serves more than 11,500 customers worldwide.