Rapid7

Staff AI Engineer (Lead)

Rapid7
Apply
3 days ago
Pune, IndiaStaff+

Responsibilities

  • Lead the design and architecture of LLM and agentic AI systems across Detection and Response and Exposure and Remediation.
  • Recommend model strategies involving frontier and open-source models, fine-tuning, distillation, and post-training.
  • Fine-tune, distill, and post-train open-source LLMs from security-data curation through training, evaluation, and deployment.
  • Improve context engineering, inference optimization, and evaluation while balancing quality, latency, and cost.
  • Establish evaluation benchmarks and release gates for AI systems.
  • Lead design reviews, resolve complex technical trade-offs, and contribute to technical roadmaps.
  • Prototype and build critical model, training, and inference code.
  • Mentor engineers, lead moderate-scope AI projects, and partner with Product and platform teams to deliver scalable customer-focused solutions.

Requirements

  • 8+ years of software or ML engineering experience, or 6+ years with an advanced degree or 3+ years with a PhD, including 2+ years building production LLM or agentic AI systems.
  • Track record of leading scalable, production-grade AI systems used across multiple teams or products, with technical leadership and mentoring impact.
  • Deep understanding of transformer architecture, attention, tokenization, positional encodings, model training, and model serving.
  • Advanced PyTorch skills, including custom model code, training loops, mixed precision, and distributed training with technologies such as FSDP and DeepSpeed.
  • Hands-on experience with full and parameter-efficient fine-tuning, distillation, preference optimization, and reinforcement-learning-based post-training methods such as LoRA, QLoRA, DPO, and GRPO.
  • Experience with retrieval, memory, context management, and evaluation strategies for long-running agent workflows.
  • Strong knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding, quantization, and serving at scale.
  • Strong predictive AI, classical machine learning, distributed systems, and Python fundamentals, with sound judgment about selecting appropriate approaches.
  • Ability to lead AI projects or programs, break goals into milestones, communicate technical trade-offs, and build cross-functional alignment.
  • Ability to translate customer needs into scalable, maintainable AI solutions and contribute to a culture of engineering excellence.
Rapid7

About Rapid7

5,001-10,000 employees

Rapid7 builds a cloud security operations platform and services for enterprises, combining vulnerability management, detection and response (SIEM/XDR and MDR), application security testing, and security automation. Its Insight platform products include InsightVM, InsightIDR, InsightAppSec, and InsightConnect, sold as subscriptions with optional managed services. Founded in 2000 and headquartered in Boston, the NASDAQ-listed company (RPD) serves more than 11,500 customers worldwide.

Contact me