Rapid7

Senior AI Engineer

Rapid7
Apply
3 days ago
Pune, IndiaSenior

Responsibilities

  • Design, build, and deploy LLM and agentic AI components for Detection and Response and Exposure and Remediation use cases.
  • Fine-tune, distill, and post-train open-source LLMs on security data from curation through training, evaluation, and deployment.
  • Build and maintain evaluation suites and use evaluations as release gates for shipped AI systems.
  • Implement retrieval, memory, and other context-engineering approaches for long-running agent workflows.
  • Optimize LLM inference for quality, latency, and cost through batching, caching, quantization, and other serving techniques.
  • Own projects from design through production, contribute to design reviews, and recommend technical approaches.
  • Partner with Product and platform engineers to deliver shared outcomes and guide less experienced engineers through reviews, onboarding, and knowledge sharing.

Requirements

  • 5+ years of software or ML engineering experience, or 3+ years with an advanced degree or equivalent practical experience, including at least 1 year building production LLM or agentic AI systems.
  • Track record of independently delivering production-grade AI systems or features with minimal guidance.
  • Understanding of LLMs, transformer architecture, attention, tokenization, and training and serving lifecycles.
  • Strong practical PyTorch skills and exposure to mixed-precision or distributed training.
  • Hands-on experience fine-tuning open-weight LLMs, including parameter-efficient methods such as LoRA.
  • Experience with context engineering, retrieval, memory, and evaluation suites for agent-system quality.
  • Working knowledge of inference optimization, Python, classical machine-learning fundamentals, and predictive AI.
  • Ability to own delivery and quality, communicate technical trade-offs, collaborate across Engineering and Product, and navigate complex technical challenges.
Rapid7

About Rapid7

5,001-10,000 employees

Rapid7 builds a cloud security operations platform and services for enterprises, combining vulnerability management, detection and response (SIEM/XDR and MDR), application security testing, and security automation. Its Insight platform products include InsightVM, InsightIDR, InsightAppSec, and InsightConnect, sold as subscriptions with optional managed services. Founded in 2000 and headquartered in Boston, the NASDAQ-listed company (RPD) serves more than 11,500 customers worldwide.

Contact me