Machine Learning Infrastructure Engineer - LLM & Agentic AI
Stellar Cyber1 day ago
Remote, United StatesMid Level
Base Salary
$150k - $215k/yr
Responsibilities
- Design and build agentic AI frameworks that orchestrate LLM-based agents for reasoning, planning, and SecOps task execution.
- Develop scalable LLM inference infrastructure for efficient serving and resource management across LLM hosting providers.
- Develop MCP servers that interact with Open XDR platform services and integrate with LLM-based agents.
- Build supporting API services for reliable and extensible Autonomous SOC agent operations.
- Collaborate with machine learning and security researchers, UI, backend, infrastructure, and product management teams.
Requirements
- Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.
- At least 2 years of software development experience, or 1 year of experience with an advanced degree in an industry setting.
- At least 2 years of experience with data structures or algorithms in an academic or industry setting.
- At least 2 years of experience developing backend infrastructure, distributed systems, APIs, and microservices for MLOps-related projects.
- Experience with cloud computing, containerization, orchestration, and deployment technologies such as Docker and Kubernetes.
- Experience with one or more of Python, Java, or Go.
- Preferred experience with LLM applications in high-sensitivity domains such as finance, defense, or health.
- Preferred experience with LangChain, LangGraph, AutoGen, prompt engineering, vector databases, retrieval-augmented generation, ML observability, and LLM inference frameworks such as vLLM and llama.cpp.
- Experience with ML platform teams or researcher tooling and knowledge of SecOps concepts are pluses.
Benefits
- Remote workplace in the United States.
- Pre-IPO stock options.
- Medical, dental, and vision care.
- 401(k), life insurance, paid time off, and an Employee Assistance Program.
- Employee Discount, Referral, Rewards, and Recognition Programs.
- Competitive salary, bonus opportunity, equity, and career growth opportunities.
Tech Stack
Categories
About Stellar Cyber
Stellar Cyber builds an open security operations platform that unifies AI-driven SIEM, NDR, and Open XDR for enterprises, managed security service providers, and public-sector teams. The company sells subscription software that ingests logs and network data to detect, correlate, and respond to threats across on-premises and cloud environments. Founded in 2017 and headquartered in San Jose, California, Stellar Cyber is privately held and broadly adopted by MSSPs.