4 months ago
USA (city not specified)Entry Level / Mid Level
H1B sponsor
Responsibilities
- Build LLM-powered features and agentic systems that address real customer problems.
- Design and implement evaluation frameworks to assess agent quality and business impact.
- Create automated benchmarks and regression tests for AI behavior evaluation.
- Investigate agent failures and develop strategies for performance improvement.
- Experiment with various AI strategies including prompting and reasoning.
- Build infrastructure for rapid experimentation and deployment.
- Collaborate with customers to understand workflows and identify AI automation opportunities.
- Contribute to engineering best practices for testing and production reliability.
Requirements
- Strong programming skills, preferably in Python.
- Solid software engineering fundamentals including testing and debugging.
- Experience building applications using LLMs and modern AI tools.
- Ability to design experiments and interpret results.
- Strong communication skills and a collaborative mindset.
- Curiosity and a desire to learn quickly.
Benefits
- Work on challenging problems in applied AI.
- Significant ownership and impact within a small, collaborative team.
- Opportunities for rapid learning alongside experienced professionals.
- Contribute to defining evaluation practices for AI systems.
About Crogl
Crogl builds an AI-driven security operations platform that automates alert triage, investigations, and threat hunting for SOC teams and managed security providers. It integrates with existing security tools and can be deployed in private cloud or on‑prem environments, reducing reliance on prewritten playbooks. Founded in 2023 and privately held, the company targets teams seeking consistent incident response and the ability to reanalyze historical alerts at scale.