17 days ago
Yerevan, Armenia +8 moreSenior / Staff+
Responsibilities
- Build production-ready coding agents and agentic workflows for developer tasks inside JetBrains products.
- Improve model and agent behavior through prompt design, context construction, fine-tuning, instruction-tuning, preference optimization, and other post-training methods.
- Design agent loops, including tool use, execution strategies, safeguards, and task-completion quality.
- Create evaluation suites and quality infrastructure with online and offline evaluations, regression checks, failure analysis, and release criteria.
- Build feedback loops from logs, user signals, and edge cases to improve data, evaluations, and agent behavior.
- Work with hosted frontier APIs and self-hosted or open-weight models, balancing capability, latency, reliability, privacy, and cost.
- Collaborate with product managers, software engineers, ML engineers, and researchers to ship features end to end.
- Help define technical direction in ambiguous areas and take ownership across multiple iterations.
Requirements
- Strong software engineering fundamentals and a track record of shipping complex systems to production.
- Hands-on experience building LLM-powered products, coding agents, or other AI systems.
- Experience improving model behavior through prompting, context engineering, fine-tuning, preference optimization, or broader post-training methods.
- Practical experience evaluating and benchmarking LLM systems, including defining task-grounded success metrics and catching regressions.
- Experience working with noisy real-world signals rather than only clean benchmark datasets.
- Good judgment regarding trade-offs among model quality, latency, reliability, privacy, and cost.
- Confidence working with ambiguity and taking ownership of a direction over multiple iterations.
- Strong communication skills and the ability to align engineering and product decisions.
Benefits
- Strong base salary and competitive pay reflecting skills and experience.
- Flexible work location with the option to work from home or the office.
- Ability to work remotely from abroad for up to 30 days per year.
- Extra time off.
- Medical insurance allowance for employees and their families.
- Learning and development opportunities, including conferences, courses, and language classes.
- Relocation support.
- Hot meals or a lunch allowance on workdays.
- Professional mental health support.
- On-site gym or sports club stipend.
- Internal company events and team gatherings.
- Some benefits may vary depending on location.
Categories
About JetBrains
On a mission to make software development a more productive and enjoyable experience. Make it happen. With Code.