
Senior Software Engineer - 3 (Orchestration & Validation)
Exotel Techcom Private Limited23 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Build and operate agents that perform regression analysis, assess code-change blast radius, and identify risks and implementation gaps.
- Determine whether AI-identified risks and gaps are accurate and provide evidence-based release decisions.
- Validate static analysis through dynamically generated tests while remaining the human in the loop.
- Develop and train test agents using prompts, skills, tool contracts, and CLI/MCP tools connected to code, GitLab, Jira, and test environments.
- Create white-box agent assertions covering database rows, Redis keys, Kafka events, and SIP/RTP traces.
- Measure agent quality using valid-bug rate, false-positive rate, time to signal, and regression sets of known merge-request outcomes.
- Convert confirmed findings and escaped defects into deterministic regression tests in CI and support release gates.
- Distinguish environment failures from product failures in ephemeral and pre-production environments and fix or escalate them appropriately.
- Evaluate AI products with evaluation datasets and calibrated LLM-as-judge checks.
- Review other engineers’ agent and test work and help the team adopt agent-based validation practices.
Requirements
- 6–8 years of software engineering experience with substantial production-code experience in a product engineering organization.
- Bachelor’s or Master’s degree in Computer Science or equivalent experience.
- Expertise in one of Java, Go, or Python, with sufficient fluency in the others to review pull requests.
- Working knowledge of Postgres, Citus, MySQL, Redis, Kafka, and Beanstalkd sufficient to validate resulting system state.
- Experience with REST APIs and microservices in large-scale distributed systems.
- Hands-on experience building or substantially extending and shipping LLM-agent workflows involving tool use, multi-step plans, retries, and evaluation.
- CI experience with Jenkins, GitLab CI, or GitHub Actions.
- Comfort using Docker and Kubernetes to read pod logs and debug failed environments.
- Ability to assess agent correctness and support conclusions with evidence.
- Preferred experience evaluating LLM outputs with evaluation datasets, rubrics, and LLM-as-judge methods.
- Preferred observability experience with Prometheus, Grafana, ELK, or OpenTelemetry.
- Contact-center or telephony exposure, including SIP, RTP, WebRTC, or TCP/UDP, is a plus.
- Exposure to AngularJS, React, or Node.js front ends is a plus.
Tech Stack
Apache KafkaDockerElasticsearchGitHub ActionsGitLab CI/CDGoGrafanaJavaJenkinsKubernetesMySQLNode.jsPHPPostgreSQLPrometheusPythonReactRedisRuby
Categories
About Exotel Techcom Private Limited
Exotel Techcom Private Limited builds an omnichannel customer engagement and contact center platform for businesses, offering cloud telephony, voice, SMS, WhatsApp/RCS messaging, and conversational AI to support both human and virtual agents. It sells SaaS and usage-based CPaaS solutions to enterprises; founded in 2011 and headquartered in Bangalore, it reports serving 7,000+ customers and powering over 20 billion customer conversations annually.