Exotel Techcom Private Limited

Senior Software Engineer - 3 (Orchestration & Validation)

Exotel Techcom Private Limited
Apply
23 hours ago
Bengaluru, IndiaSenior

Responsibilities

  • Build and operate agents that perform regression analysis, assess code-change blast radius, and identify risks and implementation gaps.
  • Determine whether AI-identified risks and gaps are accurate and provide evidence-based release decisions.
  • Validate static analysis through dynamically generated tests while remaining the human in the loop.
  • Develop and train test agents using prompts, skills, tool contracts, and CLI/MCP tools connected to code, GitLab, Jira, and test environments.
  • Create white-box agent assertions covering database rows, Redis keys, Kafka events, and SIP/RTP traces.
  • Measure agent quality using valid-bug rate, false-positive rate, time to signal, and regression sets of known merge-request outcomes.
  • Convert confirmed findings and escaped defects into deterministic regression tests in CI and support release gates.
  • Distinguish environment failures from product failures in ephemeral and pre-production environments and fix or escalate them appropriately.
  • Evaluate AI products with evaluation datasets and calibrated LLM-as-judge checks.
  • Review other engineers’ agent and test work and help the team adopt agent-based validation practices.

Requirements

  • 6–8 years of software engineering experience with substantial production-code experience in a product engineering organization.
  • Bachelor’s or Master’s degree in Computer Science or equivalent experience.
  • Expertise in one of Java, Go, or Python, with sufficient fluency in the others to review pull requests.
  • Working knowledge of Postgres, Citus, MySQL, Redis, Kafka, and Beanstalkd sufficient to validate resulting system state.
  • Experience with REST APIs and microservices in large-scale distributed systems.
  • Hands-on experience building or substantially extending and shipping LLM-agent workflows involving tool use, multi-step plans, retries, and evaluation.
  • CI experience with Jenkins, GitLab CI, or GitHub Actions.
  • Comfort using Docker and Kubernetes to read pod logs and debug failed environments.
  • Ability to assess agent correctness and support conclusions with evidence.
  • Preferred experience evaluating LLM outputs with evaluation datasets, rubrics, and LLM-as-judge methods.
  • Preferred observability experience with Prometheus, Grafana, ELK, or OpenTelemetry.
  • Contact-center or telephony exposure, including SIP, RTP, WebRTC, or TCP/UDP, is a plus.
  • Exposure to AngularJS, React, or Node.js front ends is a plus.

Tech Stack

Apache KafkaDockerElasticsearchGitHub ActionsGitLab CI/CDGoGrafanaJavaJenkinsKubernetesMySQLNode.jsPHPPostgreSQLPrometheusPythonReactRedisRuby
Exotel Techcom Private Limited

About Exotel Techcom Private Limited

501-1,000 employees

Exotel Techcom Private Limited builds an omnichannel customer engagement and contact center platform for businesses, offering cloud telephony, voice, SMS, WhatsApp/RCS messaging, and conversational AI to support both human and virtual agents. It sells SaaS and usage-based CPaaS solutions to enterprises; founded in 2011 and headquartered in Bangalore, it reports serving 7,000+ customers and powering over 20 billion customer conversations annually.

Contact me