Senior Software Engineer - (Machine learning Platform)

Tekion

2 days ago

Bengaluru, India

Senior / Mid Level

H1B Sponsor

Responsibilities

Build and run the LLM control plane/gateway with smart routing and cost tracking.
Ship a unified API and SDKs with structured outputs and full observability.
Enforce safety and privacy through content filtering and validation.
Enable multi-model, multi-vendor LLM usage with automated canarying.
Own the agent runtime including tool registry and function calling.
Design orchestration patterns and manage agent state.
Enable training and scoring pipelines for classical ML models.
Monitor model and data drift, retraining as necessary.
Implement human-in-the-loop review processes.
Evolve the domain graph and build reliable data ingestion pipelines.
Serve real-time context to agents with access controls.
Power retrieval with hybrid search methods.
Run continuous evaluations for quality and safety.
Define SLOs for latency and uptime capabilities.
Maintain a model/agent registry with versioning and audit trails.
Provide templates and documentation for product teams.

5 - 7 years of experience in building large-scale data/ML or platform systems.
Strong software engineering fundamentals including API design and distributed systems.
Production experience with Python and one of Java/Scala/Go.
Experience with MLOps at scale including pipelines and CI/CD for models.
Familiarity with cloud services, preferably AWS, and container technologies.
Practical ML knowledge including feature engineering and model deployment.
Experience building or operating an LLM gateway/control plane.
Knowledge of agentic systems and orchestration frameworks.
Experience with knowledge graphs and hybrid retrieval patterns.

Apache AirflowApache FlinkApache KafkaApache SparkAWSDockerGoGraphQLJavaKubernetesLightGBMMLflowNeo4jPythonScalaXGBoost