Software Engineer
Cognite - AI for Industry4 days ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Design, build, and operate the core serverless execution engine and Workflows orchestration layer.
- Own uptime, latency SLOs, incident response, deterministic execution, and failure handling for platform services.
- Architect multi-tenant, multi-cloud, high-throughput scheduling, queueing, and retry mechanisms.
- Define and evolve versioned REST and event-driven APIs.
- Implement distributed tracing, structured logging, alerting, and operational observability.
- Develop unit, integration, and smoke-test automation and maintain production deployment pipelines.
- Profile and improve execution throughput, cold-start latency, and cross-service performance.
- Optimize compute and storage costs without compromising reliability.
- Build platform primitives supporting ML workload scheduling, environment management, secrets handling, and long-running ML workflows.
Requirements
- 3–6 years of experience building and operating production backend services at scale.
- Deep experience with JVM languages, preferably Kotlin, or Java, plus Python and FastAPI.
- Experience with distributed systems patterns and cloud-native service design across Kubernetes, Azure, GCP, AWS, or private cloud.
- Hands-on experience with workflow engines such as Conductor or Apache Airflow and event-driven architectures using Kafka or Pub/Sub.
- Experience with PostgreSQL, non-relational databases, object storage, data lakes, and Redis in multi-tenant environments.
- Practical experience with OpenTelemetry, Prometheus, and Grafana.
- Experience supporting production ML workloads, notebooks, job scheduling, resource management, experiment tracking, or model-serving infrastructure.
- Familiarity with industrial knowledge graphs, entity resolution, NLP/CV pipelines, vector embeddings, semantic search, or RAG-based contextualization is a bonus.
- Familiarity with React or TypeScript is a bonus.
- Understanding of model versioning, A/B experiment tracking, and the boundary between platform and ML framework responsibilities is a bonus.
Tech Stack
Apache AirflowApache KafkaAWSAzureFastAPIGoogle Cloud PlatformGrafanaJavaKotlinKubernetesPostgreSQLPrometheusPythonReactRedisTypeScript
About Cognite - AI for Industry
Cognite builds an industrial data and AI platform used by energy, manufacturing, and power & utilities companies to integrate OT/IT data and deploy AI at scale. Its flagship product, Cognite Data Fusion, is sold as enterprise SaaS with services for implementation and Industrial AI agents. Founded in 2016 and privately held, the company focuses on asset-intensive operations and Industrial DataOps.