DevOps Engineer II - DataBricks
CommerceIQ14 days ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Manage Databricks infrastructure, clusters, jobs, compute resources, configurations, permissions, integrations, governance, and production workloads.
- Monitor and optimize Databricks performance, reliability, scheduling, autoscaling, resource utilization, and costs.
- Administer production databases, including maintenance, monitoring, troubleshooting, tuning, backup and recovery, replication, capacity management, and cost optimization.
- Manage AWS infrastructure and services, troubleshoot infrastructure and networking issues, and improve reliability, security, scalability, and cost efficiency.
- Operate Kubernetes and EKS environments, including deployments, scaling, networking, ingress, storage, workloads, and cluster maintenance.
- Build and maintain CI/CD pipelines, Infrastructure as Code, GitOps workflows, and automation for repetitive operational tasks.
- Create dashboards, alerts, and operational metrics; participate in incident management, root-cause analysis, and reliability improvements.
Requirements
- 4–7+ years of DevOps, cloud, or infrastructure experience.
- Strong hands-on experience with Databricks, AWS, Kubernetes, and preferably AWS EKS.
- Strong production database administration and troubleshooting experience, including PostgreSQL, MySQL, Aurora, Redis, or similar technologies.
- Experience with Terraform, Infrastructure as Code, CI/CD, Git-based workflows, Helm, and GitOps tools such as ArgoCD.
- Experience with monitoring and observability tools such as Prometheus, Grafana, CloudWatch, or OpenTelemetry.
- Strong Linux, networking, troubleshooting, and problem-solving skills, with experience supporting production environments at scale.
Tech Stack
Categories
About CommerceIQ
CommerceIQ builds an AI-driven ecommerce management platform used by consumer and retail brands to optimize retail media, digital shelf content, pricing, availability, and supply chain on major online marketplaces and retailers. It sells its software as a SaaS platform with automation and agent-based workflows for marketing, sales, and operations teams. The company is privately held, founded in 2012, headquartered in Mountain View, California, and raised a Series D in 2022.