AI Engineer-Data Databricks Pltform
Ecolab Inc.1 day ago
Bengaluru, IndiaSenior
Responsibilities
- Design, configure, maintain, and administer Databricks workspaces, Unity Catalog, clusters, SQL Warehouses, compute policies, workspace configurations, and access controls.
- Build scalable batch and streaming data pipelines and ingestion frameworks using Databricks Lakehouse, Delta Lake, Structured Streaming, and medallion architecture patterns.
- Integrate Databricks with Snowflake, SAP, Oracle, SQL Server, Azure Data Factory, Kafka, cloud storage, LLMs, vector databases, and enterprise AI platforms.
- Enable ML and generative AI workloads through MLflow, model lifecycle management, feature stores, model serving, and scalable engineering environments.
- Establish automated deployment, testing, monitoring, rollback, release management, and environment promotion processes for data and AI workloads.
- Implement infrastructure automation, enterprise security controls, RBAC, data masking, encryption, audit logging, governance policies, and vulnerability remediation.
- Operate and optimize platform observability, logging, alerting, performance, cost, scalability, reliability, and incident response.
- Collaborate with architects, data engineers, AI engineers, security teams, and business stakeholders; provide technical guidance, participate in roadmap planning, and mentor junior engineers.
Requirements
- Bachelor’s or master’s degree in computer science, engineering, IT, or a related field.
- 5+ years of experience in data, platform, or cloud engineering.
- 3+ years of hands-on experience with the Databricks Lakehouse Platform.
- Strong expertise in Delta Lake, Unity Catalog, MLflow, Databricks Workflows, Structured Streaming, PySpark, and Spark SQL.
- Experience with Azure, AWS, or GCP cloud platforms.
- Proficiency in Python and SQL.
- Strong knowledge of DevOps, CI/CD, Infrastructure as Code, and platform automation.
- Hands-on experience with Terraform, GitHub Actions, Azure DevOps, or equivalent CI/CD tools.
- Preferred experience with generative AI, agentic AI, LLM-based applications, Snowflake, enterprise AI platforms, Kubernetes, Docker, Kafka, and event-driven architectures.
- Databricks certification and experience supporting enterprise-scale Data & AI platforms are preferred.
Tech Stack
Apache KafkaAWSAzureDatabricksDockerGitHub ActionsGoogle Cloud PlatformKubernetesMicrosoft SQL ServerMLflowPythonSnowflakeSQLTerraform
Categories
Data EngineeringDevOps
About Ecolab Inc.
Ecolab Inc. builds and sells water treatment chemicals and equipment, hygiene and infection-prevention products, and on-site service and digital monitoring for industrial and institutional customers. A NYSE-listed public company founded in 1923 and headquartered in St. Paul, Minnesota, it serves food, healthcare, life sciences, hospitality, manufacturing, and energy markets worldwide; its portfolio includes Nalco Water and, in data centers, CoolIT liquid-cooling solutions.