Qualcomm

AWS Databricks Platform Engineer

Qualcomm
Apply
4 months ago
Bengaluru, India or Hyderābād, IndiaStaff+
H1B Sponsor

Responsibilities

  • Design and build scalable distributed data platform systems.
  • Own Databricks workspace architecture, governance, and lifecycle management.
  • Build and support end-to-end data pipelines from ingestion through analytics and machine learning.
  • Implement infrastructure as code using Terraform and Terramate.
  • Develop and maintain CI/CD pipelines for infrastructure, data pipelines, notebooks, SQL, and machine learning artifacts.
  • Operate and optimize Amazon EKS clusters and Helm deployments supporting data workloads.
  • Define and monitor SLIs and SLOs for platform reliability and data quality.
  • Lead incident response, on-call rotations, and blameless postmortems.
  • Implement security, compliance, governance, observability, and cost-optimization controls.
  • Drive platform innovation and continuous improvement across architecture and tooling.
  • Mentor engineers and influence platform standards and best practices.
  • Drive platform strategy across multiple globally distributed teams.

Requirements

  • 12+ years of IT-related work experience building data platforms and a bachelor's degree, or 10+ years of platform engineering experience building and operating AWS Databricks platforms, as stated in the role profile.
  • A bachelor's degree in Computer Engineering, Computer Science, Information Systems, or a related field with 5+ years of IT-related experience, or 7+ years of IT-related experience without a bachelor's degree.
  • 3+ years of programming experience, such as Java or Python.
  • 3+ years of experience with SQL or NoSQL databases.
  • 3+ years of experience with data structures and algorithms.
  • Proven experience designing complex distributed data systems end to end and evaluating scalability, reliability, cost, security, and operability trade-offs.
  • Expert AWS experience including networking, IAM, security, and multi-account environments.
  • Strong hands-on experience with Databricks Lakehouse Platform, Unity Catalog, Delta Lake, and MLflow.
  • Deep experience with Terraform/Terramate or similar infrastructure-as-code tools.
  • Experience building CI/CD pipelines with GitHub Actions or Jenkins.
  • Advanced Python and Bash scripting skills.
  • Hands-on experience managing Amazon EKS clusters and Helm deployments.
  • Experience defining and operating SLIs/SLOs for platform reliability and data quality.
  • Experience supporting SOX, GDPR, or other regulated environments.
  • AWS Certified DevOps Engineer – Professional certification or equivalent experience.
  • Ability to work independently, mentor team members, and communicate complex system designs to technical and non-technical stakeholders.
  • Preferred experience with Acceldata, OpenTelemetry, Fivetran Hybrid/HVR, HashiCorp Vault, OPA, Sonar, data lineage or metadata management tools, and Databricks serverless compute optimization.

Tech Stack

AWSBashDatabricksGitHub ActionsHelmJavaJenkinsMLflowPythonSonarQubeSQLTerraform

Categories

Data EngineeringDevOps
Qualcomm

About Qualcomm

10,000+ employees

Inspired by 250 years of American ingenuity, we build technologies that expand what’s possible. From wireless to AI at scale and 6G, our innovations power progress worldwide.

Contact me