GrepJob
Sign InSign Up
Databricks

Staff Technical Solutions Engineer (Apache Spark™)

Databricks

Apply
12 months ago
Bengaluru, India
Staff+
H1B Sponsor

Responsibilities

  • Perform initial analysis and troubleshoot issues in Apache Spark™.
  • Resolve and suggest deep code-level analysis of Spark-related customer issues.
  • Assist customers in setting up reproducible Spark problems and solutions.
  • Contribute to the development of tools and automation initiatives.
  • Participate in the Designated Solutions Engineer program for strategic customers.
  • Provide best practices guidance around Spark runtime performance.
  • Support third-party integrations with the Databricks environment.
  • Coordinate with various teams to address customer issues.
  • Engage in screen sharing meetings and respond to internal and customer inquiries.
  • Review Engineering JIRA tickets and follow up on action items.
  • Manage assigned Spark cases and adhere to SLAs.
  • Build and maintain internal documentation and knowledge base.
  • Achieve support organization KPIs.
  • Coordinate with Engineering and Backline Support teams for product defect reporting.
  • Participate in on-call rotations for escalated support during outages.
  • Enhance expertise in AWS/Azure and Databricks through continuous learning.

Requirements

  • 8+ years of experience in designing and maintaining Python/Java/Scala applications.
  • 2+ years of hands-on experience with Big Data technologies, including Apache Spark™.
  • Experience in performance tuning and troubleshooting Hive and Spark applications.
  • Proven experience in JVM and Memory Management techniques.
  • Working knowledge of Data Lakes and SCD use cases.
  • Hands-on experience with SQL-based databases and ETL technologies.
  • Linux/Unix administration skills are a plus.
  • Experience with cloud platforms like AWS, Azure, or GCP is preferred.
  • Excellent written and oral communication skills.
  • Strong analytical and problem-solving skills in a distributed computing environment.

Tech Stack

Apache HadoopApache HiveApache KafkaApache SparkAWSAzureDatabricksElasticsearchGoogle Cloud PlatformInformaticaJavaLinuxMicrosoft SQL ServerMySQLPythonScalaSQL

Categories

AI & MLBackendData EngineeringData Science