Staff Technical Solutions Engineer, Spark
Databricks
9 months ago
São Paulo, Brazil
Staff+
H1B Sponsor
Responsibilities
- Perform initial analysis and troubleshooting of Apache Spark issues.
- Resolve and suggest deep code-level analysis for customer issues.
- Assist customers in setting up reproducible Spark problems.
- Contribute to the development of tools and automation initiatives.
- Participate in the Designated Solutions Engineer program.
- Provide best practices guidance for Spark runtime performance.
- Support third-party integrations with the Databricks environment.
- Coordinate with Account Executives and Customer Success Engineers.
- Engage in screen sharing meetings and respond to internal communications.
- Review Engineering JIRA tickets and follow up on action items.
- Manage assigned Spark cases and adhere to SLAs.
- Build and maintain internal documentation and knowledge base.
- Achieve support organization KPIs.
- Coordinate with Engineering and Backline Support teams.
- Participate in on-call rotation for escalated support.
- Strengthen expertise in AWS/Azure and Databricks platforms.
Requirements
- 8+ years of experience in Python/Java/Scala application development.
- 2+ years of hands-on experience with Big Data technologies, especially Apache Spark.
- Experience in performance tuning and troubleshooting Hive and Spark applications.
- Knowledge of JVM and Memory Management techniques is preferred.
- Familiarity with Data Lakes and production-scale use cases.
- Experience with SQL-based databases and ETL technologies is preferred.
- Linux/Unix administration skills are a plus.
- Hands-on experience with cloud platforms like AWS, Azure, or GCP is preferred.
- Excellent written and oral communication skills.
- Strong analytical and problem-solving skills in a distributed computing environment.
Tech Stack
Apache HiveApache KafkaApache SparkAWSAzureDatabricksElasticsearchGoogle Cloud PlatformInformaticaJavaLinuxMicrosoft SQL ServerMySQLPythonScalaSQL
Categories
AI & MLData EngineeringData Science