about 10 hours ago
Base Salary
$323k - $428k/yr
Responsibilities
- Design and build APIs and backend services using Spring Boot.
- Write clean, maintainable, and efficient code with adherence to best practices.
- Develop and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow.
- Optimize data storage, retrieval, and processing systems for reliability and performance.
- Develop complex queries and analytics solutions using Druid, Trino, and StarRocks.
- Monitor and troubleshoot data systems to improve efficiency.
- Collaborate with data scientists and software engineers to deliver integrated solutions.
- Provide technical guidance and mentorship to junior engineers.
Requirements
- Bachelor's degree in computer science, Engineering, or a related field.
- 8+ years of experience in software and/or data engineering.
- Expertise in big data technologies such as Apache Spark and Apache Airflow.
- Experience with at least one of Apache Druid, StarRocks, or Trino.
- Strong understanding of SOLID principles and distributed systems architecture.
- Proven experience in distributed data processing and data warehousing.
- Advanced SQL skills with expertise in query optimization.
- Exceptional problem-solving abilities and capacity to work independently or collaboratively.
- Excellent verbal and written communication skills.
- Experience with cloud platforms like AWS, GCP, or Azure (preferred).
- Familiarity with additional big data technologies, including Hadoop and Kafka (preferred).
- Strong programming skills in Python, Java, or Scala (preferred).
- Knowledge of CI/CD pipelines and DevOps practices (preferred).
- Expertise in data modeling and visualization tools (preferred).
Benefits
- Health insurance, equity awards, life insurance, and disability benefits.
- Parental leave and wellness benefits.
- Paid time off and support for personal needs.
- Global access to mental health and financial wellness resources.
Tech Stack
Apache AirflowApache HadoopApache KafkaApache SparkAWSAzureDockerGoogle Cloud PlatformJavaKubernetesPythonScalaSpring BootTerraform