5 months ago
Palo Alto, CA, USA +2 moreMid Level / Senior
H1B Sponsor
Base Salary
$180k - $220k/yr
Responsibilities
- Design, develop, and maintain robust batch and real-time data pipelines using Python, Go, Spark, and Kafka.
- Collaborate with ML engineers to implement data structures and APIs for new features.
- Architect and manage data lakehouse solutions to store and query unstructured media data efficiently.
- Implement data quality checks and monitoring to ensure high reliability of data.
- Transform raw data into structured, actionable data products for front-end applications.
Requirements
- Bachelor’s/Master’s degree in Computer Science, Engineering, or a related field.
- 3-5+ years of experience as a Backend Software Engineer with heavy data processing responsibilities.
- Strong proficiency in Python and SQL.
- Experience with cloud platforms (AWS/GCP) and data technologies like Kafka, Spark, and Snowflake/Databricks.
- Experience or interest in Computer Vision/Generative AI data processing.
- Proactive, 'owner' mindset; ability to operate in a fast-paced, startup environment.
Benefits
- Competitive salary and benefits package.
- Dynamic and inclusive work environment focused on innovation and creativity.
- Opportunities for professional growth and skill development.
- Collaborative culture that values teamwork and employee input.
- Access to state-of-the-art technologies and tools.