about 2 months ago
Los Angeles, CA, USA +2 moreStaff+
Base Salary
$200k - $250k/yr
Responsibilities
- Design and evolve Laurel's global large scale data platform architecture.
- Design and operate large-scale data pipelines processing millions of events per day.
- Define best practices for data ingestion, transformation, processing, and storage.
- Mentor and help grow team knowledge of big data best practices.
- Work on Python API services (Django) to improve AI infrastructure.
- Build, improve, and maintain Airflow DAGs, optimizing MongoDB and PostgreSQL usage.
- Design and operate streaming data infrastructure, including migrations to event-driven architectures.
- Work on internal OLAP and DataLake systems.
- Develop and manage Kubernetes, Docker, and compute infrastructure.
- Improve continuous integration, continuous deployment, and other automation.
- Write backend code to assist teams with deadlines or resource constraints.
- Attend quarterly offsites, team standups, and other company meetings.
- Raise the bar for engineering quality and advocate for best practices.
Requirements
- Strong Python skills with experience building and deploying APIs for AI/ML teams.
- Experience with Airflow, Kubernetes, and AWS.
- Experience with machine learning infrastructure and large language models.
- Development experience with Terraform.
- Experience working in startup environments.
- Experience participating in a regular engineering on-call rotation.
- Experience with PostgreSQL and MongoDB.
- Experience with OLAP systems like Snowflake or Clickhouse.
- Experience with AI-specific databases, such as vector databases.
- Experience with event streaming platforms like Kafka or SQS.
Benefits
- Comprehensive medical/dental/vision coverage with covered premiums.
- 401(k) plan with additional benefits including wellness, commuter, and FSA stipends.
- Remote work flexibility with a preference for candidates near San Francisco, Los Angeles, or New York City.
- Bi-annual in-person company off-sites in unique locations.
- A collaborative and inclusive team environment.