1 month ago
San Mateo, CA, USASenior / Staff+
H1B sponsor
Responsibilities
- Design, develop, and implement backend and machine learning data infrastructure.
- Build event-based data ingestion, stream processing, data warehouse, data pipeline, visualization, analytics, and application systems.
- Develop analytics tools that provide insights into customer acquisition, operational efficiency, and business performance.
- Maintain distributed ETL, feature engineering, and model-running pipelines.
- Create data tools for analytics and data science teams.
- Keep data separated and secure across national boundaries, multiple data centers, and AWS regions.
- Troubleshoot data systems, diagnose problems, benchmark performance, load balance systems, and participate in code reviews.
- Collaborate with data and analytics experts to improve end-to-end data processing systems.
- Mentor data engineers and provide technical guidance and professional development support.
- Help drive technical strategy and grow toward people management responsibilities.
Requirements
- 5+ years of professional experience in data engineering, software engineering, or a closely related field.
- Significant experience designing and maintaining production data or machine learning systems.
- Strong proficiency in Python and SQL, including advanced querying, data transformations, and performance optimization.
- Experience building and maintaining large-scale ETL/ELT pipelines and distributed data processing systems.
- Hands-on experience with data warehouses such as Snowflake or BigQuery, or open table formats such as Iceberg.
- Experience with distributed data processing frameworks such as Apache Spark or Apache Flink.
- Familiarity with workflow orchestration tools such as Apache Airflow, Dagster, or Prefect.
- Experience with cloud infrastructure, preferably AWS or GCP.
- Strong understanding of data modeling, database design, and data architecture principles.
- Experience implementing data quality, monitoring, and reliability practices in production environments.
- Strong analytical, problem-solving, communication, and collaboration skills.
- Ability to independently drive complex technical projects and work across technical and non-technical teams.
- Demonstrated leadership potential and interest in mentoring engineers, building teams, driving technical strategy, and growing into people management.
Tech Stack
Categories
Data Engineering
About Firework
Firework builds an enterprise video commerce platform that lets brands and retailers embed shoppable video, video showrooms, and an AI shopping agent across their sites and channels. The company operates a SaaS model focused on conversion and content operations for DTC and omnichannel commerce. Founded in 2017 and headquartered in San Mateo, it is privately held and backed by investors including SoftBank Vision Fund 2.