2 months ago
Palo Alto, CA, USAMid Level
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL workflows.
- Build, automate, and optimize data infrastructure for analytics, reporting, and machine learning applications.
- Ensure data quality, consistency, and security across data sources and sinks.
- Collaborate with engineering, analytics, and product teams to define data requirements and deliver reliable datasets.
- Implement monitoring solutions and proactively resolve data pipeline issues.
- Optimize storage and data processing performance for growth and efficiency.
- Contribute to data modeling and schema design for analytics and product needs.
- Establish data engineering best practices and support a data-driven culture.
Requirements
- 4+ years of experience as a data engineer or in a similar role designing, building, and maintaining data infrastructure.
- Strong software engineering background with proficiency in Python, SQL, and/or similar languages.
- Hands-on experience with data pipeline orchestration tools such as Airflow, Prefect, or Dagster.
- Experience with cloud data platforms such as AWS, GCP, Redshift, BigQuery, or Snowflake.
- Knowledge of database systems, data modeling, and data warehousing best practices.
- Familiarity with monitoring, logging, and data quality practices for data workflows.
- Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
- Experience supporting data for machine learning or AI-powered applications is preferred.
- Familiarity with real-time or streaming data architectures such as Kafka or Kinesis is preferred.
- Experience at high-growth startups, rapid scaling, open source, hackathons, or data engineering communities is preferred.
Benefits
- Competitive salary in the AI industry.
- Substantial equity in a fast-growing startup.
- Comprehensive health benefits, monthly stipends, and company retreats.
- Collaborative, high-growth culture.
- Hybrid in-office work is preferred in Palo Alto, California.
Tech Stack
Amazon RedshiftApache AirflowApache KafkaAWSDockerGoGoogle BigQueryGoogle Cloud PlatformKubernetesNode.jsPostgreSQLPythonRedisSnowflakeSQL
Categories
Data Engineering
About Pika
Pika builds an AI-powered idea-to-video platform that generates and edits short videos from text, images, or rough clips for creators and teams. The company develops its own generative video models and offers a web app used for storytelling, social content, and design workflows. Founded in 2023 and based in Palo Alto, it is a privately held startup in the generative video space.