over 1 year ago
San Francisco, CA, USAMid Level
Base Salary
$111k - $196k/yr
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL workflows for analytics and reporting.
- Develop and optimize cloud-based data warehouses and data lakes.
- Implement real-time and batch data processing solutions.
- Design data modeling and storage strategies for structured and unstructured data.
- Improve data reliability, consistency, scalability, ingestion, transformation, and validation.
- Collaborate with data analysts, data scientists, and software engineers to enable efficient data access and analysis.
- Monitor and optimize query performance and data processing efficiency.
- Implement data security, compliance, governance, and access-control standards.
- Stay current with data engineering tools, technologies, and trends.
Requirements
- Around 4+ years of experience in data engineering, software engineering, or database management.
- Proficiency in SQL, Python, or Scala for data processing and automation.
- Hands-on experience with AWS Redshift, Google BigQuery, Azure Synapse, or Snowflake.
- Experience building ETL pipelines with Apache Airflow, dbt, Talend, or Fivetran.
- Strong understanding of data modeling, schema design, and database optimization.
- Big data framework experience with Apache Spark, Hadoop, Kafka, or Flink is a plus.
- Familiarity with orchestration tools, Docker, Kubernetes, and CI/CD workflows.
- Knowledge of data security, governance, and compliance, including GDPR, CCPA, and SOC 2.
- Strong problem-solving and debugging skills for large-scale data challenges.
- Experience working in fast-paced, data-driven, cross-functional environments.
Benefits
- Apple hardware ecosystem for work.
- Annual bonus.
- Medical insurance including vision and dental coverage.
- Short- and long-term disability insurance.
- 401k contribution up to 4%.
- Air Conference for team collaboration and professional growth.
- Transportation budget.
- Free meals at the hub.
- Gym membership.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache HadoopApache KafkaApache SparkAWSAzuredbtDockerGoogle BigQueryGoogle CloudKubernetesPythonScalaSnowflakeSQLTalend
Categories
Data Engineering
About Air Apps
Air Apps develops and publishes consumer mobile apps for iOS and Android across productivity, utilities, fitness, creativity, and learning. Founded in 2018 in Lisbon and now operating from Lisbon and San Francisco, the privately held company is self-funded and reports over 100 million worldwide downloads across 30+ titles. Current work includes an AI-powered Personal & Entrepreneurial Resource Planner.