Software Engineer II, Data Engineering
Brain Corp11 days ago
San Diego, CA, USAMid Level / Senior
Base Salary
$130k - $130k/yr
Responsibilities
- Design and develop robust, scalable data pipelines for processing structured and unstructured data.
- Contribute to the design of complex data models and optimize storage solutions.
- Enhance the efficiency and scalability of data pipelines and storage systems.
- Collaborate with data analysts, data scientists, and business teams to support data-related technical issues.
- Implement security best practices, including encryption and access control policies.
- Monitor and troubleshoot data pipeline failures and reliability issues.
Requirements
- BS or MS in Computer Science or applicable engineering discipline.
- 2-5 years of proven software development experience, with at least 2 years focused on data engineering.
- Proficiency in SQL and one or more programming languages (Python, Go, or TypeScript).
- Experience with data warehousing technologies (BigQuery, Snowflake, MySQL, PostgreSQL).
- Familiarity with stream processing frameworks (Apache Beam, Pub/Sub, Spark Streaming).
- Understanding of data governance, security, and compliance best practices.
- Strong problem-solving skills and ability to work independently.