Staff Data Platform Engineer
OXIO Corporation6 months ago
Remote, Worldwide +3 moreStaff+
Responsibilities
- Architect, build, and scale a unified data platform integrating internal and external sources.
- Design and implement streaming and batch data pipelines using tools like Spark, Airflow, and DBT.
- Lead infrastructure provisioning using Terraform and Kubernetes for secure deployments.
- Evaluate and drive the migration to a North Star data architecture.
- Collaborate with cross-functional teams to define logging standards and data contracts.
- Drive best practices in data governance and privacy compliance.
- Build APIs and data services for real-time activation and data sharing.
- Participate in strategic architectural decisions and long-term data roadmap planning.
- Evangelize modern data platform practices across the organization.
- Mentor junior engineers and contribute to team growth.
Requirements
- 15+ years of experience in software engineering with a focus on data systems.
- 10+ years of experience building data solutions using data lakehouse architectures.
- 10+ years of hands-on programming experience with Scala, Go, Python, and SQL.
- 5+ years of experience building scalable data solutions using Python, Spark, and Terraform.
- Proven experience building serverless and scalable ML infrastructure.
- Deep expertise in cloud-native data stacks like AWS, Databricks, and Snowflake.
- Strong understanding of microservices architecture and event-driven systems.
- Experience with orchestration tools like Airflow and transformation tools like DBT.
- Proficient in building and scaling APIs for data access and activation.
- Familiarity with front-end technologies like React is a plus.
Benefits
- Competitive salary and stock option incentive program.
- Company paid healthcare.
- Flexible work arrangements.
- Company sponsored team lunches and retreats.
- Opportunity to work in an international organization with diverse teams.