Senior Data Engineer
HostPapa Inc.7 days ago
Remote, WorldwideSenior
Responsibilities
- Build and maintain a high-volume, high-performance data fabric covering real-time ingestion, data pipelines, storage, and analytics.
- Own features from technical design and implementation through testing and production.
- Develop AI-powered workflows and capabilities and drive AI adoption across the platform.
- Design and integrate APIs connecting data, services, and business workflows.
- Collaborate with engineers, Product Managers, and other teams to develop scalable technical solutions.
- Ensure data quality, reliability, observability, performance, and production SLOs across pipelines.
- Work with the Engineering Manager on professional growth and career development.
- Support additional tasks and projects as needed by the team and business.
Requirements
- Strong professional software engineering experience building data-intensive systems.
- Extensive experience building data pipelines and data models for production-scale workloads.
- Hands-on experience with Python.
- Strong expertise with event-streaming technologies such as Kafka, NATS, Flink, or similar; streaming experience is essential.
- Experience with Azure, AWS, or GCP and containerized workloads using Docker and Kubernetes.
- Understanding of data contracts, data quality, pipeline observability, and production SLOs.
- Experience with AI-assisted development tools and applying AI to engineering problems and development workflows.
- Strong experience designing and integrating APIs.
- Strong knowledge of PostgreSQL and relational databases.
- Experience with unit and end-to-end testing and building reliable, production-ready systems.
- Professional working proficiency in English and the ability to collaborate in a distributed international environment.
- Familiarity with billing, finance, or usage-based or metered monetization is preferred.
- Exposure to RAG, MCP, agent runtimes, Anthropic APIs, OpenAI APIs, or similar AI technologies is advantageous.
- Experience with lakehouse or data federation technologies such as Iceberg, Trino, or similar is beneficial.
Benefits
- Remote-first work with team members across many countries.
- Competitive market-benchmarked pay.
- Professional development support and room to grow with ownership of work.
- Flexible working arrangements within required team core hours.
- Access to AI tools and opportunities to experiment with them.
Tech Stack
Categories
Data Engineering