3 hours ago
Remote, PolandSenior
Responsibilities
- Design and implement internal SDKs and self-service frameworks for distributed teams to ingest and transform data autonomously.
- Create reusable patterns for batch and real-time event processing as part of a platform engineering strategy.
- Optimize Databricks and Spark execution, shuffle partitions, autoscaling, performance, and DBU consumption.
- Manage trade-offs among data latency, throughput, platform performance, and cloud spend.
- Implement schema-on-write validation and data contracts before data reaches the Bronze layer.
- Partner with data architecture and stewardship teams on privacy, security, metadata lineage, and data quality.
- Mentor engineers on distributed computing and conduct code reviews focused on scalability and maintainability.
- Champion AI-assisted development tools to accelerate engineering delivery and improve code quality.
Requirements
- At least 5 years of experience building and operating production-grade data systems at massive scale.
- Deep hands-on expertise with the Databricks and Spark ecosystem, including Delta Lake, DLT, Spark UI debugging, and performance tuning.
- Proven experience building production real-time or streaming architectures using Spark Structured Streaming, Kafka, or Kinesis.
- Experience managing and optimizing cloud costs in a high-growth environment.
- Experience building APIs, tools, or frameworks used by internal engineering teams.
Benefits
- Generous paid parental leave, flexible time off, spending accounts, medical, dental, and vision insurance, and a sabbatical after five years.
- Full-time regular employees in non-sales roles may be eligible for an annual bonus based on individual and company performance.
- The company describes its teams as remote-first and offers flexibility and resources.
Tech Stack
Categories
Data Engineering
About G-P
G-P (Globalization Partners) builds a SaaS-based global employment platform with Employer of Record services that let companies hire, onboard, and pay talent in 180+ countries while handling payroll, benefits, and compliance. The remote-first, privately held company earns revenue through platform subscriptions and service fees for EOR, immigration, and compliance support. Founded in 2012, it serves organizations expanding internationally across a range of industries and sizes.