4 days ago
Remote, PortugalSenior
Responsibilities
- Own catalog-team features from requirements and technical design through implementation, testing, rollout, and production support.
- Extend Apache Polaris while preserving compatibility with the Iceberg REST Catalog specification.
- Build catalog APIs and services for namespaces, tables, views, identities, permissions, and metadata operations.
- Solve distributed-systems problems involving consistency, concurrency, failure recovery, multi-tenancy, and service performance.
- Diagnose production issues using logs, metrics, traces, and service data, then address root causes.
- Write and review design documents and technical specifications.
- Collaborate with query engine, security, platform, and product teams on interfaces and dependencies.
- Improve test coverage, operational tooling, and engineering practices.
- Review code for correctness, security, maintainability, compatibility, and performance.
- Mentor newer engineers and contribute relevant fixes and features upstream to Apache Polaris or other open-source projects.
- Use AI-assisted development tools for comprehension, debugging, and test generation while validating their output.
Requirements
- At least five years of professional software development experience or equivalent practical experience.
- Strong Java skills in a substantial production codebase, with knowledge of data structures, algorithms, concurrency, API design, and distributed systems.
- Experience owning backend or distributed-system features from design through rollout and production support, including estimating work and managing dependencies.
- Ability to turn incomplete product requirements into implementation-ready specifications covering interfaces, invariants, failure cases, security, and acceptance criteria.
- Experience directing AI coding agents, reviewing their plans and output, and correcting unsafe or unsuitable approaches.
- Strong code-review judgment around concurrency, authorization, compatibility, performance, and maintainability.
- Experience validating changes with automated tests, static analysis, and production telemetry, then diagnosing failures and addressing root causes.
- Clear written and verbal communication skills for specifications, design documents, technical discussions, and code reviews.
- Bachelor’s degree in Computer Science or a related field, or equivalent practical experience.
- Bonus qualifications include Apache Polaris, Apache Iceberg, Iceberg REST Catalog, metadata catalogs, authorization systems, credential vending, policy enforcement, multi-tenant cloud services, databases, transaction isolation, consistency models, Kubernetes, public cloud infrastructure, Apache Spark, Apache Flink, Trino, and open-source contributions.
Tech Stack
Categories
About Dremio
Dremio builds a unified data lakehouse platform for self-service analytics and AI, enabling SQL-based access and federated queries across cloud, hybrid, and on‑prem data, powered by Apache Iceberg and Apache Arrow. It sells enterprise software and cloud services to data engineering, BI, and data science teams; customers include Maersk and S&P Global. Founded in 2015 and headquartered in Austin, Dremio is now part of SAP.