6 months ago
Brazil (city not specified)Senior
Responsibilities
- Design and maintain large-scale batch and streaming data ingestion and transformation pipelines.
- Ensure data quality, reliability, integrity, versioning, testing, monitoring, and observability throughout the data lifecycle.
- Implement and evolve data architecture on GCP using BigQuery, Cloud Storage, Pub/Sub, and Composer.
- Collaborate with Analytics, Product, and Engineering teams to define data needs and translate business requirements into technical solutions.
- Contribute to data engineering best practices and internal standards for models, naming, monitoring, governance, and documentation.
Requirements
- Hands-on experience using AI tools throughout the data development lifecycle, including troubleshooting, operational automation, incident analysis, and engineering task acceleration with reliability and observability practices.
- Solid experience with Python and SQL; Java or Scala experience is preferred.
- Experience with Airflow, Airbyte, or equivalent orchestration and replication frameworks.
- Knowledge of data modeling and design practices such as Kimball, Data Vault, and Medallion.
- Experience with GCP, including BigQuery, Cloud Storage, Pub/Sub, Composer, and IAM.
- Familiarity with Kafka, Dataflow, or Beam for streaming is a plus.
- Experience with Terraform and infrastructure-as-code practices.
- Experience with data observability, DAG monitoring, alerts, data quality, standardization, governance, and technical documentation is preferred.
- Solid experience with Apache Flink and analytical table catalogs and formats is a plus.
- Product-oriented mindset and ability to collaborate across disciplines.
Benefits
- Fully remote work model, allowing the employee to choose where to live without losing the role.
Tech Stack
AirbyteApache AirflowApache BeamApache FlinkApache KafkaGoogle BigQueryGoogle CloudGoogle Cloud PlatformJavaPythonScalaSQLTerraform
Categories
Data Engineering
About Jusbrasil
Jusbrasil builds a Brazilian legal-information platform that aggregates court cases, decisions, legislation, and legal content for lawyers, legal teams, students, and citizens. Its business model combines subscriptions for legal research tools—now including the Jus IA assistant—with services that help attorneys reach potential clients. Founded in 2008 and headquartered in Salvador, Bahia, it is privately held and has raised a Series A round in 2016.