1 day ago
São Paulo, BrazilSenior
Responsibilities
- Plan and implement enterprise data platforms across AWS and GCP.
- Drive adoption of cloud-native services and enable engineering teams to use core infrastructure effectively.
- Help teams adopt automation and release-process best practices to accelerate cloud migration and digital transformation.
- Partner with security teams to maintain a strong cloud security posture for services and data.
- Administer Databricks Unity Catalog governance across more than 100 projects, including compute policies, cluster custodian rules, and access controls.
- Maintain and extend Terraform and Databricks Asset Bundles CI/CD pipelines using GitHub Actions and AWS CodeBuild.
- Support DDL and access-grant management through Flyway-based migration tooling while maintaining Terraform as the source of truth.
- Analyze and manage FinOps spend across Databricks DBUs, S3 storage, and Snowflake integrations.
- Contribute to multi-cloud strategy and AWS-to-GCP migration planning for AI workloads.
- Design secure, scalable OIDC-based external and third-party access architectures.
- Build and operate centralized observability tooling for data jobs and pipelines, including performance-regression detection.
- Redesign Databricks workspace architecture for catalog-based disaster-recovery tiers and own the eventual DR implementation.
- Maintain working knowledge of AWS and GCP networking, IAM, CloudWatch, and Databricks network connectivity configuration.
Requirements
- At least 3 years of hands-on public-cloud experience with AWS and/or GCP in a fast-paced, high-growth environment.
- At least 2 years of hands-on Databricks experience, including Unity Catalog, Delta Lake, and Databricks Asset Bundles.
- At least 1 year of Snowflake experience, including data warehousing, access management, and cross-platform integrations.
- Bachelor’s degree in information science, computer science, engineering, or a related IT-focused discipline.
- Experience contributing within cross-functional technology teams.
- Fluency in written and spoken English.
- Strong knowledge of Python, Terraform, or Ansible, including the Databricks Terraform provider and Databricks Asset Bundles.
- Experience with Docker, EC2, Auto Scaling Groups, Lambda, ECS, or EKS.
- Foundational knowledge of VPC, Transit Gateway, Direct Connect, Application Load Balancer, Network Load Balancer, and PrivateLink.
- Experience with Databricks Unity Catalog governance, access controls, and compute-policy management.
- Experience with GitHub Actions and AWS CodeBuild for data-platform deployments.
- Knowledge of generative AI and AI/ML techniques, including Databricks MLflow and Model Serving workflows.
- Experience with observability and monitoring for data pipelines and workflows.
- Experience with FinOps principles and analysis of Databricks DBU, S3, and Snowflake spend.
- Familiarity with Flyway or Liquibase database-migration tooling.
- Understanding of IAM patterns, including OIDC authentication for external client access.
- Experience with multi-cloud environments, especially AWS and GCP, and cross-cloud data and AI workload migration.
- Strong communication, analytical, strategic, creative, pragmatic, and decision-making skills.
Tech Stack
Categories
About FactSet
FactSet builds a financial data and analytics platform used by asset managers, investment banks, hedge funds, and wealth managers for research, portfolio management, trading, and risk. Its products include the FactSet workstation, data feeds and APIs, and workflow tools like OMS/EMS, sold primarily via subscription licensing. Founded in 1978 and headquartered in Norwalk, Connecticut, FactSet is a public company listed on the NYSE (ticker: FDS).