Senior Data Engineer (GCP) - AI Platforms
WillowTree12 months ago
São Paulo, BrazilSenior
Responsibilities
- Develop and optimize scalable, high-performing, secure, and reliable data pipelines.
- Identify process improvements, automate manual tasks, and contribute to infrastructure redesign.
- Design and develop data architectures and support data integration, storage, and processing.
- Collaborate with data scientists, software engineers, project managers, product owners, and other stakeholders to ensure data quality and plan development work.
- Mentor junior engineers and share technical expertise with team members.
- Research and adopt technologies, libraries, frameworks, and best practices that improve data capabilities.
- Consider accessibility and the impact of the work on others.
Requirements
- Bachelor’s, master’s, or doctoral degree in statistics, mathematics, physics, computer science, or a related subject.
- At least three years of experience as a data engineer.
- Experience in technology-related fields, including industry or academic research in areas such as BI, software, data science, or data engineering.
- Experience designing data architectures and developing and optimizing data pipelines.
- Experience with databases, data modeling, and SQL.
- Experience with a general-purpose programming language such as Python or Scala.
- Effective English communication skills for explaining technical and non-technical concepts.
- Ability to collaborate effectively, work independently, manage multiple tasks, and meet deadlines.
- Preferred experience with AWS, GCP, Azure, Hadoop, Spark, Kafka, Airflow, NoSQL databases, Docker, and Kubernetes.
Benefits
- Flexible hours and autonomy.
- Opportunities to work with cutting-edge technologies and global brands.
- Collaborative team and learning ecosystem with a career development and growth plan.
- Optional international travel opportunities.
- Health and dental plan.
- Life insurance.
- Monthly voucher for meals, culture, education, health, and mobility.
- Child care assistance and additional benefits.
- Role is based in São Paulo-SP or Porto Alegre-RS, Brazil.
Tech Stack
Apache AirflowApache HadoopApache KafkaApache SparkAWSAzureDockerGoogle Cloud PlatformKubernetesPythonScalaSQL
Categories
Data Engineering
About WillowTree
WillowTree is a digital product consultancy that designs and builds mobile apps, websites, and omnichannel experiences for large enterprises and consumer brands. Its services include custom app development, web development, marketing automation, and data/AI integrations, delivered as fee-for-service consulting. Headquartered in Charlottesville, VA, WillowTree is part of TELUS Digital and has worked with clients such as T-Mobile and Marriott.