Lead Data Engineer
ThoughtWorks2 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Lead and manage data engineering projects from inception to completion, including goal setting, scope definition, delivery, and cross-team collaboration.
- Collaborate with stakeholders and clients to understand strategic objectives and identify opportunities to use data and improve data quality.
- Design, develop, deploy, support, and operate modern data architectures and end-to-end data solutions.
- Create and develop complex data-processing pipelines for challenging client problems.
- Collaborate with data scientists to design scalable implementations of their models.
- Advise clients on distributed storage and computing technologies and develop data models using appropriate modeling techniques.
- Establish and implement data governance, security, privacy, and data-quality practices.
- Coach, mentor, motivate, and guide teammates while advocating for technical excellence.
Requirements
- 10+ years of experience leading the design and implementation of technical solutions.
- Experience creating Big Data architectures, building and operating data pipelines, and maintaining data storage in distributed systems.
- Deep understanding of data modeling and modern data engineering tools and platforms.
- Experience writing clean, high-quality code in a preferred programming language.
- Production experience building and deploying large-scale data pipelines and data-centric applications using distributed storage and processing platforms.
- Experience with data visualization techniques and communicating insights to different audiences.
- Experience applying data-driven approaches and data security and privacy strategies to business problems.
- Experience with SQL, NoSQL, data lakes, and data schemas.
- Strong stakeholder management, communication, adaptability, conflict management, mentoring, leadership, and relationship-building skills.
Benefits
- Interactive tools, development programs, and supportive teammates to help employees grow and develop their careers.
- Hybrid work arrangement, as indicated by the job posting.
Tech Stack
Categories
Data Engineering
About ThoughtWorks
Thoughtworks is a global technology consultancy that designs and builds custom software, data platforms, and cloud-native systems for enterprises across industries. Its services-based model spans product discovery, agile delivery, platform modernization, and advisory on digital transformation and AI. Founded in 1993 and headquartered in Chicago, it listed on Nasdaq in 2021 (TWKS) and remains backed by private-equity firm Apax Partners.