Senior Software Engineer II - Data Engineering and Platform
LG Ad Solutions8 months ago
Bengaluru, IndiaSenior / Staff+
Responsibilities
- Design, develop, and deploy scalable data solutions including ETL pipelines and data warehousing.
- Develop and execute the strategic vision for the data platform.
- Collaborate with product managers and engineering teams for effective data integration.
- Identify and address performance bottlenecks within the data platform.
- Implement data governance frameworks to ensure data quality and compliance.
- Provide technical leadership and mentorship to data engineers.
- Lead code and architecture reviews to maintain high standards.
- Stay updated with emerging technologies in data engineering.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Over 5 years of software development experience, with at least 2 years in a technical leadership role.
- Strong proficiency in big data technologies like Apache Spark, Airflow, and Kafka.
- Experience with programming languages such as Scala and Python.
- In-depth knowledge of relational and non-relational databases.
- Hands-on experience with data visualization tools.
- Proficiency in developing CI/CD pipelines using Jenkins and GitHub Actions.
- Experience with Infrastructure as Code tools like Pulumi and Terraform.
- Strong problem-solving abilities and attention to detail.
- Excellent communication skills for conveying technical concepts.
- Proven ability to collaborate cross-functionally.
- Familiarity with data governance and security practices.
Tech Stack
Categories
Data Engineering