
Data Engineer
S&P Global2 days ago
Hyderābād, IndiaMid Level
Responsibilities
- Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
- Implement and maintain services and tools supporting existing data feed systems.
- Design, manage, and optimize complex data pipelines, workflows, ETL processes, and data models.
- Develop clean, modular, and testable code for data processing tasks.
- Maintain and develop software in production environments using cloud-based tools.
- Collaborate with information architecture, data integration, and broader technology teams to align pipelines with strategic initiatives.
- Support scalable acquisition, ingestion, content management, mastering, and distribution of datasets.
- Communicate technical concepts to non-technical stakeholders and work effectively with global teams.
Requirements
- Bachelor’s degree in computer science or a related field.
- At least 4+ years of professional software development experience.
- Proficiency in programming or scripting languages used for data processing, including object-oriented or functional languages.
- Experience with data orchestration and workflow management systems, distributed data processing frameworks, and large-scale data processing platforms.
- Strong understanding of RESTful services, API design, and object-oriented programming principles.
- Good working knowledge of relational and NoSQL databases, including querying and data modeling.
- Experience developing and maintaining production software using cloud-based tools.
- Strong experience in distributed data processing, optimization, ETL pipeline design, and scalable data architecture.
- Strong collaboration, teamwork, written communication, and verbal communication skills.
- Agile experience is desirable.
- Experience with data warehousing and analytics platforms is advantageous.
- Experience with CI/CD pipelines, GitHub, and DevOps practices is required or strongly preferred.
- Familiarity with data lake and data warehouse architectures is preferred.
- Exposure to real-time data processing frameworks and observability tools such as Grafana is advantageous.
Benefits
- Health care coverage and wellness benefits.
- Generous paid time off and flexible downtime.
- Continuous learning and career development resources.
- Competitive pay, retirement planning, continuing education, company-matched student loan contributions, and financial wellness programs.
- Family-friendly benefits and perks.
- Retail discounts and referral incentive awards.
Tech Stack
Grafana
Categories
Data Engineering