7 days ago
Bengaluru, IndiaSenior
Responsibilities
- Build and maintain monitoring dashboards for data-pipeline latency, failures, and SLAs.
- Design, develop, monitor, troubleshoot, tune, and support Apache NiFi data flows for enterprise data integration and ingestion.
- Implement distributed tracing and logging across ingestion, processing, and storage layers.
- Configure real-time alerts using Grafana, Datadog, Azure Monitor, CloudWatch, and similar tools.
- Improve pipeline performance, scalability, error handling, and flow optimization.
- Capture metadata consistently using data-catalog tools.
- Investigate pipeline failures and performance issues, conduct root-cause analysis, and implement preventive automation.
- Collaborate with Data Engineers, SRE/DevOps, Platform Teams, and Product Owners.
- Provide pipeline-health insights to business stakeholders and influence platform-wide observability standards.
Requirements
- At least 7.5 years of experience in Data Engineering is required; the role also describes a 4–8 year range for Data Engineering, Observability, or Platform Engineering experience.
- Bachelor's or master's degree in computer science or equivalent, with a score of 6 GPA or above, and 15 years of full-time education.
- Strong understanding of modern batch and streaming data pipelines.
- Experience with at least one cloud ecosystem: Azure, AWS, or GCP.
- Proficiency with monitoring and observability platforms such as Datadog, Grafana, CloudWatch, Azure Monitor, or Dynatrace.
- Hands-on Apache NiFi experience covering flow design, development, performance tuning, troubleshooting, production support, monitoring, observability, error handling, and optimization.
- Hands-on experience with Kafka, Spark Streaming, EventHub, or equivalent streaming technologies.
- Understanding of Docker, Kubernetes, APIs, microservices, CI/CD, software development life cycle, and version control such as GitHub.
- Programming or scripting skills in Python, SQL, Bash, or similar languages.
- Good database knowledge, including RDBMS concepts, nested queries, and record maintenance.
- Experience with logging, alerting, monitoring, on-premises or cloud infrastructure, services, and performance.
- Strong written and verbal communication skills and familiarity with Agile methodologies and project execution.
Benefits
- The position is based at the Accenture Bengaluru office.
Tech Stack
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.