Staff Data Solutions Engineer

2 days ago

Pune, IndiaStaff+

Responsibilities

Create high-level and low-level designs covering architecture, schemas, transformations, interfaces, error handling, SLAs, and observability.
Design, build, and maintain scalable data pipelines, data products, and enterprise integration layers.
Integrate LLMs, machine learning, retrieval-augmented generation, AI agents, and unstructured data processing into production applications.
Set standards for software design, testing, CI/CD, monitoring, alerting, documentation, and code quality.
Provide technical leadership and design assurance across internal engineering teams, third-party partners, and delivery squads.
Design for reliability, supportability, observability, cost effectiveness, and lifecycle ownership.
Develop prototypes, evaluate technology options, and identify reusable patterns, shared services, and platform opportunities.
Mentor engineers and contribute to data engineering communities, standards, and practices.

Bachelor’s degree in Computer Science or a related field.
8+ years of hands-on experience designing, building, productionising, and maintaining reliable, scalable data infrastructure and data products.
Experience producing HLD and LLD artefacts, architecture diagrams, data flows, component specifications, API contracts, data models, and operational runbooks.
Strong software engineering practices including design reviews, unit testing, CI/CD development, monitoring, alerting, code review, and documentation.
Development experience in an object-oriented programming language, with Python preferred; Scala, Java, or C# also accepted.
Expert SQL knowledge and experience with large-scale distributed data systems and the full data lifecycle.
Experience integrating AI and machine learning into production systems, including LLM APIs, RAG, vector search, embeddings, or AI agents.
Experience or familiarity with LangChain, LlamaIndex, Hugging Face, Weaviate, CrewAI, AutoGen, Spark, Hadoop, Hive, AWS, Azure, GCP, Alation, or Collibra is desirable.
Ability to lead through technical influence, collaborate effectively, and support continuous learning and improvement.

Hybrid office/remote working arrangement.
Up to 10% travel expected.
Eligible for within-country relocation assistance.
Reasonable workplace adjustments and recruitment accommodations are available for individuals with disabilities.

10,000+ employees

Check out our commenting guidelines 👉 bp.com/CommentsGuide