Capco

Senior Data Engineering - PSM-Libra

Capco
Apply
3 months ago
Bengaluru, IndiaSenior

Responsibilities

  • Collect, store, process, and analyze large structured, message, semi-structured, and unstructured datasets.
  • Select, implement, maintain, and monitor scalable data-processing solutions.
  • Integrate data solutions with company architecture and build core services supporting machine learning and analytics systems.
  • Integrate multiple large data sources and databases into unified systems.
  • Lead and collaborate with local and globally distributed teams and stakeholders.
  • Develop applications and querying solutions using Hive and Spark/PySpark.
  • Support continuous integration, continuous deployment, software testing, and delivery within tight deadlines.

Requirements

  • Strong knowledge of distributed computing and scalable application design principles.
  • Experience with Hortonworks or Cloudera big-data platforms and HDFS.
  • Strong Scala skills and experience with Python, particularly the Anaconda environment and Python-based machine-learning model deployment.
  • Practical experience with Hive and Spark/PySpark querying tools.
  • Experience with Jenkins or Hudson and Ansible for continuous integration and deployment.
  • Knowledge of at least one Python web framework, preferably Flask, Tornado, or Twisted.
  • Experience with Google Cloud Platform, including Data Proc or Dataflow.
  • Knowledge of the Elasticsearch Stack (ELK).
  • Experience using Git or GitLab for version control.
  • Knowledge of financial-markets domains such as parties or clients, trades, settlements, payments, instruments and pricing, or market and credit risk.
  • Understanding of global markets, market macrostructure, and macroeconomics.
  • Good knowledge of SDLC and formal Agile processes, with a bias toward TDD and willingness to test products.
  • Strong written and spoken communication skills and ability to synthesize differing stakeholder opinions and priorities.
  • Basic front-end knowledge of JavaScript, HTML5, and CSS3 is a plus.

Benefits

  • The role offers opportunities to work on transformation projects for major banks, insurers, payment providers, and other financial-services organizations.
  • Capco describes an open, inclusive culture with opportunities for career growth and no forced hierarchy.

Tech Stack

AnsibleApache HiveApache SparkElasticsearchFlaskGitGoogle Cloud PlatformJavaScriptJenkinsPythonScala

Categories

Data Engineering
Capco

About Capco

5,001-10,000 employees

Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.

Contact me