Bristlecone

Big Data Engineer

Bristlecone
Apply
12 hours ago
Bengaluru, IndiaMid Level / Senior

Responsibilities

  • Analyze complex systems and collaboratively design new products and services using Spark, Python, and Scala.
  • Integrate new data sources and tools.
  • Implement scalable and reliable distributed data replication strategies.
  • Design, develop, and deploy data tools for operational and product use cases.
  • Perform analysis of large datasets using AWS Cloud components.
  • Own product features from development and testing through production deployment.
  • Evaluate big data technologies and prototype improvements to data-processing architecture.
  • Automate data pipelines and other development, testing, and operational workflows.

Requirements

  • 4–7 years of experience delivering enterprise software solutions.
  • Proficiency with Java, Spark, Scala, Python, and AWS Cloud technologies.
  • At least 2 years of experience with multiple Spark technologies such as MapReduce, Hive, Kafka, and Scala.
  • Knowledge of data schemas, data models, data ingestion, transformation, and big data lifecycle efficiency.
  • Experience with Agile Development methodologies.
  • Understanding of secure application development and automated QA for big data technologies.
  • Strong object-oriented design and analysis skills.
  • Excellent written and verbal communication skills.
  • Preferred experience with Airflow and Python.
  • Knowledge of cloud technologies and AWS services.
  • Knowledge and hands-on experience using AI technologies for development, testing, and automation.

Tech Stack

Apache AirflowApache HiveApache KafkaApache SparkAWSJavaPythonScala

Categories

Data Engineering
Bristlecone

About Bristlecone

1,001-5,000 employees

Bristlecone provides supply chain consulting and systems integration, delivering planning, sourcing, and fulfillment solutions for Global 2000 enterprises. Its teams implement platforms such as SAP Integrated Business Planning and Kinaxis, alongside analytics, data, and integration services. Founded in 1998 and headquartered in San Jose, it operates worldwide and is part of the Mahindra Group. Its business model centers on advisory, implementation, and managed services for life sciences, retail, consumer goods, manufacturing, and high tech.

Contact me