Bigdata Engineer - E6871

Nisum

over 1 year ago

Hyderābād, India

Senior / Mid Level

H1B Sponsor

Responsibilities

Analyze complex systems and design new products and services using software engineering skills.
Integrate new data sources and tools into existing systems.
Implement scalable and reliable distributed data replication strategies.
Mentor and provide architectural direction to onsite/offshore developers.
Collaborate with teams to develop and deploy data tools for operations and product use cases.
Perform analysis of large datasets using Hadoop ecosystem components.
Own product features from development through to production deployment.
Evaluate big data technologies and prototype solutions for data processing architecture.
Automate processes to improve efficiency.

5-6 years of experience delivering enterprise software solutions.
Proficient in Java, Spark, Scala, Python, and AWS Cloud technologies.
3+ years of experience with Hadoop/Spark technologies like HDFS, HBase, Hive, and Kafka.
Strong understanding of data models and efficiency in big data lifecycle.
Ability to translate technical and business requirements into implementations.
Experience with Agile Development methodologies.
Experience in data ingestion and transformation processes.
Solid understanding of secure application development methodologies.
Preferred experience with Airflow and Python.
Strong object-oriented design and analysis skills.
Excellent written and verbal communication skills.

Year-round training sessions for skill enhancement certifications.
Opt-in parental medical insurance in addition to standard medical benefits.
Participation in team-building activities like cricket tournaments and hack-a-thons.
Free snacks and dinner daily, with subsidized lunch.

Apache AirflowApache HadoopApache HBaseApache HiveApache KafkaApache SparkAWSJavaPythonScala