GrepJob
Black Canyon Consulting

Senior Platform Engineer (DataOps)

Black Canyon Consulting
Apply
about 1 month ago
Bethesda, MD, USASenior
H1B Sponsor

Responsibilities

  • Develop and continuously improve the DataOps platform.
  • Develop and maintain common tools and libraries.
  • Evaluate new technologies and practices.
  • Assist NCBI developers with platform adoption.
  • Ensure compliance with federal application security regulations.
  • Embrace agile development and continuous improvement.
  • Encourage a growth mindset and offer leadership opportunities.

Requirements

  • 7+ years of experience in the field.
  • Strong coding skills in at least one programming language (Python, C++, etc.).
  • Experience with Kubernetes and containerization.
  • Familiarity with cloud services like GCP, AWS, or Azure.
  • Experience with Apache Kafka or equivalent.
  • Knowledge of Apache AirFlow or equivalent.
  • Experience with data processing applications and cloud-based infrastructure.
  • Linux command-line skills.

Benefits

  • Medical, dental, and vision coverage.
  • 401k plan with employer contribution.
  • Paid holidays and vacation.
  • Flexible work schedule.
  • Tuition reimbursement.

Tech Stack

Apache AirflowApache KafkaApache SparkApache StormAWSAzureC++DatadogDockerElasticsearchGoogle Cloud PlatformInfluxDBKibanaKubernetesLinuxPrometheusPythonRabbitMQSplunkTeamCityTerraform

Categories

Data EngineeringDevOps