
Data Engineer- SME
SOS International LLC2 months ago
Huntsville, AL, USASenior
Responsibilities
- Build and maintain data pipelines, ETL processes, and storage systems.
- Design end-to-end data architectures and infrastructure.
- Lead teams building complex data pipelines and machine learning systems.
- Develop services and extend infrastructure to enable machine learning workflows.
- Integrate software components into functional data systems.
- Write clean, testable, and maintainable code in Python and other languages.
- Implement CI/CD pipelines and DevSecOps best practices.
- Create technical documentation for software systems.
- Collaborate across teams to share knowledge and leading practices.
- Partner with Data Scientists and end users to automate manual workflows and produce MLOps-based workloads.
Requirements
- Top Secret security clearance with SCI eligibility.
- At least 7 years of experience as a Data Engineer, Data Scientist, or in an advanced analytical role.
- Experience in data engineering and/or software development.
- Expertise with Python, Git, YAML, Docker, and SQL.
- Knowledge of CI/CD and Agile methodologies.
- Experience developing back-end systems and services.
- Understanding of software design and system integration.
- Preferred: significant experience with petabyte-scale data sets and large-scale, multi-INT analytics.
- Preferred: BS or MS in Computer Science, Statistics, Mathematics, Physics, or a quantitative field.
Tech Stack
Apache AirflowApache KafkaApache SparkArgo CDDockerGitHarnessKubernetesLinuxMongoDBNeo4jPostgreSQLPythonPyTorchSQLTensorFlow
Categories
Data EngineeringML Engineering