Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Captivation Software7 days ago
Annapolis Junction, MD, USASenior
Base Salary
$130k - $270k/yr
Responsibilities
- Design, implement, and optimize scalable data ingress and egress pathways.
- Develop dataflow designs and data transport mechanisms for analytics workloads.
- Use Apache Airflow to design, schedule, orchestrate, and monitor complex workflows.
- Use Apache Spark and other distributed big data processing engines.
- Develop Bash scripts to automate manual processes.
- Query, join, and aggregate large datasets using SQL technologies.
- Perform data wrangling and preprocessing with pandas and NumPy.
- Work with structured, semi-structured, and unstructured data formats.
- Apply data quality, validation, and anomaly detection practices.
- Use Git for source control.
Requirements
- Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable polygraph and be a U.S. citizen.
- Master's degree in Computer Science or a related discipline plus five years of relevant software engineering experience, bachelor's degree plus seven years, or nine years of relevant software engineering experience.
- Experience using the Linux CLI and Linux tools.
- Experience developing Bash scripts.
- Recent software development experience using Python and Java.
- Experience with Apache Airflow, including DAG design, scheduling, operators, and sensors.
- Experience with Apache Spark or comparable distributed big data processing engines.
- Familiarity with MySQL, MariaDB, and PostgreSQL for large-dataset querying, joining, and aggregation.
- Experience using Jupyter Notebook.
- Experience with pandas and NumPy for data wrangling and preprocessing.
- Experience working with Parquet, JSON, CSV, and XML data.
- Experience with Git source control.
- Preferred familiarity with Slurm for HPC job scheduling.
- Preferred experience with Jira and Confluence through the Atlassian Tool Suite.
Benefits
- Annual salary of $130,000-$270,000 depending on years of experience.
- Up to 20% 401k contribution with no matching required and vesting from day one.
- Above-market hourly rates.
- $3,600 HSA contribution.
- Six weeks of paid time off.
- Company-paid employee medical, dental, vision, life, short-term disability, long-term disability, and AD&D insurance.
- Direct-hire position; third-party staffing and recruiting firms are not considered.
Tech Stack
Apache AirflowApache SparkBashGitJavaJupyter NotebookLinuxMariaDBMySQLNumPyPandasPostgreSQLPythonSQL
Categories
Data Engineering
About Captivation Software
Captivation Software builds custom full-stack web, cloud, and mobile applications and provides DevSecOps consulting for U.S. government and intelligence programs. The privately held company earns revenue through engineering services and prime/subcontract work, delivering analytics, big data, and AI software to mission-focused agencies. Founded in 2014 and headquartered in Hanover, Maryland, it focuses on projects for the Intelligence Community and defense customers in the Mid-Atlantic.