AWS Data Engineer
Virtual Service Operations, Inc.27 days ago
Washington, DC, USASenior
Base Salary
$220000k - $260000k/yr
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines for structured and semi-structured data.
- Build and optimize AWS-based data solutions using Glue, S3, Lambda, Redshift, EMR, Athena, and Step Functions.
- Develop performant and maintainable data processing jobs with Python, PySpark, and SQL.
- Model data lakes and warehouses through schema design, partitioning, and cataloging.
- Implement data quality checks, monitoring, logging, and alerting for production pipelines.
- Apply IAM, encryption, least-privilege, security, and compliance practices for federal workloads.
- Support CI/CD and infrastructure-as-code practices for data workloads.
- Collaborate with stakeholders, troubleshoot issues, and document solutions.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience.
- At least 5 years of data engineering or ETL development experience.
- At least 3 years of hands-on experience with AWS data services, including Glue, S3, Lambda, Redshift, Athena, and EMR.
- The posting also specifies 8+ years of professional experience.
- Strong proficiency in Python and SQL, with experience using PySpark or Spark.
- Experience building and supporting production ETL pipelines with large datasets.
- Understanding of data warehousing, dimensional modeling, and data lake architecture.
- Experience with Git and Agile delivery.
- Strong written and verbal communication skills and the ability to work with technical and non-technical stakeholders.
- Preferred qualifications include AWS certifications, Terraform or CloudFormation experience, Airflow or Step Functions experience, familiarity with Databricks, Snowflake, or Informatica, streaming experience with Kinesis or Kafka, federal or financial-regulatory data experience, and FedRAMP or other compliance-driven environment experience.
- Active TS/SCI clearance and U.S. citizenship are required.
Benefits
- Ongoing learning and professional development opportunities.
- Health benefits, retirement benefits, and additional benefits for eligible employees.
- Competitive salary.
- Flexible work arrangements are offered, while this specific role is stated to be onsite in the DC Metro Area.
Tech Stack
Amazon RedshiftApache AirflowApache KafkaApache SparkAWSDatabricksGitInformaticaPythonSnowflakeSQLTerraform
Categories
Data Engineering
About Virtual Service Operations, Inc.
Virtual Service Operations (VSO) is a privately held IT services firm founded in 2017 and headquartered in Manassas, Virginia. It delivers managed IT and hybrid-cloud operations, cloud migration, end-user services, network consulting, and IT financial management, anchored by its FogLifter platform. VSO serves large commercial enterprises and U.S. federal and defense customers, including projects in classified DoD environments, providing cybersecurity support and TBM/IT financial management advisory.