Data Engineer - Clearance Required
Logistics Management Institute4 months ago
Remote, United States or Pittsburgh, PA, USAMid Level / Senior
Base Salary
$101k - $175k/yr
Responsibilities
- Lead data engineering efforts in Palantir Foundry, including ontology design, pipeline development, and data integration for Army AI2C applications.
- Build, maintain, and optimize Foundry pipelines using Python-based transforms, PySpark, Pipeline Builder, Code Repositories, and Foundry’s data connection framework.
- Develop and maintain Databricks workflows using notebooks, Delta Lake tables, and Spark jobs.
- Write reusable and reliable code using Python, PySpark, SQL, and TypeScript/JavaScript for Foundry Workshop or Slate applications.
- Translate data science and analytics outputs into governed, reusable data products in Foundry and Databricks.
- Integrate AI/ML capabilities into Foundry and Databricks applications and identify opportunities for emerging AI technologies.
- Provide technical leadership and mentorship across Foundry and Databricks.
- Collaborate with data scientists, UX designers, and software developers using Git, code reviews, and Agile practices.
- Consult with Army managers and representatives to identify data platform needs, develop data-driven solutions, and expand strategic customer relationships.
- Communicate technical concepts to non-technical stakeholders and influence strategic decisions.
Requirements
- Bachelor’s degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or a related field, or equivalent work experience.
- 3–5 years of data engineering experience, including hands-on development and operation of applications on Palantir Foundry (Vantage).
- Experience with Foundry pipeline development, PySpark/Pipeline Builder, Code Repositories, ontology/object modeling, and Foundry Workshop application development.
- Experience with Databricks, including notebooks, Delta Lake, and Spark-based data processing.
- Proficiency in Python and SQL for data manipulation and pipeline development, including tools such as pandas, PySpark, or NumPy.
- Familiarity with data visualization approaches such as D3.js, Plotly, Recharts, or Foundry-native Workshop widgets.
- Experience planning, analyzing, designing, implementing, testing, and maintaining enterprise data pipelines and applications.
- Familiarity with Git, Agile methodologies, CI/CD, and automated deployments.
- Experience in technical leadership, mentorship, or client relationship management.
- Active Secret Clearance or ability to obtain one.
- Preferred qualifications include AI/ML integration experience, familiarity with OpenAI, Anthropic Claude, LangChain, Foundry AIP, statistical analysis, machine learning concepts, Storybook, classified or air-gapped Foundry deployments, Army or DoD software development, strategic consulting, and expanding technical scope with government customers.
- 7+ years of directly related experience and a master’s degree are preferred.
- Only U.S. citizens are eligible for the required security clearance.
Benefits
- The role may be based remotely or in Pittsburgh, with on-site Pittsburgh candidates preferred.
- The position requires approximately 10% travel.
- Applicants must have or be eligible to obtain a U.S. Government Secret security clearance.
- The role supports work across classified or air-gapped environments when applicable.
Tech Stack
Categories
Data Engineering
About Logistics Management Institute
Logistics Management Institute (LMI) provides consulting, software development, and analytics services to U.S. federal agencies, with strengths in supply chain, digital engineering, AI, and modeling and simulation. It builds and sustains government systems—such as Army acquisition and contract-writing platforms—while delivering data-driven modernization and program support across defense, space, healthcare, and energy. Founded in 1961 and headquartered in Tysons, Virginia, LMI operates as a privately held contractor to the public sector.