2 months ago
San Jose, CA, USASenior
Responsibilities
- Build and modify high-complexity ETL and data pipelines for large-scale datasets.
- Develop and maintain monitoring and alerting systems for data, infrastructure, and workflow issues.
- Design data warehousing solutions and optimize queries and pipelines for large-scale processing.
- Collaborate with attorneys, data scientists, engineers, and technical and non-technical stakeholders on data requirements, dependencies, and timelines.
- Lead end-to-end, cross-functional data engineering initiatives including planning, documentation, stakeholder coordination, system design, and execution.
- Identify and resolve data and system issues to improve reliability, efficiency, and operational visibility.
- Communicate technical concepts and project status to technical and non-technical audiences.
- Participate in internal practice meetings, thought leadership, case studies, learning materials, networking events, and Digital Transformation practice initiatives.
Requirements
- 5–7+ years of experience in data engineering or a closely related field.
- Expert-level SQL experience with relational or distributed query engines such as Presto, PostgreSQL, or MySQL.
- Expert-level Python programming experience.
- Expert-level experience building and managing ETL/data pipelines with orchestration tools such as Airflow or comparable technologies.
- Experience leading large, cross-functional data engineering projects involving technical and non-technical stakeholders.
- Experience designing and delivering high-complexity monitoring and alerting systems.
- Strong written and verbal communication skills and the ability to work independently across stakeholder groups.
- Strong understanding of data privacy and security considerations in data engineering environments.
- Bachelor’s degree in a relevant field or equivalent work experience.
- Preferred experience using AI to accelerate delivery or build AI-enabled workflow components.
- Preferred experience in regulated industries, mentoring technical team members, startups or ambiguous environments, and data loss remediation or related data protection initiatives.
- Volunteer or internship experience with a law firm or privacy-related environments is preferred.
Benefits
- Remote work, with preference for California and ideally Bay Area candidates; occasional onsite work in San Francisco may be required.
- Three-month contract.
- Comprehensive medical benefits, dental, vision, life insurance, paid holidays, and a 401(k) plan with matching.
- Networking, career learning, and development programs.
- Direct W2 candidates only; sponsorship is unavailable.
Tech Stack
Categories
Data Engineering
About itD Tech
itD Tech is the technology organization within the Idaho Transportation Department, building and operating digital services and enterprise systems for Idaho’s transportation network. It develops and maintains tools for DMV transactions, permitting, GIS/asset management, traffic and safety data, and statewide infrastructure operations, funded by state and federal transportation budgets. Headquartered in Boise, it supports internal agency staff, motorists, carriers, contractors, and local partners across Idaho.