2 days ago
San Jose, CA, USAMid Level
Responsibilities
- Design, develop, maintain, and optimize complex ETL pipelines for large-scale data extraction, transformation, and processing.
- Build and enhance scalable data warehousing solutions for efficient querying and management of large datasets.
- Lead development of monitoring, alerting, and data pipeline systems to identify and prevent infrastructure issues.
- Develop and optimize SQL queries using Presto, PostgreSQL, and MySQL.
- Collaborate with attorneys, Data Scientists, and cross-functional teams to understand requirements, identify data sources, and deliver reliable data solutions.
- Lead cross-functional engineering initiatives by defining project plans, coordinating stakeholders, documenting technical work, and driving implementation.
- Identify opportunities to use AI and automation to streamline workflows while maintaining privacy and security standards.
- Contribute to internal practice meetings, thought leadership, case studies, learning materials, networking events, and Digital Transformation initiatives.
Requirements
- At least 3 years of professional Data Engineering experience.
- Expert-level SQL proficiency with relational databases such as Presto, PostgreSQL, or MySQL.
- Expert-level Python proficiency.
- Expert-level experience building, managing, and optimizing ETL and data pipelines.
- Expert-level proficiency with workflow orchestration and pipeline tools such as Apache Airflow or similar technologies.
- Experience leading end-to-end data engineering initiatives with large cross-functional teams and diverse stakeholders.
- Strong written and verbal communication skills and the ability to explain complex technical concepts clearly.
- Ability to navigate ambiguous requirements and independently drive technical projects to completion.
- Bachelor’s degree in a relevant field or equivalent work experience.
- Preferred qualifications include AI workflow automation, regulated-industry, legal technology, eDiscovery, data privacy, compliance, data loss prevention, mentoring, startup, and legal-team experience.
Benefits
- Comprehensive medical benefits, dental and vision insurance, life insurance, a 401(k) plan with matching, paid holidays, networking, and career learning and development programs.
- Six-month duration and direct W2 engagement; remote within California, with occasional onsite work in San Francisco and preference for candidates in or near the San Francisco Bay Area.
Tech Stack
Categories
Data Engineering
About itD Tech
itD Tech is the technology organization within the Idaho Transportation Department, building and operating digital services and enterprise systems for Idaho’s transportation network. It develops and maintains tools for DMV transactions, permitting, GIS/asset management, traffic and safety data, and statewide infrastructure operations, funded by state and federal transportation budgets. Headquartered in Boise, it supports internal agency staff, motorists, carriers, contractors, and local partners across Idaho.