Data & AI Engineer – Equities Technology
William Blair3 months ago
Base Salary
$130k - $161k/yr
Responsibilities
- Design, build, and maintain scalable data pipelines using Databricks, Azure Data Factory, Azure Synapse, Spark, Python, and ADLS.
- Implement ETL/ELT workflows, reusable ingestion and transformation frameworks, data models, analytical schemas, and full or incremental data loads.
- Build and deploy AI-enabled services, agents, RAG workflows, and LLM integrations for equity research, trading, sales, and client-service use cases.
- Productionize AI and Data Science proofs of concept into secure, scalable, monitored, auditable, and compliant services.
- Optimize prompts, embeddings, orchestration, and inference workflows for accuracy, performance, cost, and reliability.
- Support migration of legacy SQL, SSIS, Synapse, and custom ETL solutions to Azure-native architectures.
- Implement Azure DevOps and YAML-based CI/CD pipelines and use Azure services for secure and maintainable operations.
- Develop monitoring dashboards and operational practices covering pipeline health, SLAs, system performance, cloud spend, alerting, lifecycle management, and runbooks.
- Collaborate with Product Managers, Software Engineers, Data Scientists, and business stakeholders to define requirements and deliver solutions.
- Lead testing, analyze and resolve defects, document technical designs and integrations, and maintain operational playbooks and runbooks.
Requirements
- Bachelor’s degree in information technology or a related field.
- 4–6+ years of hands-on experience with Databricks, Spark, Azure Data Factory, Azure Synapse, Python, ADLS, and Azure Functions.
- Strong experience designing and managing Synapse and Azure Data Factory pipelines, activities, and linked services.
- Experience building full and incremental data loads from Azure and on-premises data sources.
- Experience designing reusable ETL/ELT frameworks and orchestrating pipelines across Azure Data Factory, Synapse, and Databricks.
- Experience implementing LLM-enabled or RAG-based solutions in production environments.
- Proficiency with REST APIs, data gateways, third-party system integrations, SQL, data modeling, analytical storage, and performance tuning.
- Experience with Azure DevOps and YAML-based CI/CD pipelines.
- Familiarity with Azure Key Vault, automation runbooks, Logic Apps, and cloud security best practices.
- Strong communication, collaboration, and problem-solving skills.
- Preferred: hands-on experience with Azure AI Services, including OpenAI and embeddings.
- Preferred: familiarity with Microsoft Fabric.
- Preferred: proficiency in ASP.NET, .NET Core, or C#.
- Preferred: background in financial services, capital markets, or other regulated environments.
Benefits
- Chicago-based hybrid work schedule.
- Medical, dental, and vision coverage.
- Employer-paid short- and long-term disability and life insurance.
- 401(k), profit sharing, and paid time off.
- Maven family and fertility benefits and parental leave, including adoption, surrogacy, and foster placement.
- Other voluntary benefits and eligibility for a discretionary annual bonus and/or commission-based incentives.
Tech Stack
Categories
AI ApplicationsData Engineering
About William Blair
William Blair is an employee-owned investment bank and asset manager that provides M&A advisory, capital raising, equity research, institutional sales and trading, and private wealth management. The Chicago-headquartered firm, founded in 1935, serves corporations, financial sponsors, institutions, and high-net-worth families through fee-based advisory, trading, and asset-management revenues. It operates globally with more than 20 offices across North America, Europe, and Asia.