
AI QA AGENT Lead
Northern Trust2 days ago
Chicago, IL, USA or Tempe, AZ, USAStaff+
Base Salary
$134k - $227k/yr
Responsibilities
- Acquire data from databases, files, APIs, and other sources and develop training, validation, and testing datasets.
- Analyze raw datasets with descriptive statistics and collaborate with domain experts to interpret data fields.
- Design, develop, integrate, and evaluate generative AI, LLM, conversational AI, and Retrieval-Augmented Generation solutions.
- Evaluate AI frameworks and services and recommend standardized tools for AI development.
- Integrate AI tools with Azure services and use Terraform to automate cloud provisioning and infrastructure tasks.
- Build unit tests, data quality checks, and data pipelines to ensure algorithms use trusted data.
- Implement CI/CD pipelines for automated deployment of AI solutions using Azure DevOps, GitHub Actions, and Terraform.
- Use Azure Kubernetes Service to manage and scale containerized AI applications.
- Maintain AI models and monitor their relevance and effectiveness using Azure monitoring tools.
- Implement Azure security controls covering networks, identities, access, encryption, privacy, and data protection.
- Develop, tune, and evaluate supervised, unsupervised, time-series, ensemble, and distributed machine learning solutions.
- Identify dataset bias or leakage and ensure train/test splits reflect realistic performance expectations.
- Present technical and business findings to internal and external customers.
- Provide guidance to software development teams as prototypes and frameworks are moved into production environments.
- Plan and execute data science training sessions and hackathons and collaborate with vendors and universities on new techniques and tools.
Requirements
- Bachelor's degree in Computer Science or a related field.
- Experience with Python, common Python libraries such as NumPy, Pandas, and scikit-learn, Linux-based operating systems, Python IDEs, and source control tools.
- Knowledge of generative AI, LLMs, conversational AI, RAG patterns, evaluation metrics, and machine learning theory.
- Knowledge of Azure cloud application development, infrastructure automation, cloud security, identity and access management, encryption, and data protection.
- Experience or knowledge of CI/CD, Azure DevOps, GitHub repositories, machine learning algorithms, hyperparameter tuning, feature selection, and large-scale training or inference.
- Preferred experience with advanced distributed machine learning frameworks such as Keras and TensorFlow and Azure cloud infrastructure.
- Preferred Azure Security, DevOps, or Azure AI Engineer Associate certification, or equivalent.
- Open-source software development experience is desirable but not required.
Benefits
- Comprehensive benefits include 401(k) and pension retirement benefits, medical, dental, vision, spending accounts, disability coverage, paid time off, parental and caregiver leave, life and accident insurance, and voluntary and well-being benefits.
- The company offers a discretionary bonus program that may include an equity component.
- The role is subject to U.S. work authorization requirements and does not offer employment-based visa sponsorship.
- The company describes a flexible and collaborative work culture, internal mobility opportunities, accessible senior leaders, and an inclusive workplace.
Tech Stack
Categories
About Northern Trust
Northern Trust is a financial services company that provides asset servicing (custody and fund administration), asset management, wealth management, and banking/treasury services to institutions, corporations, and affluent families. Its business model centers on fees for assets under custody/administration and management, plus banking services. Founded in 1889 and headquartered in Chicago, it is publicly traded on Nasdaq (NTRS) and serves clients across the Americas, EMEA, and APAC.