Northern Trust

AI QA AGENT Lead

Northern Trust
Apply
2 days ago
Chicago, IL, USA or Tempe, AZ, USAStaff+

Base Salary

$134k - $227k/yr

Responsibilities

  • Acquire data from databases, files, APIs, and other sources and develop training, validation, and testing datasets.
  • Analyze raw datasets with descriptive statistics and collaborate with domain experts to interpret data fields.
  • Design, develop, integrate, and evaluate generative AI, LLM, conversational AI, and Retrieval-Augmented Generation solutions.
  • Evaluate AI frameworks and services and recommend standardized tools for AI development.
  • Integrate AI tools with Azure services and use Terraform to automate cloud provisioning and infrastructure tasks.
  • Build unit tests, data quality checks, and data pipelines to ensure algorithms use trusted data.
  • Implement CI/CD pipelines for automated deployment of AI solutions using Azure DevOps, GitHub Actions, and Terraform.
  • Use Azure Kubernetes Service to manage and scale containerized AI applications.
  • Maintain AI models and monitor their relevance and effectiveness using Azure monitoring tools.
  • Implement Azure security controls covering networks, identities, access, encryption, privacy, and data protection.
  • Develop, tune, and evaluate supervised, unsupervised, time-series, ensemble, and distributed machine learning solutions.
  • Identify dataset bias or leakage and ensure train/test splits reflect realistic performance expectations.
  • Present technical and business findings to internal and external customers.
  • Provide guidance to software development teams as prototypes and frameworks are moved into production environments.
  • Plan and execute data science training sessions and hackathons and collaborate with vendors and universities on new techniques and tools.

Requirements

  • Bachelor's degree in Computer Science or a related field.
  • Experience with Python, common Python libraries such as NumPy, Pandas, and scikit-learn, Linux-based operating systems, Python IDEs, and source control tools.
  • Knowledge of generative AI, LLMs, conversational AI, RAG patterns, evaluation metrics, and machine learning theory.
  • Knowledge of Azure cloud application development, infrastructure automation, cloud security, identity and access management, encryption, and data protection.
  • Experience or knowledge of CI/CD, Azure DevOps, GitHub repositories, machine learning algorithms, hyperparameter tuning, feature selection, and large-scale training or inference.
  • Preferred experience with advanced distributed machine learning frameworks such as Keras and TensorFlow and Azure cloud infrastructure.
  • Preferred Azure Security, DevOps, or Azure AI Engineer Associate certification, or equivalent.
  • Open-source software development experience is desirable but not required.

Benefits

  • Comprehensive benefits include 401(k) and pension retirement benefits, medical, dental, vision, spending accounts, disability coverage, paid time off, parental and caregiver leave, life and accident insurance, and voluntary and well-being benefits.
  • The company offers a discretionary bonus program that may include an equity component.
  • The role is subject to U.S. work authorization requirements and does not offer employment-based visa sponsorship.
  • The company describes a flexible and collaborative work culture, internal mobility opportunities, accessible senior leaders, and an inclusive workplace.

Tech Stack

AzureGitHub ActionsKerasKubernetesLinuxNumPyPandasPythonPyTorchscikit-learnTensorFlowTerraform
Northern Trust

About Northern Trust

501-1,000 employees

Northern Trust is a financial services company that provides asset servicing (custody and fund administration), asset management, wealth management, and banking/treasury services to institutions, corporations, and affluent families. Its business model centers on fees for assets under custody/administration and management, plus banking services. Founded in 1889 and headquartered in Chicago, it is publicly traded on Nasdaq (NTRS) and serves clients across the Americas, EMEA, and APAC.

Contact me