AI FinOps Engineer
T. Rowe Price2 months ago
Baltimore, MD, USAMid Level
H1B sponsor
Base Salary
$122k - $261k/yr
Responsibilities
- Develop and maintain cost transparency for AI and machine learning workloads, including compute, storage, networking, training, inference, and third-party platform usage.
- Create reporting, dashboards, and KPIs covering AI spend, utilization, efficiency, and business value.
- Identify and recommend optimization strategies for model selection, deployment, compute and GPU sizing, scheduling, storage lifecycle, inference, vendor, and API usage.
- Support showback and chargeback models for AI services.
- Build forecasting and budgeting models for AI platforms, cloud consumption, and external vendor spend.
- Define and enforce governance standards for tagging, budgeting, provisioning, monitoring, and lifecycle management.
- Collaborate with Finance and Procurement on vendor evaluation, pricing analysis, contracts, and consumption optimization.
- Align AI cost optimization practices with risk, security, compliance, enterprise controls, and regulatory expectations.
- Automate cost management and governance using scripting, infrastructure-as-code, and cloud-native tooling.
- Evaluate hosted AI services, internally managed platforms, and open-source model deployments for cost, scalability, security, and operational supportability.
- Contribute to firmwide best practices for responsible, efficient, and scalable AI adoption.
Requirements
- Bachelor’s degree or equivalent work experience in Computer Science, Engineering, Information Systems, Finance, Data Analytics, or a related field.
- Experience in FinOps, cloud engineering, platform engineering, DevOps, MLOps, data engineering, or infrastructure cost management.
- Deep familiarity with LLM pricing mechanics, including context windows, caching, batching, input/output token splits, and tier structures.
- Strong understanding of cloud cost drivers such as compute, storage, networking, and managed platform services.
- Familiarity with model training, fine-tuning, batch inference, real-time inference, and data pipeline processing.
- Experience with at least one major cloud platform, such as AWS or Azure.
- Experience using cloud cost management, observability, or reporting tools.
- Proficiency in Python, SQL, or similar scripting or query languages.
- Experience building dashboards, reports, or analytics for cost transparency and operational decision-making.
- Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
- Preferred experience with generative AI or large language model workloads, token-based pricing, and inference cost optimization.
- Preferred familiarity with Databricks, Snowflake, SageMaker, Azure ML, or similar enterprise AI and data platforms.
- Preferred understanding of GPU utilization, accelerator economics, performance-cost tradeoffs, tagging, cost allocation, budget governance, and enterprise controls.
- Experience in financial services or another highly regulated environment and relevant cloud, FinOps, Technology Business Management, or infrastructure engineering certifications are preferred.
- FINRA licenses are not required and will not be supported.
Benefits
- Hybrid work schedule with up to three days per week from home.
- Base salary ranges vary by location: $122,000.00-$209,000.00 in Maryland, Colorado, Washington, and for remote workers; $135,000.00-$230,000.00 in Washington, D.C.; and $153,000.00-$261,000.00 in New York and California.
- Annual bonus eligibility.
- Generous retirement plan.
- Health and wellness benefits, including online therapy.
- Paid time off for vacation, illness, medical appointments, and volunteering days.
- Family care resources, including fertility and adoption benefits.
About T. Rowe Price
T. Rowe Price is a global asset manager that designs and distributes mutual funds, ETFs, separate accounts, and retirement solutions for individuals, financial advisors, institutions, and plan sponsors. It earns management and advisory fees for actively managed equity, fixed income, and multi-asset strategies, and also provides subadvisory services and brokerage. Founded in 1937 and headquartered in Baltimore, it is a public company listed on Nasdaq under the ticker TROW.