Senior Architect, Data Engineering
West Monroe23 days ago
Base Salary
$184k - $245k/yr
Responsibilities
- Advise clients on platform selection and architecture for Databricks, Snowflake, and Microsoft Fabric.
- Design scalable data flows, processing pipelines, ingestion and reporting structures, distributed architectures, and lakehouse environments.
- Architect and implement AI/ML and Generative AI solutions, including LLM, prompt engineering, embeddings, vector database, and RAG use cases.
- Provide data management, governance, stewardship, semantic modeling, data integration, and data integrity expertise.
- Coordinate with application owners to integrate source systems with analytics platforms.
- Guide and coach consultants, share best practices, and perform code reviews.
- Partner with business development teams to identify client needs, propose solutions, develop proposals and presentations, and support pre-sales activities.
- Attend necessary business and technical meetings and help build long-term client relationships.
Requirements
- 10+ years of professional experience and 5+ years within a consulting environment.
- Strong expertise in Databricks and/or Snowflake, including lakehouse architecture, performance optimization, governance, orchestration, and AI/ML and Generative AI workloads.
- Experience with AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies.
- Hands-on experience with LLMs, prompt engineering, embeddings, vector databases, and RAG architectures.
- Strong data engineering experience with Databricks, Snowflake, Microsoft Fabric, relational databases, large unstructured datasets, ETL procedures, and cloud platforms.
- Experience with AWS, Azure, or GCP; reporting tools such as Power BI and Tableau; and Azure SQL, Azure Data Lake, or Azure Data Factory.
- Knowledge of Big Data methodologies, distributed architectures, messaging patterns, and related tools.
- Proven experience supporting business development, technical proposals, pre-sales activities, and revenue growth.
- Excellent organizational, verbal, and written communication skills, with a commitment to inclusion and openness to diverse perspectives.
- Willingness to travel to client sites 30% to 50%.
Benefits
- Medical, dental, vision, and basic life insurance coverage for employees and families.
- 401k plan, employee stock ownership program, and eligibility for annual bonuses.
- Unlimited flexible time off and ten paid holidays annually.
- Ten weeks of paid parental leave eligibility upon hire.
- The role may be based near West Monroe offices or another listed location, with salary varying by geography.
Tech Stack
Apache SparkApache StormAWSAzureDatabricksGoogle Cloud PlatformMicrosoft SQL ServerMLflowScalaSnowflake
Categories
AI ApplicationsData Engineering
About West Monroe
West Monroe is a Chicago-based business and technology consulting firm that helps enterprises and private equity sponsors improve operations and build digital capabilities. It sells project-based consulting across industries such as financial services, healthcare, energy, and software, including M&A advisory, customer experience, product and data strategy, and cybersecurity. Founded in 2002 and privately held under M/C Partners, it operates from multiple U.S. hubs.