Senior Data Engineer - API Platform Engineer - CDH
Mayo Clinic7 days ago
Rochester, MN, USASenior
Responsibilities
- Lead the design and architecture of enterprise API and AI gateway platform capabilities.
- Build and manage scalable API proxies and REST- and SOAP-based integrations.
- Implement API security frameworks, AI gateway services, governance standards, lifecycle management, and traffic policies.
- Deploy and operate API and AI gateway platforms across GCP, Azure, on-premises, and hybrid environments.
- Develop CI/CD pipelines, automation frameworks, and infrastructure provisioning workflows.
- Monitor API performance and reliability, troubleshoot incidents, and participate in rotating on-call support.
- Integrate APIs with backend systems, microservices, and enterprise platforms.
- Support platform migrations, modernization efforts, proof-of-concepts, documentation, runbooks, and developer onboarding.
Requirements
- Bachelor’s degree in a relevant field and at least five years of professional or research experience in data visualization, data engineering, or analytical modeling techniques, or an associate ’s degree and at least seven years of such experience.
- Advanced SQL and strong scripting experience with languages such as Python, JavaScript, PHP, C++, or Java, plus API integration experience.
- Experience with batch and streaming data processing technologies such as Apache Spark, Hive, Pig, or Kafka.
- Experience with big data, statistics, machine learning, Linux, and Windows operating systems.
- Experience designing, deploying, or operating API management platforms or gateways, preferably Apigee X.
- Experience with cloud-native infrastructure, container platforms, scalable distributed systems, networking, and multi-cloud or hybrid environments.
- Preferred experience with Airflow or Google Composer, Kubernetes, Docker, Jenkins, GitHub Actions, Terraform, Helm, Azure DevOps, Denodo, Tableau, Power BI, SAS, ThoughtSpot, DASH, d3, React, Snowflake, SSIS, Google BigQuery, and GCP or Kubernetes certification.
- Strong analytical, communication, problem-resolution, cross-functional collaboration, workload-management, and customer-service skills are required.
Tech Stack
Apache AirflowApache HiveApache KafkaApache PigApache SparkAzureC++D3.jsDockerGitHub ActionsGoogle BigQueryGoogle Cloud PlatformHelmJavaJavaScriptJenkinsKubernetesLinuxPHPPythonReactSassSnowflakeSOAPSQLTerraformWindows
About Mayo Clinic
Mayo Clinic is a nonprofit academic medical center and health system providing hospital and specialty care, research, and medical education to patients globally. It operates major campuses in Rochester, Minnesota (headquarters), Phoenix/Scottsdale, Arizona, and Jacksonville, Florida, plus a regional health system across the Midwest. Revenue comes primarily from clinical services, complemented by research grants and education programs; specialties include heart care, cancer, transplantation, and neurosciences.