Senior AI Data Engineer
Strategic Systems International2 months ago
Mexico (city not specified)Senior
Responsibilities
- Own the movement, modeling, quality, and guarantees of data from source systems through warehouses, retrieval layers, and feature layers.
- Design and maintain dimensional data warehouses using Kimball modeling and evaluate alternatives such as Data Vault, One Big Table, and Inman.
- Write production-grade Python and expert SQL, including window functions, CTEs, query plan analysis, and performance tuning.
- Build versioned, tested, observable data pipelines using Airflow, Prefect, Dagster, or equivalent orchestration tools.
- Operate cloud data platforms covering storage, compute, IAM, networking, and cost management on AWS, Azure, or GCP.
- Manage containerized workloads, Kubernetes platforms, CI/CD, and lakehouse table formats including compaction, snapshot expiry, schema evolution, and partition evolution.
- Build or support data layers for production RAG systems, hybrid search infrastructure, streaming systems, data quality, catalog, and lineage capabilities.
- Collaborate with AI/ML data scientists on model-facing systems, feature stores, AI security, governance, and compliance.
Requirements
- 5-10+ years of experience in software engineering or data engineering, including substantial production data platform work.
- Expert-level SQL and Python experience, including query optimization, typing, packaging, dependency management, and testing.
- Demonstrated expertise in Kimball dimensional modeling, including grain selection, many-to-many relationships, denormalization, and tradeoff analysis.
- Production experience with Airflow, Prefect, Dagster, or an equivalent orchestration platform.
- Expert-level experience with AWS, Azure, or GCP and their storage, compute, IAM, networking, and cost-management capabilities.
- Experience with SOLID principles, domain-driven design, containerization, Kubernetes, and CI/CD.
- Experience with Iceberg, Delta Lake, or Hudi and their maintenance characteristics.
- Preferred experience with production RAG data layers, hybrid search, Kafka, Kinesis, Flink, Spark Structured Streaming, dbt, Great Expectations, Soda, catalog and lineage platforms, MLflow, Weights & Biases, and feature stores.
- Working knowledge of a second language such as TypeScript, Java, Go, Scala, or Rust is preferred.
- Experience with AI security, governance, compliance frameworks, and open-source contributions to data or AI infrastructure projects is preferred.
Tech Stack
Apache AirflowApache FlinkApache KafkaAWSAzuredbtGoGoogle Cloud PlatformJavaKubernetesMLflowPythonRustScalaSQLTypeScript
Categories
Data Engineering
About Strategic Systems International
Strategic Systems International (SSI) provides advanced analytics and software engineering services, building data-driven applications for tech companies and enterprises. Founded in 1991 and headquartered in Chicago, it operates globally with offices in Europe, Asia, and Latin America. SSI is a Microsoft Gold Certified Partner, delivering custom development, data engineering, business intelligence, and machine learning across sectors such as fintech, healthcare, IoT, and big data.