Senior Data Engineer
Tiger Analytics Inc.8 months ago
Jersey City, NJ, USASenior
Responsibilities
- Design, develop, and deploy end-to-end data pipelines on AWS using Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.
- Build data processing and transformation workflows with Databricks, Apache Spark, and SQL.
- Create and maintain Apache Airflow orchestration workflows for pipeline execution, scheduling, and monitoring.
- Prepare and ingest structured and unstructured data for AI/ML and Generative AI workloads.
- Enable pipelines supporting LLM applications, vector embeddings, and knowledge retrieval systems.
- Lead migration of legacy data systems to modern cloud-based data architectures.
- Develop and maintain CI/CD pipelines for data workflows and platform automation.
- Collaborate with data scientists, ML engineers, and AI teams to support model training, inference, and Generative AI applications.
- Optimize data pipelines for performance, reliability, scalability, and cost-effectiveness using AWS best practices.
Requirements
- 8+ years of experience as a Data Engineer working with AWS cloud services.
- Hands-on experience with AWS services including Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, and related data platform tools.
- Experience building data pipelines with Databricks, Apache Spark, and SQL.
- Experience using Apache Airflow for workflow orchestration.
- Strong understanding of data modeling, data lake and lakehouse architectures, and ETL/ELT frameworks.
- Experience with CI/CD pipelines and version control systems such as Git.
- Exposure to Generative AI or LLM-based applications and experience supporting AI/ML data pipelines.
- Familiarity with vector databases, embeddings, and Retrieval-Augmented Generation architectures.
- Experience with LLM APIs or AI frameworks such as LangChain.
- Understanding of MLOps workflows and model deployment pipelines.
Benefits
- Hybrid workplace in Jersey City, United States.
- Full-time position with significant career development opportunities.
- Opportunity to work in a small, challenging, and entrepreneurial environment with substantial individual responsibility.
Tech Stack
Categories
Data Engineering
About Tiger Analytics Inc.
Tiger Analytics Inc. provides data and AI consulting services that deliver machine learning, analytics, and cloud data engineering solutions for large enterprises across industries, including life sciences. The company engages on strategy and implementation projects, from modern BI and data platforms to MLOps, helping Fortune 100 clients turn data into business outcomes. Founded in 2011 and headquartered in Santa Clara, it is privately held with operations across North America, Europe, and Asia-Pacific.