Senior Data Engineer
Tiger Analytics Inc.1 month ago
Remote, United States or Dallas, TX, USASenior
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, Python, and Scala.
- Develop and optimize ETL/ELT processes for ingestion, transformation, and distributed data processing.
- Use Hadoop and its ecosystem to process and manage large structured and unstructured datasets.
- Develop, troubleshoot, and optimize Spark applications for performance, scalability, and reliability.
- Schedule, monitor, and manage batch jobs, workflow dependencies, and data pipelines using Control-M.
- Troubleshoot job failures and resolve data pipeline issues to ensure scheduled workloads complete on time.
- Implement data validation, error handling, and quality checks for data accuracy and consistency.
- Collaborate with architects, analysts, and cross-functional teams to deliver reliable data solutions.
- Follow coding, testing, version control, and deployment procedures.
- Support production deployments, incident resolution, and ongoing maintenance.
Requirements
- At least 8 years of overall data engineering experience.
- Strong hands-on experience with Databricks and Apache Spark.
- Proficiency in Python and Scala for data processing and application development.
- Hands-on experience with Hadoop and big data technologies.
- Experience with Control-M for batch scheduling, monitoring, orchestration, and dependency management.
- Strong understanding of ETL/ELT, data transformations, and distributed data processing.
- Experience with performance tuning, debugging, troubleshooting, and production support.
- Strong SQL skills and understanding of data management concepts.
- Excellent analytical, problem-solving, and collaboration skills.
Benefits
- Medical, dental, vision, retirement accounts, long- and short-term disability, life insurance, HSA/FSA accounts in the USA, and discretionary time off.
- Continuous learning, AI upskilling, exposure to emerging technologies, and opportunities to build expertise in Generative AI, agentic AI, and next-generation data platforms.
- Remote workplace and full-time employment.
Tech Stack
Categories
Data Engineering
About Tiger Analytics Inc.
Tiger Analytics Inc. provides data and AI consulting services that deliver machine learning, analytics, and cloud data engineering solutions for large enterprises across industries, including life sciences. The company engages on strategy and implementation projects, from modern BI and data platforms to MLOps, helping Fortune 100 clients turn data into business outcomes. Founded in 2011 and headquartered in Santa Clara, it is privately held with operations across North America, Europe, and Asia-Pacific.