Senior Data Engineer
Tiger Analytics Inc.3 months ago
Richmond, VA, USASenior
Responsibilities
- Design and develop scalable batch and real-time data pipelines using Python and SQL.
- Implement data solutions on AWS, Azure, or GCP.
- Build high-volume distributed data processing solutions using Spark, Kafka, Hadoop, EMR, MapReduce, or equivalent technologies.
- Develop and optimize real-time and event-driven streaming applications.
- Design data models and structures for enterprise data warehouses and analytics platforms.
- Work with Snowflake, Databricks, and Amazon Redshift.
- Optimize data pipelines and processing workloads for performance, scalability, reliability, and cost efficiency.
- Lead technical discussions and design reviews while providing guidance to other data engineers.
- Collaborate with architects, product teams, application developers, and business stakeholders to develop scalable data solutions.
- Establish engineering practices for code quality, testing, deployment, monitoring, and data quality.
Requirements
- 10+ years of experience in application or data engineering using Python and SQL.
- 5+ years of experience with at least one major public cloud platform: AWS, GCP, or Azure.
- 5+ years of experience with distributed data processing technologies such as Spark, Kafka, Hadoop, EMR, MapReduce, or equivalent.
- 5+ years of experience building and supporting real-time data and streaming applications.
- 5+ years of experience with cloud data warehouses or platforms such as Snowflake, Databricks, or Redshift.
- 5+ years of experience with data modeling for data warehousing and analytics.
- Strong understanding of data engineering, distributed computing, data pipelines, and cloud architecture.
- Strong problem-solving and communication skills with the ability to provide technical leadership.
Benefits
- Hybrid workplace arrangement.
- Significant career development opportunities in a fast-growing and challenging entrepreneurial environment.
- High degree of individual responsibility.
Tech Stack
Amazon RedshiftApache HadoopApache KafkaApache SparkAWSAzureDatabricksGoogle Cloud PlatformPythonSnowflakeSQL
Categories
Data Engineering
About Tiger Analytics Inc.
Tiger Analytics Inc. provides data and AI consulting services that deliver machine learning, analytics, and cloud data engineering solutions for large enterprises across industries, including life sciences. The company engages on strategy and implementation projects, from modern BI and data platforms to MLOps, helping Fortune 100 clients turn data into business outcomes. Founded in 2011 and headquartered in Santa Clara, it is privately held with operations across North America, Europe, and Asia-Pacific.