2 months ago
Remote, IndiaMid Level
Responsibilities
- Architect and implement scalable, secure, and reliable data pipelines.
- Develop ETL/ELT processes for structured and unstructured data sources.
- Perform exploratory data analysis to identify trends, validate data integrity, and derive insights.
- Collaborate with data scientists, analysts, and software engineers on data models for analytics and real-time insights.
- Write maintainable Python code with comprehensive unit and integration tests.
- Own end-to-end feature delivery in an agile, collaborative environment.
Requirements
- Bachelor's or master's degree in computer science, engineering, or a related field.
- At least 4 years of hands-on experience in data engineering or backend software development.
- Understanding of relational databases, including RDS, MySQL, and PostgreSQL.
- Experience with Apache Kafka or RabbitMQ for asynchronous, decoupled systems.
- Proficiency in Python and SQL plus an orchestration tool such as Apache Airflow, Luigi, or Prefect.
- Strong experience with cloud data platforms such as AWS Redshift, GCP BigQuery, Snowflake, or Databricks.
- Deep understanding of data modeling, data warehousing, and distributed systems.
- Familiarity with CI/CD, infrastructure as code, Docker, Kubernetes, AI/ML-integrated solutions, data security and privacy regulations, prompt engineering, and LLM-based systems.
Tech Stack
Amazon RedshiftApache AirflowApache KafkaApache SparkDatabricksDockerKubernetesMySQLPostgreSQLPythonRabbitMQSnowflakeSQL
Categories
Data Engineering
About Netomi
Netomi builds an agentic AI platform for enterprise customer experience, automating support across chat, email, and voice through a no-code, SaaS model. Founded in 2016 and headquartered in San Mateo, it is used by global brands such as Delta Air Lines, United Airlines, and MetLife, and is backed by investors including WndrCo, Accenture Ventures, Adobe Ventures, Y Combinator, and Index Ventures.