Senior Backend Engineer
Aivar Innovations Private Limited17 hours ago
Coimbatore, IndiaSenior
Responsibilities
- Own the six-stage processing pipeline end-to-end from ingestion to output.
- Design the pipeline orchestration framework with async Python, parallel and sequential execution, retries, and dead-letter queues.
- Build connector integrations for enterprise APIs, databases, file systems, and SaaS platforms.
- Implement PII/PHI detection, data integrity checks, format compliance, and input sanitization.
- Build reconstruction capabilities that transform extracted data into Markdown, vector representations, and context maps.
- Design event-driven architecture with message queuing, backpressure handling, and graceful degradation.
- Implement immutable audit trail logging across all pipeline stages.
- Build multi-tenant data isolation and enforce strict customer separation at every pipeline stage.
- Develop production systems supporting 100K+ documents or records per batch.
- Implement APIs with versioning, rate limiting, and authentication.
- Maintain comprehensive testing, CI/CD, monitoring, and incident response practices.
Requirements
- 4–8 years of software engineering experience.
- At least 2 years building data-intensive pipelines.
- Distributed Python systems experience with asyncio, aiohttp, and Celery.
- Experience with Kafka, Amazon SQS, RabbitMQ, or Redis Streams.
- Experience with high-volume data pipelines processing 100K+ documents or records per batch.
- API design experience with REST or GraphQL, versioning, rate limiting, and authentication.
- Experience with AWS services including Lambda, SQS/SNS, MSK, EKS, Step Functions, ECS, S3, DynamoDB, and RDS.
- Experience with multi-tenant SaaS architecture and customer data isolation patterns.
- Experience with production testing, CI/CD, monitoring, and incident response.
Tech Stack
Amazon DynamoDBApache KafkaAWSDockerElasticsearchFastAPIGitHub ActionsGrafanaGraphQLPostgreSQLPrometheusPythonRabbitMQRedisTerraform
Categories
BackendData Engineering
About Aivar Innovations Private Limited
Aivar Innovations Private Limited is an AI-first technology partner that builds and operates data and ML platforms, generative-AI pipelines, and cloud-native infrastructure for enterprises. The company delivers consulting and engineering services—covering async Python platforms, multi-tenant SaaS architectures, compliance/PII safety layers, DevOps/SRE, and AWS modernization—often via reusable accelerators. Founded in 2024 and headquartered in Menlo Park, California, Aivar raised a $4.6M seed round in January 2026.