Backend Engineer - Search
Atomicwork Inc5 months ago
Bengaluru, IndiaMid Level
Responsibilities
- Design, develop, and maintain data pipelines for enterprise search applications.
- Implement data ingestion processes from various sources, including databases, file systems, and APIs.
- Develop data transformation and enrichment processes to prepare data for indexing.
- Integrate with search platforms to index and update data efficiently.
- Ensure data quality, consistency, and integrity throughout the pipeline.
- Monitor pipeline performance and troubleshoot issues as they arise.
- Collaborate with cross-functional teams, including data scientists, engineers, and product managers.
- Implement security measures to protect sensitive data during processing and storage.
- Document pipeline architecture, processes, and best practices.
- Stay updated with industry trends and advancements in data engineering and enterprise search.
Requirements
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with data pipeline frameworks and tools (e.g., Apache Airflow, Apache NiFi).
- Experience with search platforms like Elasticsearch or OpenSearch.
- Familiarity with data ingestion, transformation, and indexing processes.
- Understanding of enterprise search concepts, including crawling, indexing, and query processing.
- Knowledge of data security and access control best practices.
- Experience with cloud platforms (AWS, GCP, or Azure) and related backend services.
- Familiarity with Model Context Protocol (MCP) is a strong plus.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.
Benefits
- Fantastic team — the #1 reason why everybody joins us.
- Convenient offices — well-located offices spread over five different cities.
- Paid time off — Unlimited sick leaves and 15 days off every year.
- Health insurance — comprehensive health coverage up to 75% premium covered.
- Flexible allowances — with hassle-free reimbursements across spends.
- Annual outings — for everyone to have fun together.