about 3 hours ago
Bengaluru, India
Senior
H1B Sponsor
Responsibilities
- Engage with stakeholders and product managers to assess application features and design solutions.
- Collaborate with cross-functional teams to deliver impactful solutions.
- Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Airflow.
- Optimize data storage, retrieval, and processing systems for reliability and performance.
- Develop complex queries and analytics solutions for large-scale datasets using Apache Pinot and Trino.
- Monitor and troubleshoot data systems to minimize downtime and maximize efficiency.
- Design and build APIs and backend services using Spring Boot.
- Write clean, maintainable, and efficient code while adhering to best practices.
Requirements
- 5+ years of experience building large-scale distributed systems.
- 5+ years of experience in Big Data technologies.
- Advanced SQL skills with expertise in query optimization for large datasets.
- Experience with cloud platforms such as AWS, GCP, or Azure.
- Familiarity with containerization tools like Docker and Kubernetes.
- Proven experience in distributed data processing and real-time data pipelines.
- Experience programming in Python, Scala, or Java.
- Exceptional problem-solving abilities and capacity to work independently or collaboratively.
- Bachelor's or Master's degree in Computer Science, Engineering, or equivalent.
- Experience with Ad-Tech and building Agentic AI systems is a plus.
Benefits
- Global access to mental health and financial wellness support.
- Comprehensive healthcare benefits including medical, dental, and vision.
- Life, accident, disability, commuter, and retirement options.
- Flexible time off for vacation and personal reasons.
Tech Stack
Apache AirflowApache SparkAWSAzureDockerGoogle Cloud PlatformJavaKubernetesPythonScalaSpring Boot
Categories
AI & MLBackendData Engineering