Tech Lead - Data Engineer
The Opus Group10 months ago
India (city not specified)Staff+
Responsibilities
- Lead hands-on data engineering work across ETL/ELT frameworks and data pipeline tools.
- Develop and optimize data solutions using Scala, Python, SQL, and shell scripting.
- Work with orchestration tools and big data technologies such as Airflow, Prefect, Luigi, Hadoop, and Spark.
- Design data models including star and snowflake schemas and improve BI performance.
- Implement data quality frameworks, metrics, test automation, and monitoring.
- Support payments-processing workflows involving transaction lifecycles, settlements, authorizations, disputes, refunds, and reconciliation.
- Collaborate and communicate effectively with business units, senior leaders, associates, and clients.
Requirements
- 7–9 years of hands-on experience in data engineering, preferably in payments or financial services.
- Strong programming skills in Scala, Python, and SQL; mandatory shell scripting experience and Java experience as a plus.
- Strong SQL and database optimization skills; NoSQL experience is a plus.
- Experience with ETL/ELT frameworks, data pipeline tools, and orchestration tools such as Airflow, Prefect, or Luigi.
- Experience with Hadoop or Spark is preferred.
- Knowledge of data modeling, dimensional design, BI performance optimization, data quality, test automation, and monitoring.
- Strong understanding of payments processing, transaction lifecycles, settlements, authorizations, disputes/refunds, and reconciliation flows.
- Experience with payment gateways, merchant acquiring, issuing, and banking interfaces is a plus.
- Familiarity with payments compliance and security standards such as PCI-DSS.
- Bachelor’s or master’s degree in computer science, engineering, or a related discipline.
- Strong communication, interpersonal, teamwork, facilitation, negotiation, planning, and organizational skills.
Tech Stack
Categories
Data Engineering
About The Opus Group
The Opus Group is a privately held network of experiential marketing agencies—Opus Agency, MAS, and Verve—that design and produce brand experiences, events, and campaigns for global enterprises. Headquartered in Beaverton, Oregon, it provides strategy, creative, production, and digital services through project-based and retainer engagements. The company is backed by EagleTree Capital and focuses on large-scale corporate, consumer, and B2B event programs.