Staff - Data Engineer (Azure Databricks)
Bread Financial7 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Build, develop, and maintain data infrastructure, data ingestion pipelines, data warehouses, data lakes, and enterprise big data platforms.
- Ingest, transform, process, monitor, and troubleshoot structured, unstructured, batch, and streaming data from internal and external sources.
- Collaborate with architects, engineers, analysts, scientists, business users, and product teams on data models, analytical tools, dashboards, data features, and proof-of-concept projects.
- Create automation systems and tools to configure, monitor, and orchestrate data infrastructure and pipelines.
- Manage data lineage, metadata, critical data elements, version control, data quality checks, and data profiling processes.
- Work with Hive, HDFS, NoSQL databases, and other warehousing solutions while supporting HDFS maintenance and cloud deployments.
- Make technology decisions for data infrastructure, evaluate new technologies, and improve data engineering processes and tools.
- Serve as a subject matter expert, mentor associates, educate business teams, and communicate technical concepts to diverse audiences.
Requirements
- Bachelor's degree in Computer Science or Information Systems, or equivalent experience.
- 8–10 years of work experience in IT, SQL, Hadoop ecosystems, data warehousing, and data modeling.
- One cloud certification, such as AWS Cloud Practitioner, Microsoft Azure Fundamentals, or Google Cloud Digital Leader.
- Experience with Agile project management, Jira, software development using Agile methodologies, data engineering, data analysis, data profiling, data modeling, and data strategies.
- Expertise in ER Studio, business process management tools, metadata management, and related tools.
- Preferred qualifications include a master's degree in Computer Science or a STEM field, or equivalent experience.
- Preferred experience includes 10–13 years in the field, Agile product owner or Scrum Master experience, Hadoop, Spark, and systems intended for cloud deployments such as AWS, EKS, and Lambda.
- Python, SQL, data warehousing, data modeling, Apache Hadoop, and data engineering skills are listed.
Benefits
- Hybrid work arrangement in a normal office environment.
- Wellness benefits and a diverse suite of associate benefits.
- Career development opportunities and non-traditional career progression opportunities.
- Opportunity to participate in an award-winning workplace culture and community-focused programs.
- Regular full-time position; offers are contingent on successful completion of credit and background checks.
Categories
Data Engineering
About Bread Financial
Bread Financial is a Columbus, Ohio–based public financial services company (NYSE: BFH) that builds payment, lending, and savings products for U.S. consumers and retail partners. Through brands including Comenity and Bread, it issues private-label and co-brand credit cards, installment financing, and buy now, pay later options, and offers online savings and CDs. Its business model combines merchant partnerships with consumer credit, earning interest and program fees across travel, apparel, jewelry, and other specialty sectors.