Security Data Engineer
Ernst and Young13 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and maintain data pipelines for processing and analyzing large datasets.
- Use SQL for data extraction, transformation, and loading processes.
- Manage and optimize data storage and processing with Databricks and Data Lake technologies.
- Integrate data from security tools in collaboration with security teams.
- Create and maintain documentation for data pipelines, processes, and workflows.
- Monitor and troubleshoot data pipeline performance and data quality issues.
- Develop data models and visualizations for presenting security insights to stakeholders.
- Support analytics, reporting, service reviews, service improvements, service transition, and readiness for internal security technology offerings.
- Maintain relationships and collaborate across a geographically and culturally dispersed organization.
- Apply ITIL knowledge to support compliance with Incident, Problem, and Change processes.
Requirements
- A degree in Computer Science or a related discipline, or equivalent work experience.
- 7–10 years of experience working within Information Technology in a global firm.
- Strong proficiency in SQL and experience with data manipulation and querying.
- Hands-on experience with Databricks and Data Lake technologies.
- Knowledge of data modeling, ETL processes, and data warehousing concepts.
- Proficiency in Azure Cloud services and Azure security tools, including Azure Security Center, Azure Monitor, and Azure Sentinel.
- Knowledge of Azure Data Lake, Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Notebooks, PySpark, and Spark SQL.
- Experience with Python, including pandas and NumPy, or PowerShell; knowledge of Scala is also relevant.
- Experience with Azure SQL and database management systems for ETL processes.
- Familiarity with security tools and frameworks, cloud platforms, and data visualization tools such as Power BI and Tableau.
- Certifications in data visualization or analytics platforms are relevant.
- Strong critical thinking, problem-solving, communication, presentation, judgment, collaboration, and time-management skills.
- Experience working in a global virtual environment and across culturally diverse teams.
- Ability to work autonomously and within a team, handle ambiguity and change, and meet deadlines.
Benefits
- Competitive remuneration package with rewards for individual and team performance.
- Flexible benefits covering holidays, health and well-being, insurance, savings, discounts, offers, and promotions through the FlexEY program.
- Support, coaching, and feedback from colleagues.
- Opportunities to develop new skills and progress a career.
- Flexible working arrangements intended to support lifestyle balance and personal priorities.
- Client-facing professionals may be required to travel regularly or work at client sites.
Categories
Data Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.