Sr Engineer, Data Engineering
TransUnion23 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Design, implement, and optimize enterprise-scale data platforms on Google Cloud Platform.
- Build scalable batch and streaming data pipelines and architect ingestion, transformation, storage, and consumption solutions.
- Analyze and optimize cloud workloads through right-sizing, cluster tuning, autoscaling, scheduling, resource allocation, and utilization improvements.
- Develop cloud cost governance programs, chargeback/showback reporting, cost dashboards, KPIs, forecasts, and savings recommendations.
- Define resource labeling, tagging, metadata, cost allocation, ownership, data classification, and lifecycle governance standards.
- Tune BigQuery queries, Spark workloads, data partitioning, clustering, indexing, caching, storage patterns, and pipeline performance.
- Establish SLIs/SLOs and monitor operational efficiency for data platforms.
- Provide technical guidance, cost-benefit analysis, and architecture recommendations to technical and business stakeholders.
Requirements
- 5-8 years of experience in data engineering, cloud engineering, or cloud architecture.
- At least 3 years of hands-on Google Cloud Platform experience.
- Strong experience designing cloud-native data platforms and enterprise-scale data processing environments.
- Experience implementing cloud cost optimization, FinOps, governance, tagging, chargeback/showback, budgeting, forecasting, and capacity planning initiatives.
- Experience with Apache Spark, PySpark, SQL, data modeling, ETL/ELT, streaming architectures, data warehousing, lakehouse architectures, data quality, lineage, and metadata management.
- Experience with Terraform, Python, shell scripting, Kubernetes, Docker, and automation or CI/CD tooling.
- Knowledge of IAM, service accounts, VPC and networking fundamentals, data protection, encryption, secrets management, audit logging, and compliance frameworks.
- Preferred certifications include Google Professional Data Engineer, Google Professional Cloud Architect, Google Professional Cloud DevOps Engineer, FinOps Certified Practitioner, FinOps Certified Professional, and Terraform Associate.
Benefits
- Hybrid position requiring at least two days per week in person at an assigned TransUnion office, with remaining responsibilities performed virtually.
- TransUnion promotes work/life flexibility, professional development resources, collaboration, and opportunities to contribute through its Workforce for Good program.
Tech Stack
Apache AirflowApache SparkDockerGitHub ActionsGoogle BigQueryGoogle Cloud PlatformJenkinsKubernetesLooker StudioPythonSQLTerraform
Categories
Data Engineering
About TransUnion
TransUnion is a global credit bureau and information-services company that provides credit data, identity verification, fraud prevention, and risk analytics to businesses and consumers. It sells data, APIs, and decisioning software used by lenders, insurers, telecoms, and other regulated industries, and offers consumer credit reports and monitoring. Founded in 1968 and headquartered in Chicago, it operates in more than 30 countries and is publicly traded on the NYSE under the ticker TRU.