Data Engineering- SSEII
First American Financial Corporation2 months ago
Bengaluru, IndiaSenior
Responsibilities
- Develop and maintain a unified data platform using Azure Databricks.
- Design, develop, and maintain scalable data pipelines and API integrations.
- Implement ETL processes and ensure data integrity and quality.
- Use Spark, Kafka, and Airflow for large-scale data processing and orchestration.
- Test, monitor, and troubleshoot data systems for smooth operation.
- Design high-performance pipelines with guarantees including idempotency, fault tolerance, consistency, and observability.
- Collaborate with data engineers, analysts, and scientists to optimize data workflows.
Requirements
- 5+ years of development experience with Python, Scala, Java, or C#, with Python preferred.
- 5+ years of experience with Databricks, Snowflake, BigQuery, Apache Spark, HIVE, Hadoop, Cloudera, or Redshift.
- Experience with PySpark on Databricks is preferred.
- Proficiency in high-performance data pipeline design and pipeline guarantees such as idempotency, at-least-once processing, exactly-once processing, fault tolerance, eventual consistency, streaming consistency, transactional consistency, and observability.
- Experience developing in containerized environments such as Docker, Rancher, or Kubernetes.
- Experience with Apache Airflow or a similar data orchestration tool.
- Bachelor's degree in Computer Science or a related field, or an equivalent combination of education and experience.
- Minimum of 15 years of formal education, with graduate or postgraduate study in Computer Science or Information Technology.
Benefits
- First American (India) is an inclusive equal opportunity employer committed to supporting and respecting all individuals.
Tech Stack
Amazon RedshiftApache AirflowApache HadoopApache HiveApache KafkaApache SparkAzureC#DatabricksDockerGoogle BigQueryJavaKubernetesPythonRancherScalaSnowflake
Categories
Data Engineering
About First American Financial Corporation
First American Financial Corporation provides title insurance, closing/settlement services, and real-estate risk and property data products to lenders, agents, homebuyers/sellers, and commercial property firms. It also offers valuation services, mortgage subservicing, and home warranties, monetizing through insurance premiums and fee-based transactions and data licensing. Founded in 1889 and headquartered in Santa Ana, California, First American is a Fortune 500 public company trading on the NYSE under the ticker FAF.