Reply

Senior Data Engineer

Reply
Apply
over 1 year ago
Kochi, IndiaSenior

Responsibilities

  • Design and implement architecture for complex data systems.
  • Translate business requirements into functional and technical specifications.
  • Design and implement lakehouse architecture.
  • Develop and manage cloud-based data architecture and reporting solutions.
  • Apply relational and dimensional data modeling principles.
  • Design data warehouses using established principles such as Kimball and Inmon.
  • Create and manage source-to-target mappings for ETL/ELT processes.
  • Develop and manage Databricks notebooks for data transformation, exploration, and model deployment.
  • Mentor junior engineers and contribute to architectural decisions and code reviews.
  • Work with customers to deliver data storage, retrieval, transformation, aggregation, visualization, and information delivery solutions.

Requirements

  • Bachelor’s degree in computer science, Computer Engineering, MIS, or a related field.
  • At least 5 years of experience with Microsoft SQL Server, T-SQL, SQL performance tuning, indexing, structure, and query optimization.
  • At least 5 years of experience in Microsoft data platform development and implementation.
  • At least 5 years of experience with Power BI or comparable technologies.
  • At least 3 years of consulting experience focused on analytics and data solutions.
  • At least 2 years of experience with Databricks, including Unity Catalog, Databricks SQL, Workflows, and Delta Sharing.
  • Proficiency in Python and Apache Spark.
  • Expertise with Microsoft Azure services including Azure SQL, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, and Stream Analytics.
  • Preferred experience with Microsoft Fabric.
  • Familiarity with CI/CD pipelines and infrastructure-as-code tools such as Terraform or Azure Resource Manager.
  • Knowledge of taxonomies, metadata management, master data management, data stewardship, data ownership, and data quality management.
  • Preferred experience with big data platforms, database management systems, NoSQL databases, and non-Microsoft reporting and business intelligence tools.

Tech Stack

Apache CassandraApache HBaseApache HiveApache PigApache SparkAzureCouchDBDatabricksIBM DB2Microsoft SQL ServerMongoDBMySQLPythonTerraform

Categories

Data Engineering
Reply

About Reply

10,000+ employees

Reply [EXM, STAR: REY] specialises in the design and implementation of solutions based on new communication channels and digital media. As a network of highly specialised companies, Reply defines and develops business models enabled by the new models of AI, big data, cloud computing, digital media and the internet of things. Reply delivers consulting, system integration and digital services to organisations across the telecom and media; industry and services; banking and insurance; and public sectors.

Contact me