Cognizant

Streaming Azure Data Engineer

Cognizant
Apply
1 day ago
Toronto, CanadaMid Level

Base Salary

$115k - $125k/yr

Responsibilities

  • Build and maintain streaming and event-driven data pipelines using Azure Event Hubs and structured event schemas.
  • Develop and deploy Azure Function Apps for HTTP- and event-triggered data processing and transformation.
  • Orchestrate data integration and pipeline workflows with Azure Data Factory.
  • Design and maintain data solutions using Azure Data Lake Storage, Azure Cosmos DB, Snowflake, Databricks, and Apache Spark.
  • Develop Python-based data transformations, API integrations, automation, and backend services.
  • Build and maintain ETL/ELT pipelines and optimize complex SQL queries.
  • Contribute to data warehousing, dimensional modeling, lakehouse architecture, and Bronze/Silver/Gold data-layer patterns.
  • Design and build RESTful APIs with routing, versioning, error handling, documentation, and security controls.
  • Apply software engineering practices including Git, code reviews, modular code, CI/CD, unit testing, and integration testing.

Requirements

  • Hands-on streaming data engineering experience with Azure Event Hubs, Databricks, Apache Spark, and APIs.
  • Hands-on experience with Microsoft Azure, Azure Data Lake Storage, Azure Functions, Azure Data Factory, Azure Cosmos DB, and Snowflake.
  • Intermediate to advanced Python development experience in data engineering and backend service contexts.
  • Production experience with PySpark and SparkSQL.
  • Strong software engineering practices, including Git, code reviews, maintainable code, and CI/CD using Azure DevOps or an equivalent tool.
  • Proficiency with pytest, mocking, and asynchronous testing patterns.
  • Advanced SQL skills and proven experience building and maintaining ETL/ELT pipelines.
  • Knowledge of star schemas, slowly changing dimensions, dimensional modeling, data lake and lakehouse architecture, medallion patterns, and Delta Lake.
  • Experience designing and building RESTful APIs and familiarity with microservices and inter-service communication.
  • Understanding of API security patterns including mTLS, API keys, and environment-driven authentication configuration.

Benefits

  • Remote work arrangement.
  • Annual base salary of $115K-$125K depending on experience and qualifications.
  • Eligibility for Cognizant’s discretionary annual incentive program based on performance and applicable plan terms.
  • Medical, dental, vision, and life insurance.
  • Paid holidays and paid time off.
  • 401(k) plan and contributions.
  • Long-term and short-term disability coverage.
  • Paid parental leave.
  • Employee Stock Purchase Plan.

Tech Stack

Apache SparkAzureDatabricksGitpytestPythonSnowflakeSQL

Categories

Data Engineering
Cognizant

About Cognizant

10,000+ employees

Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.

Contact me