Responsibilities
- Design and implement data ingestion pipelines for business systems data using Fivetran, Python, Bulk APIs, S3-based lakehouse architectures, Kafka, and Spark.
- Build automated pipelines from source systems to Snowflake with strong reliability, scalability, and observability.
- Use advanced SQL in Snowflake for transformation, standardization, and preparation of analytics-ready datasets.
- Optimize high-volume ingestion through API rate-limit handling, micro-batching, incremental loading, and CDC.
- Apply DevOps, version control, and deployment automation practices to data pipelines.
- Partner with analysts, subject matter experts, and platform teams to prototype pipelines for evolving requirements.
- Monitor, troubleshoot, and optimize ingestion jobs for data freshness, accuracy, and performance.
Requirements
- 6+ years of hands-on experience in data engineering and ingestion automation in cloud or hybrid environments.
- Experience ingesting CRM, ERP, financial, consumption, and renewals systems data.
- Advanced proficiency with Python and Fivetran or a similar ETL/ELT tool for pipeline automation, orchestration, and validation.
- Expertise with Kafka, Spark, and S3 or lakehouse-style storage architectures.
- Strong proficiency with Snowflake, including ingestion, transformation, and performance optimization.
- Deep understanding of rate limits, micro-batching, incremental loads, and CDC.
- Experience applying DevOps and CI/CD practices to data pipelines.
- Ability to work independently and deliver solutions rapidly in a fast-paced, iterative environment.
- Preferred experience with additional open-source ingestion frameworks and connectors.
- Preferred exposure to event-driven or telemetry-heavy architectures at scale.
Benefits
- Competitive compensation packages designed to recognize and reward performance.
- Opportunity to work with AWS, Microsoft, Google Cloud, and other leading partners.
- Opportunity to work with Dynatrace Intelligence and agentic operations technologies.
Tech Stack
Categories
About Dynatrace
Dynatrace keeps today’s AI-driven world working by advancing observability for today’s digital business. The world relies on software, but what isn’t seen is just how much complexity goes on behind the scenes to make sure everything stays up and running. Most businesses today have huge digital ecosystems made up of software, data flows, applications, and hybrid-cloud environments. As these ecosystems grow in complexity, so do the points of failure. Outages and glitches resulting in grounded flights or failed financial transactions prove how critical it is that software works as expected, making AI-powered observability an essential capability to ensure digital businesses run smoothly and recover quickly — keeping the world working. Dynatrace provides businesses with a holistic view of their entire digital ecosystem, removing the burden of operational monitoring and alert management. By automating these tasks, teams are empowered to transform complexity into their greatest asset and to drive their business forward by focusing on high-impact initiatives, driving topline acceleration, fueling innovation, and delivering experiences customers love.