Senior Architect, Software Engineering

Tekion

4 months ago

Chennai, India

Senior / Staff+

H1B Sponsor

Responsibilities

Design and implement data architecture and pipelines using PySpark, Python, and AWS services.
Modernize legacy systems by converting Java-based migration or ETL scripts into Spark-based solutions.
Build and manage data lakes and data warehouses optimized for analytics and AI/ML workflows.
Collaborate with data scientists and analysts to enable model training, deployment, and continuous data delivery.
Define and document high-level and low-level designs for scalable data systems.
Implement standards for data quality, governance, performance optimization, and security.
Lead troubleshooting, performance tuning, and architecture reviews for data pipelines.

15+ years of experience in data engineering or architecture with a strong hands-on development background.
Expert-level proficiency in PySpark, Python, and SQL for data processing and transformation.
Strong understanding of AWS data ecosystem, including Glue, EMR, S3, Redshift, and Lambda.
Proven experience migrating or re-engineering Java-based ETL systems into modern Spark environments.
Solid foundation in data lake, data warehouse, and cloud-native architecture design.
Experience supporting AI/ML data pipelines and integrating data platforms with ML workflows.
Strong documentation skills and ability to communicate architecture clearly to technical and business stakeholders.
Experience with both RDBMS such as Maria DB/MySQL and No-SQL databases such as MongoDB.
Experience with GIT, Jenkins, and AWS.
Expertise in performance optimization and cost management for cloud environments.
Ability to manage multiple projects and priorities in a fast-paced environment.
AWS Professional level certifications (e.g., Solutions Architect Professional, DevOps Engineer Professional).

Amazon RedshiftAWSGitJavaJenkinsMariaDBMongoDBMySQLPythonSQL