Principal Software Engineer - Data Engineering
Caterpillar18 hours ago
Chennai, India or Bengaluru, IndiaStaff+
Responsibilities
- Develop detailed architecture deliverables and technical infrastructure designs for digital platform applications.
- Lead data architecture, data-domain ownership, reusable data-product development, and impact analysis across the existing data platform.
- Evaluate and deploy technologies, including database and AWS service options, to enhance digital capabilities.
- Design secure, performant, and cost-effective data lake solutions using Snowflake and related technologies.
- Gather, analyze, document, and communicate business requirements with cross-functional stakeholders and partners.
- Lead architecture discussions, document solutions in Confluence, complete engineering handoffs, and support build and deployment activities.
- Troubleshoot technical and functional issues, improve data quality, and define solutions for business-critical rules.
- Create and review high-level architecture and technical architecture documentation and provide rough-order-of-magnitude estimates.
- Track emerging technologies and assess their applicability to business and operational requirements.
Requirements
- Expertise with AWS, including EMR, Glue, S3, Fargate, SNS, SQS, Kinesis, EventBridge, RDS, and DynamoDB; Snowflake; SQL; Python; and ER modeling.
- Strong understanding of data platforms, existing data landscapes, data domains, and the design of new solutions without unintended downstream impact.
- Experience designing end-to-end data pipelines integrating IoT, sensor, and machine telemetry data is preferred.
- Knowledge of microservices and APIs is preferred.
- Working knowledge of NVIDIA Omniverse, USD data models, and connector frameworks is preferred.
- Familiarity with digital twin architecture for manufacturing operations, product design, or asset management is preferred.
- Understanding of industrial IoT ecosystems is preferred.
About Caterpillar
Caterpillar Inc. designs, manufactures, and services construction and mining equipment, diesel and natural gas engines, industrial gas turbines, and diesel-electric locomotives for infrastructure, resource, and energy customers. The public company, founded in 1925 and headquartered in Irving, Texas, sells primarily through an independent worldwide dealer network and provides equipment financing. It operates through Construction Industries, Resource Industries, and Energy & Transportation segments, with shares traded on the NYSE and Euronext Paris.