Data Engineer
General Motors26 days ago
Arlington, TX, USAMid Level
Responsibilities
- Identify, capture, collect, format, and extract relevant data from external sources, internal systems, and data warehouses.
- Evaluate, research, and experiment with batch and streaming data engineering technologies.
- Showcase emerging data technologies and support adoption of new technologies and techniques.
- Coordinate with Privacy Compliance on proper data collection and handling.
- Create and implement business rules and functional enhancements for data schemas and processes.
- Monitor data loads and resolve data processing issues.
- Troubleshoot data availability and activation issues with internal business clients.
Requirements
- Experience designing, processing, and managing large-scale data with distributed platforms such as Hadoop, Spark, Kafka, or HDFS.
- Hands-on experience with Azure, AWS, or Google Cloud and infrastructure-as-code tools such as Terraform, ARM Templates, or CloudFormation.
- Experience building and maintaining ETL/data pipelines across multiple data formats and sources, including JSON, Parquet, relational databases, cloud databases, and messaging platforms.
- Understanding of data lakes, lakehouses, streaming pipelines, and object storage technologies such as ADLS Gen2 and Amazon S3.
- Experience with SQL and NoSQL technologies such as Cosmos DB, MongoDB, Cassandra, or Redis.
- Experience with Docker and Kubernetes.
- Familiarity with DevOps and software development practices, including Git, CI/CD, build tools, code quality tools, and artifact management.
- Experience with Adobe Experience Platform, Real-Time CDP, Journey Analytics, tag management platforms, SDKs, and REST APIs.
- Understanding of data privacy, security, governance, and regulatory considerations, including GDPR.
- Experience working in Agile environments using Scrum, SAFe, or similar methodologies.
- Strong problem-solving, troubleshooting, collaboration, written communication, and verbal communication skills.
- Ability to use AI tools such as Microsoft Copilot, evaluate AI outputs for accuracy, compliance, and bias, integrate AI into workflows, and apply responsible AI practices.
- High school diploma or equivalent required.
- Bachelor’s degree in a related field or equivalent experience required.
Benefits
- Benefits are available on day one and include 401K matching, 12 weeks of fully paid bonding leave for new parents, tuition assistance, training, a GM employee auto discount, community service pay, and nine company holidays.
- Hybrid work environment with three days per week in the office: Tuesday, Wednesday, and Thursday.
- Competitive pay and bonus eligibility are offered.
Tech Stack
Apache CassandraApache HadoopApache KafkaApache SparkAWSAzureDockerGitGoogle CloudKubernetesMongoDBRedisSQLTerraform
Categories
Data Engineering
About General Motors
General Motors designs, manufactures, and sells cars, trucks, and electric vehicles for consumers and commercial fleets under brands including Chevrolet, GMC, Cadillac, and Buick. A public company on the NYSE headquartered in Detroit and founded in 1908, it operates globally and is developing EVs on its Ultium battery platform. Revenue comes from vehicle and parts sales, connected services such as OnStar, and financing through GM Financial.