1 month ago
Taiwan (city not specified)Mid Level
Responsibilities
- Design IT system architectures, research new technologies, and provide recommendations.
- Design and implement high-volume, governed data pipeline architectures.
- Collaborate with product and business teams on data platform re-engineering and data-related technical issues.
- Operate highly available NoSQL databases, including Cassandra, S3/MinIO, and MariaDB, in Kubernetes environments.
- Develop batch and streaming data solutions and pipelines.
- Manage metadata, ensure data quality, secure and govern data, and evaluate new data technologies.
- Orchestrate data across multiple sources and support parallel processing.
- Design solutions independently from high-level architectures and deploy cloud-native practices.
Requirements
- Bachelor of Science degree or higher in computer science or a related field such as information engineering, information management, data engineering, or applied mathematics.
- Experience with the Hadoop ecosystem and SQL and NoSQL databases.
- Experience developing big data solutions and data pipelines for batch and streaming applications.
- Knowledge of object stores for image and semi-structured or unstructured data.
- Strong analytical, problem-solving, organizational, critical-thinking, collaboration, and communication skills.
- Ability to work independently with minimal supervision.
- Preferred experience with MongoDB, MariaDB, Cassandra, and MinIO/S3.
- Preferred experience with containers and container orchestration platforms.
Tech Stack
Categories
Data Engineering
About TSMC
TSMC (Taiwan Semiconductor Manufacturing Company) is a pure-play semiconductor foundry that manufactures integrated circuits for fabless and systems companies on a contract basis. Founded in 1987 and headquartered in Hsinchu, Taiwan, it is the world’s largest chip foundry, with advanced process nodes and fabs in Taiwan and new facilities in Arizona and Japan. Its shares trade on the Taiwan Stock Exchange (2330) with ADRs on the NYSE (TSM).