about 4 hours ago
Hong Kong, Hong Kong or Singapore, SingaporeSenior / Staff+
Responsibilities
- Own the architecture, development, and optimization of the big data platform.
- Design and build real-time/batch data pipelines for on-chain data.
- Build and maintain the data warehouse/lake, ensuring data quality and consistency.
- Combine big data with LLM capabilities to build intelligent applications.
- Build data infrastructure for AI use cases, including vector databases.
- Collaborate with Algorithm/AI teams on data processing and pipelines.
- Optimize performance and resource efficiency of big data jobs.
- Track industry developments in big data, Web3 data infrastructure, and AI.
- Communicate and document in English with global colleagues and partners.
Requirements
- Bachelor's degree or above in Computer Science, Software Engineering, or related field.
- 7+ years of big data development experience.
- Proficiency with Hadoop, Spark, and Flink.
- Strong big data development skills in Java/Scala/Python and solid SQL tuning ability.
- Understanding of LLM fundamentals and application patterns.
- Experience with vector databases or embedding data processing.
- Understanding of blockchain fundamentals and on-chain data structures.
- Fluent English reading/writing and strong cross-cultural communication skills.
- Strong problem decomposition and troubleshooting ability.
Benefits
- Competitive total compensation.
- Comprehensive insurance coverage for employees and their dependants.
- More that we love to tell you along the process!
Tech Stack
Apache FlinkApache HadoopApache HBaseApache HiveApache KafkaApache SparkAWSClickHouseGoogle Cloud PlatformJavaPythonScalaSoliditySQL
Categories
AI & MLData Engineering