3 months ago
Taipei, Taiwan or Tokyo, JapanSenior
Responsibilities
- Design, develop, and maintain RESTful APIs using Python.
- Build and manage data warehouses with ClickHouse, Trino/Presto, and Pinot.
- Design and develop data pipelines using Apache Airflow and Apache Spark.
- Develop automation tools with cross-functional teams to streamline daily operations.
- Implement monitoring and alerting systems for system performance and stability.
- Address application queries promptly and effectively to support client satisfaction.
- Use AWS and GCP to optimize data operations.
- Use Kubernetes for container orchestration, application deployment, and scaling.
Requirements
- A BS/MS degree in Computer Science is required.
- At least 5 years of experience building and operating large-scale distributed systems or applications.
- Experience with Kubernetes development and Linux/Unix.
- Experience managing a data lake or data warehouse.
- Expertise in data structures and algorithms on Big Data platforms.
- Ability to work independently in a dynamic, fast-moving environment and manage multiple tasks and projects.
- Experience with ClickHouse is preferred.
- Open-source contributions and a GitHub link are preferred.
- Experience with Python, Scala, or Java is preferred.
- Experience with Hadoop, Hive, Flink, Presto/Trino, and related Big Data systems is preferred.
- Experience with public cloud platforms such as AWS or GCP is preferred.
Tech Stack
Apache AirflowApache FlinkApache HadoopApache HiveApache SparkAWSClickHouseGoogle Cloud PlatformJavaKubernetesLinuxPrestoPythonScala
Categories
BackendData Engineering
About Appier
Appier builds AI-driven advertising and marketing software for enterprises, offering programmatic ad bidding, customer data, and predictive tools delivered as SaaS. Founded in 2012 and headquartered in Taipei, it is a public company listed on the Tokyo Stock Exchange (ticker: 4180). Its Ad Cloud processes millions of bid requests per second across APAC, Europe, and the U.S., and is used by in-house and agency marketers.