Data Engineer

Magic Crystal Limited-company-logo
Data Engineer
Magic Crystal Limited
软件工程师
油尖旺区, 香港
7 天前
全职
办公室工作
资讯科技和服务
工作描述
191 天前

Job Descriptions:

  • Define the architecture of the Measurable AI Analytics platform.

  • Build a robust and scalable data foundation, from logging to streaming pipelines, data filtering, and email parsing.

  • Implement our data stack using modern technologies such as Apache Spark, Kafka, HDFS, and Cassandra.

  • Optimize our data pipelines and establish best practices for table schemas, data models, and data storage.

  • Build efficient solutions on top of AWS and Azure using Python, Scala, and Go.

Requirements:

  • Minimum of 1 year of experience in building backend systems.

  • BSc in Computer Science, Electronic Engineering, Mathematics, or a related field.

  • Solid knowledge of Golang, Python, or Java.

  • Solid knowledge of MySQL or MongoDB.

  • Experience working with popular cloud solutions such as AWS, Azure, or GCP.

  • Knowledge of Docker and Kubernetes.

  • Enthusiasm for working with high-volume heterogeneous data and distributed systems.

Bonus Points:

  • Experience working on and deploying large-scale systems.

  • Experience with Hadoop, Cassandra, Kafka, MongoDB, Redis, or MySQL.

  • Server-side shell scripting experience.

分享到
更多类似工作