Data Engineer
【Your Job】
Responsibilities
Mainly responsible for building data collection pipelines and infrastructure, focusing on gathering, cleansing, and modeling unstructured data from the internet, and preparing it for use in products. The data collection system is fully frameworked, eliminating the need to start from scratch each time. Instead, a system is in place that automatically performs data cleansing and modeling by simply aligning inputs and outputs.
Recently, with the growing size of the data, involvement in building data platforms and implementing distributed systems has increased. Th