Main job:
- 数据清洗，清洗目前KG库里的各类数据(空值、简体繁体转换、特殊符号、重复等等)
- 数据准入框架，保证入库数据格式的准确性
- Kanzhun、CRM、Boss数据入库(getKafka和putKafka)
- IDMapping映射，将CrmID, BossID, KzID匹配并入库(入库的唯一性策略，ReduceByKey)
-
Notifications
You must be signed in to change notification settings - Fork 0
AimeeLiu01/BossKG
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Clean Code
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published