Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

spark 处理历史数据 #20

Open
FS1360472174 opened this issue Jan 9, 2018 · 0 comments
Open

spark 处理历史数据 #20

FS1360472174 opened this issue Jan 9, 2018 · 0 comments

Comments

@FS1360472174
Copy link
Owner

  1. 一些基础数据是 属性名称
    这些数据冗余下来了,但是有可能会发生变化

  2. spark 处理的时候,join 的时候是将这些数据都从MySQL表拉到了ES表中,由于这些数据量大,
    不能每天去全量拉。需要使用其他手段支持

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant