graphscope 下使用graphlearn 在大图上跑分布式训练 #1263
-
请教一个问题:使用vineyard 分布式的存一张大图,在大图之上跑分布式训练, 每个trainer 理论上讲都可以touch 到全图的数据,这样是否会导致 vineyard 数据分片在不同节点间频繁拷贝? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
Thanks for opening your first issue here! Be sure to follow the issue template! And a maintainer will get back to you shortly! |
Beta Was this translation helpful? Give feedback.
-
每个trainer是通过grpc连接到多个server上来touch到全局的数据的,每个server管理自己的partition的数据,fragment本身不会copy。 |
Beta Was this translation helpful? Give feedback.
每个trainer是通过grpc连接到多个server上来touch到全局的数据的,每个server管理自己的partition的数据,fragment本身不会copy。