how is the task log recorded?

[hansedong]

Is it stored in a database or written to a file? Or is there any architecture documentation?

[youlu-cn]

Currently, we collect the std error and std out, and store the messages in mysql.

[hansedong]

@youlu-cn Thanks for the reply, I would like to ask, if it is stored in the database, is there a limit on the size of each task（stdout and stderr） ? In addition, suppose the machine has 3000 nodes, each node is running 20 tasks at the same time (both write the database), how to solve the problem that there may be a limited number of connections?

[youlu-cn]

@hansedong Task logs are written in batch by each agent node. Besides, this operation is an interface that you can implement your own behavior.