Kubernetes support

[Halone228]

Hi, while exploring the new documentation I discovered many new interesting and useful features, also in the beginning it was mentioned about scaling through Kubernetes, I realize how incredibly cool it is, because there is no need to stay on one limited machine anymore. However, working with Kubernetes itself turned out to be a bit different, there is actually some "jobs" running in kubernetes. The idea is very good, but it would be interesting to consider a more complex behavior:

• Suppose a cluster is allocated for botosaurus "jobs" only. It presents a master pod some kind of manager or controller (let's call it a controller), which handles the deployment in the cluster.
• First of all, the automated controller will be able to stock new pods with browsers that can be used for synchronization from the module kube api sync, kube api asynchronous interface.
• We connect to the controller from the "control" program, which already and will request interaction with this or that browser, performing different tasks on it.

In any case, if you are interested in this idea I will be glad to answer your questions, to describe in detail the structure of programs and other tools, as well as to implement this behavior in botasaurus! Thanks for your attention and time.

[Chetan11-dev]

All of it is done, just docs needs be released, will be releasing soon.

[Chetan11-dev]

Released, Please run the following commands:

python -m pip install bota botasaurus botasaurus_api botasaurus_driver bota botasaurus-proxy-authentication botasaurus_server --upgrade

And read https://github.com/omkarcloud/botasaurus/blob/master/run-scraper-in-kubernetes.md