Exception thrown when exporting dataset on the spark platform, with docker configured on a local machine.

[eduardocesar]

On the spark platform, when trying to save a data set, by using the "Save data" operation, an exception is thrown. Attached is a copy of the associated traceback:

Traceback (most recent call last): File "/usr/local/juicer/juicer/spark/spark_minion.py", line 478, in _perform_execute raise ex from None File "/usr/local/juicer/juicer/spark/spark_minion.py", line 474, in _perform_execute self._emit_event(room=job_id, namespace='/stand')) File "/tmp/juicer_app_2_2_3.py", line 284, in main task_futures['20eb90eb-d454-450e-aa30-50e0b0fa1d1f'].result() File "/usr/lib/python3.7/concurrent/futures/_base.py", line 435, in result return self.__get_result() File "/usr/lib/python3.7/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/lib/python3.7/concurrent/futures/thread.py", line 57, in run result = self.fn(*self.args, **self.kwargs) File "/tmp/juicer_app_2_2_3.py", line 283, in <lambda> lambda: data_writer_1(spark_session, cached_state, emit_event)) File "/tmp/juicer_app_2_2_3.py", line 187, in data_writer_1 header) TypeError: 'JavaPackage' object is not callable

Below is an image of the operations used to produce the error:

This error does not occur when using the scikit-learn, and the data set can be saved without any problems on that platform

The steps to install the locally where the instructions contained in https://github.com/eubr-bigsea/docker-lemonade, with the docker images being download from docker-hub.

The eubrabigsea/juicer docker image ID associated is c4287f835c64, downloaded using the most up to date installation.