spark-fits write mode

[jacobic]

Hi Julien,

Long time no speak! :)

I still use this package every day and was just wondering if you considered creating a 'fits' writer interface? For instance the ability to group a pyspark dataframe by a number of columns and then to write to fits in directories which are partitioned by the values in the columns? At the moment I use a combination of pandas_udfs and astropy.table to do this but it is a bit messy and would be a lot cooler (and better performance) if it works out of the box with spark-fits

Please let me know what you think.

Thanks again,
Jacob

[JulienPeloton]

Hi Jacob,

Sorry for the long delay to answer... Although I reckon it would be nice to have, there is no plan currently to add a FITS writer in spark-fits. This is a huge task, and I have no resources to work on this. I'll let you know if this change in the future.

[jacobic]

Hi Julien,

No worries at all! Thanks again for all the time and effort you have already spent on this.

Cheers,
Jacob