import process crashes with invalid file (no errors reported)

[matthewhegarty]

I am running the example application on Docker. I find that the process crashes when using an incomplete 'artists' file. I don't see any error message or warnings, the celery container eventually crashes with 'out of memory' error.

To reproduce (I have a branch here which runs the application in Docker - docker compose up --build):

1. Go to Artist import
2. Leave Resource on default of 'ArtistResourceWithM2M'
3. Choose the attached file (change name to 'artists.csv')
4. Click import

You will see the following requests:

In my Docker instance (running on MacOS) I see this error after about 5 mins:

[ERROR] Worker (pid:19) was sent SIGKILL! Perhaps out of memory?

No other errors are reported.

If you import the file 'artists-sm.csv' it runs fine (ensure an 'Instrument' FK exists with id=1).

artists.csv.txt
artists-sm.csv.txt

[matthewhegarty]

btw - it's taken me a little while to get the test_project up and running - I'm happy to add this to the documentation if that's of interest?

[Eg0ra]

Hi @matthewhegarty ,

I found out the reason for out of memory, it happens when trying to render template. I removed extra loop, please try, will this fix your error?

[matthewhegarty]

Thanks - AFAICT it has the same issue. I merged your branch and pushed here.

btw - am in the django-import-export discord if it helps.