Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generating DCAT feed eats memory #403

Open
pietercolpaert opened this issue May 10, 2016 · 5 comments
Open

Generating DCAT feed eats memory #403

pietercolpaert opened this issue May 10, 2016 · 5 comments
Assignees
Milestone

Comments

@pietercolpaert
Copy link
Member

I now get this error on demo.thedatatank:

[Tue May 10 14:56:04.860052 2016] [:error] [pid 6551] [client 78.21.55.178:55568] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 78 bytes) in /home/tdt/demo/core/bootstrap/compiled.php on line 6199
@coreation
Copy link
Member

coreation commented May 10, 2016

How much memory is assigned? (check php.ini)

I'll check if we're caching this properly.

@coreation coreation added this to the TDT 6.06 milestone May 10, 2016
@pietercolpaert
Copy link
Member Author

As the error message says: 134217728 bytes ;)

But it really should not take that much memory to get a DCAT feed with only a few datasets, right?

@coreation
Copy link
Member

Depends, we're working on more meta-data right now, but normally it should not.

@coreation
Copy link
Member

Wasn't due to the DCAT, it was because on our demo server needed some maintenance :).

@pietercolpaert
Copy link
Member Author

Reopening this: seems like EasyRDF is a horrible library concerning performance and memory. I’m soon launching the Hardf library which also support quads:
pietercolpaert/hardf#5

I get a 200 times faster parsing speed with Hardf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants