Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQLite index very slow #8

Closed
tskisner opened this issue Jul 17, 2017 · 1 comment
Closed

SQLite index very slow #8

tskisner opened this issue Jul 17, 2017 · 1 comment
Assignees
Labels

Comments

@tskisner
Copy link
Member

The SQLite index is so slow that it is a blocking factor. Looking through the code, there are several key mistakes:

  1. prepared statements are re-created every transaction, rather than creating once and binding values.
  2. When doing a single meta-data operation (adding or deleting one object), then it is fine to make that a single transaction. When replaying an long list of operations, these should be batched into a single transaction.
@tskisner tskisner added the bug label Jul 17, 2017
@tskisner tskisner added this to the Public Release milestone Jul 17, 2017
@tskisner tskisner self-assigned this Jul 17, 2017
@tskisner
Copy link
Member Author

This problem was addressed mainly by 481fc62, and also the following commit which used PRAGMA options to sqlite to configure it for better performance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant