Hoisted Range Fetch (no, hoisted filters)

[tantaman]

While implementing Linearite I ran into this problem --

Deleting an issue requires deleting all comments. Displaying an issue requires displaying all comments.

The comments collection is sorted by issueId and then createdTime which means we can quickly look up all issues for a comment.

We, however, don't have a hoisted way to bound this.

We can do:

db.comments.after({issueId: xxx}).limit(y)

but we don't know the correct value for y since we don't know when the comments for the issue end.

We need:

db.comments.after({issueId: xxx}).before({issueId: yyy});

hmm.. even that doesn't work well since it assumes we know the next issue id.

This would be ideal:

db.comments.filter({issueId: xxx});

but filter is currently not hoisted (hoisted = run by the backing data source). We need hoisted filters so we don't scan the entire source set.

---

We'll need to re-implement something like SourceExpressions from Aphrodite into Materialite so we can hoist operators to the provided backend (SQL, IndexedDB, memory, other).

• Related: Equality by key? #13
• Related: https://tantaman.com/2022-05-26-query-planning.html