Adding denoKV to doc drivers

[ssv0]

Hi, sneakspeak dev here: to make earthstar server deployable on "deno deploy" I added support to denokv doc driver, modding localstorage driver. So if you look to add support for deno kv the modded driver is in this repo:

https://github.com/ssv0/denodeploy-denokv

Feel free to take inspiration or add it to main repo. Maybe it would be better to use different keys instead of putting all docs in an entry.

[sgwilym]

Thank you for sharing this, and for creating this driver.

I see that you use the memory attachment driver, do you not use attachments?
How is sync on deno deploy? Do the websocket connections live long enough for sync to happen?

You're right that putting data in different keys would be (vastly) better than a single entry. The reason that this approach is workable with LocalStorage is because it can store a maximum of 5mb. Deno KV can take much more, so performance will degrade as the number of stored docs grows.

The next version of Earthstar will have a ground-up Deno.KV driver via willow-js: https://github.com/earthstar-project/willow-js/blob/main/src/store/storage/kv/kv_driver_deno.ts

There will be initial builds of willow-powered Earthstar in the coming months. Would you be interested in trying it, and seeing how it is to migrate sneakspeak to it?

[ssv0]

I still have to test denokv, as far as I know there seem to be problems when new instances are launched with an existing (because it's global) kv but maybe I just misconfigured the client. I think sneakspeak will benefit from willow features so I'm definitely trying it out.

[sgwilym]

@ssv0 Sorry, realised I never updated you on this. Earthstar 11 now has a beta available: https://jsr.io/@earthstar/[email protected]

Soon it'll also get sneakernet-style capabilities via Willow's new sideloading protocol.

[ssv0]

Hi I have seen some sample code in the repo, many useful features for sneakspeak so eventually I'll update it. The general idea is to use earthstar to shuffle around messages and surrealdb (which is currently slow but runs on browser and as app server, very flexible) to provide indexing capabilities for the content. Generalizing the idea would result in some kind of decentralized kappa architecture which for me is the way forward, as a personal project it depends on my free time though. Ciao! Il venerdì 7 giugno 2024 alle ore 12:41:33 CEST, Sam Gwilym ***@***.***> ha scritto: @ssv0 Sorry, realised I never updated you on this. Earthstar 11 now has a beta available: ***@***.******@***.*** Soon it'll also get sneakernet-style capabilities via Willow's new sideloading protocol. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>