Clarifications to datacake-sqlite readme

[canadaduane]

I'm approaching this project as a newcomer and have a couple of questions about the datacake-sqlite integration.

1. How does datacake-sqlite relate to sqlite? Specifically, can I query whatever it produces using SQL?
2. Is it possible to modify the sqlite storage using SQL, and if so, is there any expectation that these updates will eventually be consistent with other datacake nodes?
3. Is the double negative in these assertion sentences a mistake? "No document should not exist!"

Thank you!

[ChillFish8]

Hello! I'm sorry for not getting back to you sooner.

Yes, the readme probably could do with being improved and a bit more explicit:

How does datacake-sqlite relate to sqlite? Specifically, can I query whatever it produces using SQL?
You can but only the API provided via datacake in the form of the KV interface will be managed by datacake.
SQLite is effectively a glorified KV store here, primarily for convenience when testing or a small bit of data, it isn't able to replicate SQL commands across and apply them (unless you implement a more custom solution which is possible.)

Is the double negative in these assertion sentences a mistake? "No document should not exist!"
Yes :)

[AdamJSoftware]

Are there any plans of having full SQL capability? What is the current limitation of having full SQLite capabilities being compatible with Datacake's eventual consistency?

[ChillFish8]

Are there any plans of having full SQL capability? What is the current limitation of having full SQLite capabilities being compatible with Datacake's eventual consistency?

One would need to replace SQLIte's underlying KV store with a wrapper in order to correctly reflect changes.

The reason for this is executing a SQL statement can create changes on multiple rows, and do not work well when you have multiple statements being executed and need to apply those changes in the correct order.

The eventual consistency nature of datacake makes applying the statements in the right order is nearly impossible.

[AdamJSoftware]

Once RAFT consensus is implemented, do you think it'll be easier?

[ChillFish8]

Something like RAFT would indeed make it easier to do, it wouldn't be the same as the eventually consistent store, but that would be a good thing.

Currently the biggest blocker for any sort of raft support is the eco system still feels a bit unstable / unimplemented currently.