Commit Graph

142 Commits

Author SHA1 Message Date
Bartosz Sypytkowski 2d9a024554 chore: use redis stream router 2024-11-07 07:18:20 +01:00
Bartosz Sypytkowski f3cd597832 chore: fix clippy errors 2024-11-06 10:57:32 +01:00
Bartosz Sypytkowski 3fc49a8b21 chore: turn off collab preindexing 2024-11-06 10:10:55 +01:00
Bartosz Sypytkowski 863e405263 chore: add more precise logging on get unindexed collabs 2024-11-06 08:04:07 +01:00
Bartosz Sypytkowski 99203cc7f3 chore: fix flaky tests 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 25f0461389 chore: added metrics for new stateless operations 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski e86c9de316 chore: when saving collab snapshot, do not load it unless there are pending updates in redis 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 961c482995 chore: prevent hot loops in collab updates stream 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 2511bd720d chore: fix clippy errors 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski ce793fa03e chore: make collab group prune grace period configurable 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 395424bfd2 chore: detect and re-request missing updates on the server side 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski a99f986270 chore: removed appflowy history 2024-11-05 07:48:12 +01:00
Bartosz Sypytkowski 81dc66fa7b chore: fix clippy warnings 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski f684d3623d chore: fixed collab ack 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski fc1a7d28e2 chore: better stress test scenario 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski de4016659e chore: add break in cancellation of snapshot task 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d624cdf49b chore: turn off separate appflowy history process 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski a2d3d7feb5 chore: add perf tests 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 279a599b66 chore: fix early return from redis collab update stream reader 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 85e25f887c chore: don't try to prune empty redis stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d0b7c7d8e3 chore: update stream - live and current queries 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 61820d7226 chore: more traces in collab group 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski a1546909c3 chore: remove server sync protocol (not used anymore) 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 00f5a5bb7e chore: code cleanup 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 3e612e2db6 chore: create method for receiving the most recent snapshot 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 9c674d5777 chore: changes to make appflowy cloud compile under the latest appflowy collab 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski bee7caedac chore: attach indexer to collab persister 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 97335a94ec chore: basics of snapshots (unoptimized) 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 253bb97825 chore: a dirty draft of snapshot saving 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 9164c494b1 chore: redis stream for awareness 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d26d0ff1a7 chore: collab streams 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 0d6b595ee8 chore: create collab update sink and stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski fe3611cc88 chore: remove broadcast and introduce lease 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d3d3378b86 chore: draft of stateless collab group 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 6aed9609b9 chore: removed realtime shared state tests 2024-11-04 09:21:10 +01:00
Bartosz Sypytkowski 356cf5d132 chore: fix clippy errors 2024-11-04 08:29:32 +01:00
Bartosz Sypytkowski f105c2dbc2 chore: fix clippy errors 2024-11-04 08:20:56 +01:00
Bartosz Sypytkowski f9397eaaf2 chore: remove realtime shared state 2024-11-04 07:58:16 +01:00
Khor Shu Heng 9eb1c36c92
chore: access control interface to return error instead of boolean (#914) 2024-10-21 20:20:14 +08:00
Nathan.fooo ffee47d0f7
chore: remove workspace and collab listener (#893) 2024-10-17 17:43:00 +08:00
Khor Shu Heng 8ab5da4aef
fix: limit concurrency level of batch get encode collab (#892) 2024-10-17 13:29:27 +08:00
khorshuheng 383629ab1c chore: simplify not enough permission error 2024-10-16 15:10:31 +08:00
Nathan.fooo 1616ceaf4f
chore: use workspace deps (#880) 2024-10-14 16:02:22 +08:00
Khor Shu Heng 8c14612f98
feat: refactor access control to enable swapping implementation (#859) 2024-10-10 13:04:47 +08:00
Nathan.fooo 33e63fae5c
chore: try to fix pg lock timeout (#864)
* chore: try to fix pg lock timeout

* chore: add logs for insert collab

* chore: add timeout for duplicate

* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
Nathan.fooo 38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint (#862)
* chore: using copy to improve write speed of batch collab api endpoint

* chore: insert to redis

* chore: fix compile
2024-10-07 08:58:19 +08:00
Nathan.fooo 9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
Khor Shu Heng 11732324b5
feat: support fetching encoded collab in batch from memory (#837) 2024-10-02 10:22:40 +08:00
Nathan.fooo 4c54481d70
chore: bump collab version (#822)
* chore: bump collab version

* chore: update deps count
2024-09-14 23:59:50 +08:00
Nathan.fooo a4b885e13b
chore: set exp time for collab base on collab type (#820)
* chore: set exp time for collab base on collab type

* chore: fix test
2024-09-13 19:04:56 +08:00