Commit Graph

28 Commits

Author SHA1 Message Date
Bartosz Sypytkowski cc6b58f73d chore: add metrics to redis collab stream 2025-01-03 08:44:36 +01:00
nathan 971aa6d3e1 chore: map error 2024-12-20 10:13:16 +08:00
Bartosz Sypytkowski eb54947ab7 chore: add config option for redis stream group workers count 2024-11-08 04:39:44 +01:00
Bartosz Sypytkowski bc49d73b40 chore: split redis stream readers to active and one shot 2024-11-07 11:43:19 +01:00
Bartosz Sypytkowski 2d9a024554 chore: use redis stream router 2024-11-07 07:18:20 +01:00
Bartosz Sypytkowski f328e96763 chore: reduce log visibility level 2024-11-06 07:31:32 +01:00
Bartosz Sypytkowski 25f0461389 chore: added metrics for new stateless operations 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski e86c9de316 chore: when saving collab snapshot, do not load it unless there are pending updates in redis 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski b6ba52672a chore: add exponential backoff to collab update stream 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 961c482995 chore: prevent hot loops in collab updates stream 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 279a599b66 chore: fix early return from redis collab update stream reader 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 85e25f887c chore: don't try to prune empty redis stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d0b7c7d8e3 chore: update stream - live and current queries 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 00f5a5bb7e chore: code cleanup 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 97335a94ec chore: basics of snapshots (unoptimized) 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 253bb97825 chore: a dirty draft of snapshot saving 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 9164c494b1 chore: redis stream for awareness 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d26d0ff1a7 chore: collab streams 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 0d6b595ee8 chore: create collab update sink and stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski fe3611cc88 chore: remove broadcast and introduce lease 2024-11-05 07:47:17 +01:00
Nathan.fooo 054fd2e7d8
chore: ignore create redis stream error when create a new group (#826) 2024-09-16 15:31:05 +08:00
Nathan.fooo 115d046094
chore: periodicall check redis stream capacity (#580) 2024-05-27 14:09:57 +08:00
Nathan.fooo 3f2d5f0785
chore: optimize redis stream space usage (#579)
* chore: set maxlen for redis stream

* chore: update log

* chore: set expiration time
2024-05-27 13:22:14 +08:00
Nathan.fooo 2736fa60a7
chore: integrate redis stream (#559)
* chore: integrate redis stream

* chore: make CollabUpdateStreaming::send_update synchronous

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
2024-05-18 08:28:57 +08:00
Nathan.fooo 28e0e74fd1
feat: Implement history(1) (#466)
* chore: update collab commit

* chore: collab history test

* chore: collab history test

* chore: impl redis stream

* chore: impl redis stream test

* chore: impl migration

* chore: implement history sql

* chore: add test

* chore: add test

* chore: fix test

* chore: update log and test

* chore: add xtask

* chore: clippy

* chore: impl api

* chore: add missing sqlx files

* chore: fix test

* chore: fix test
2024-04-15 09:18:19 +08:00
Nathan.fooo 15a07a61e7
feat: implement redis pubsub (#403)
* chore: implement redis pubsub

* chore: fix warns

* chore: use bincode to do serdde
2024-03-20 17:46:01 +08:00
Nathan.fooo d4845a6784
feat: group stream (#399)
* feat: group stream

* chore: update
2024-03-20 11:24:31 +08:00
Zack de92490e26
feat: collab-stream redis poc (#83)
* feat: collab-stream redis poc

* fix: remove unneeded print statements

* feat: implementing listening

* chore: fix conflict

* chore: add test

* chore: add test

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-03-20 10:00:25 +08:00