Commit Graph

69 Commits

Author SHA1 Message Date
Bartosz Sypytkowski ed07104aeb chore: remove from editing collab param in get encode collab method 2024-12-14 09:42:15 +01:00
Bartosz Sypytkowski dfe780d30c chore: fix linter errors 2024-12-14 09:22:42 +01:00
Bartosz Sypytkowski 41e9302ff9 Merge branch 'main' into stateless 2024-12-12 16:00:45 +01:00
Nathan.fooo af38efe6d9
feat: sync document through http request (#1064)
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
Bartosz Sypytkowski 813179fdb0
chore: Remove async awaits from RealtimeServerActor (#1059)
* chore: reduce number of async await methods in connection manager

* chore: remove async handlers from rt actor
2024-12-10 15:20:28 +08:00
Bartosz Sypytkowski b2f8a95ec4 chore: setup new collab in the db 2024-12-05 06:29:19 +01:00
Bartosz Sypytkowski 5e7b5f87fa chore: merge branch main into stateless 2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski b91a5fac8e chore: post merge fixes 2024-11-20 08:56:16 +01:00
Bartosz Sypytkowski 06b7ce0a29 chore: post merge fixes 2024-11-16 07:33:18 +01:00
Bartosz Sypytkowski 401cc3ad25 Merge branch 'main' into stateless 2024-11-16 07:22:34 +01:00
Nathan.fooo 91b0c50722
chore: remove logs (#986) 2024-11-13 13:59:23 +08:00
Nathan.fooo 9778843746
chore: disable history service (#985)
* chore: disable history service

* chore: fix build
2024-11-13 10:46:15 +08:00
Bartosz Sypytkowski eb54947ab7 chore: add config option for redis stream group workers count 2024-11-08 04:39:44 +01:00
Bartosz Sypytkowski b9ca480143 chore: add retry limit to which collab snapshot can be made 2024-11-07 13:12:17 +01:00
Bartosz Sypytkowski bc49d73b40 chore: split redis stream readers to active and one shot 2024-11-07 11:43:19 +01:00
Bartosz Sypytkowski 3fc49a8b21 chore: turn off collab preindexing 2024-11-06 10:10:55 +01:00
Bartosz Sypytkowski 99203cc7f3 chore: fix flaky tests 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 25f0461389 chore: added metrics for new stateless operations 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski e86c9de316 chore: when saving collab snapshot, do not load it unless there are pending updates in redis 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 961c482995 chore: prevent hot loops in collab updates stream 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 2511bd720d chore: fix clippy errors 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski ce793fa03e chore: make collab group prune grace period configurable 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 395424bfd2 chore: detect and re-request missing updates on the server side 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 81dc66fa7b chore: fix clippy warnings 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski f684d3623d chore: fixed collab ack 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski fc1a7d28e2 chore: better stress test scenario 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski de4016659e chore: add break in cancellation of snapshot task 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d624cdf49b chore: turn off separate appflowy history process 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski a2d3d7feb5 chore: add perf tests 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 279a599b66 chore: fix early return from redis collab update stream reader 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 85e25f887c chore: don't try to prune empty redis stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d0b7c7d8e3 chore: update stream - live and current queries 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 61820d7226 chore: more traces in collab group 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski a1546909c3 chore: remove server sync protocol (not used anymore) 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 00f5a5bb7e chore: code cleanup 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 3e612e2db6 chore: create method for receiving the most recent snapshot 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 9c674d5777 chore: changes to make appflowy cloud compile under the latest appflowy collab 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski bee7caedac chore: attach indexer to collab persister 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 97335a94ec chore: basics of snapshots (unoptimized) 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 253bb97825 chore: a dirty draft of snapshot saving 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 9164c494b1 chore: redis stream for awareness 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d26d0ff1a7 chore: collab streams 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 0d6b595ee8 chore: create collab update sink and stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski fe3611cc88 chore: remove broadcast and introduce lease 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d3d3378b86 chore: draft of stateless collab group 2024-11-05 07:47:17 +01:00
Nathan.fooo 4c54481d70
chore: bump collab version (#822)
* chore: bump collab version

* chore: update deps count
2024-09-14 23:59:50 +08:00
Nathan.fooo fff93e6083
chore: Adjust gen history interval (#812)
* chore: adjust generate history interval

* chore: disable verbose log
2024-09-11 13:45:53 +08:00
Zack 826546c5cb
feat: duplicate published doc (#700)
* chore: test collab sync

* feat: folder view for user workspace

* feat: add private indicator

* chore: use collab cache instead

* chore: initial impl

* chore: cargo sqlx

* fix: write back to collab cache

* fix: assign page id

* fix: text map

* chore: connect api and refactor

* chore: switch to using mem storage

* fix: collab type

* feat: use group manager to manage sync

* feat: try add send command instead

* chore: add client api code

* feat: try use sink and stream from group collab

* chore: disable sync first

* fix: insert page before stopping group

* feat: add extra for view

* feat: add metadata to doc

* fix: icon

* fix: page circular dep

* fix: page circular dep

* fix: live update

* feat: database initial impl

* feat: workspace database

* chore: link database

* fix: database validation

* fix: workspace database oid

* fix: workspace database oid

* fix: specify view layout

* feat: add txn when inserting collab and rework database views

* fix: parent view id for new database

* fix: database view for folder

* fix: database ids

* fix: database row id

* fix: main database layout and write database before folder

* fix: metadata for non database main view

* chore: database in doc wip

* chore: filter visible views

* chore: use structure value instead of json

* chore: database in doc wip

* fix: remove child item push

* fix: main database view meta

* chore: rework inline database in doc

* fix: make duplicate more error forgiving

* chore: use get instead of get key value

* chore: merge with main

* feat: set max depth for folder view

* chore: update dependency counter

* chore: remove unneeded arg

* chore: simplify collab new from source

* chore: remove unneeded param

* chore: rename and doc

* feat: rework inline database and use duplicated ref

* chore: simplify params

* chore: fmt

* feat: deduplicate database wip

* fix: compatible with newer appflowy version

* fix: database views

* feat: database in doc

* chore: cargo clippy

* chore: update dockerfile rust toolchain

* fix: doc inline db parent id

* fix: database id

* fix: document data modification

* chore: minor refactor and todo

* chore: remove unneeded nesting

* fix: enforce ordering for views to add

* chore: add doc and test case for folder view

* fix: remove the need for cloning published collab

* fix: some review

* chore: move folder conversion logic

* fix: remove collab folder deps on shared entity

* chore: cargo fmt

* fix: compile

* chore: remove group manager dependency

* fix: dep count

* fix: add messages sent by server

* fix: dep count

* chore: add test for doc ref and inline doc database

* chore: cargo clippy

* chore: add more test scenarios

* chore: fix tests

* chore: get database id

* chore: update collab

* chore: add more assert and database row id checks

* fix: suggestions from review

* chore: sqlx

* fix: accumulate collab before insert

* chore: add tokio spawn blocking for encoding

* fix: reduce limit for publish collabs

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
Co-authored-by: nathan <nathan@appflowy.io>
2024-09-03 09:12:29 +08:00
Nathan.fooo c2a5369313
chore: set chat request timeout (#777)
* chore: set chat request timeout

* chore: clippy
2024-09-01 15:16:11 +08:00
Bartosz Sypytkowski f75413566e chore: reconnect realtime metrics 2024-08-30 09:56:51 +02:00