Commit Graph

301 Commits

Author SHA1 Message Date
Nathan.fooo 3623d9f296
chore: check file md5 before import (#895) 2024-10-17 17:18:07 +08:00
Khor Shu Heng 8ab5da4aef
fix: limit concurrency level of batch get encode collab (#892) 2024-10-17 13:29:27 +08:00
Nathan.fooo 9942e68089
chore: imported workspace should not become the latest visting workspace (#890)
* chore: imported workspace should not become the latest visting workspace

* chore: sqlx files

* chore: update test

* chore: fmt
2024-10-16 21:02:05 +08:00
Nathan.fooo d3e4a6870d
chore: template (#889)
* chore: template

* fix: auto del file lifetime

* chore: delete file if fail to write to disk

* fix: modified html

* chore: set content type

* chore: md5 content

* chore: clippy

* fix: image loaded failed

* fix: build

* chore: bump collab

---------

Co-authored-by: Kilu <lu@appflowy.io>
2024-10-16 17:39:24 +08:00
Khor Shu Heng ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
feat: additional access control config
2024-10-16 17:00:54 +08:00
khorshuheng 383629ab1c chore: simplify not enough permission error 2024-10-16 15:10:31 +08:00
Nathan.fooo d89cbe1c8c
chore: support streaming unzip using env (#888) 2024-10-16 14:02:03 +08:00
Nathan.fooo 3c02fa253f
chore: retry import (#887)
* chore: retry import

* chore: delete temp files

* chore: bump collab
2024-10-16 12:55:53 +08:00
Nathan.fooo 2b02a8d12b
chore: bump collab (#884) 2024-10-15 15:56:14 +08:00
Nathan.fooo 1616ceaf4f
chore: use workspace deps (#880) 2024-10-14 16:02:22 +08:00
Nathan.fooo 95e8b30f11
chore: bump collab that use yrs 0.21.2 (#872)
* chore: bump collab that use yrs 0.21.2

* chore: fmt
2024-10-14 00:58:32 +08:00
Nathan.fooo bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Nathan.fooo 14cfaa0bbd
chore: insert metadata after import notion zip file (#871)
* chore: insert metadata after import notion zip file

* chore: update logs
2024-10-10 22:32:02 +08:00
Khor Shu Heng 8c14612f98
feat: refactor access control to enable swapping implementation (#859) 2024-10-10 13:04:47 +08:00
Nathan.fooo 98347b81ea
fix: import notion zip file as workspace (#868)
* chore: insert content length in header

* chore: custom header

* chore: workspace name

* chore: file name

* chore: handle file name that is not utf8 encode

* chore: clippy

* fix: end of file when unzip file

* chore: docs
2024-10-09 21:27:24 +08:00
Nathan.fooo 33e63fae5c
chore: try to fix pg lock timeout (#864)
* chore: try to fix pg lock timeout

* chore: add logs for insert collab

* chore: add timeout for duplicate

* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
Nathan.fooo 820db6564e
chore: create space view for imported notion zip file (#863) 2024-10-07 12:41:45 +08:00
Nathan.fooo 38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint (#862)
* chore: using copy to improve write speed of batch collab api endpoint

* chore: insert to redis

* chore: fix compile
2024-10-07 08:58:19 +08:00
Nathan.fooo 9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
Khor Shu Heng 11732324b5
feat: support fetching encoded collab in batch from memory (#837) 2024-10-02 10:22:40 +08:00
Nathan.fooo 4c54481d70
chore: bump collab version (#822)
* chore: bump collab version

* chore: update deps count
2024-09-14 23:59:50 +08:00
Nathan.fooo a4b885e13b
chore: set exp time for collab base on collab type (#820)
* chore: set exp time for collab base on collab type

* chore: fix test
2024-09-13 19:04:56 +08:00
nathan 96896101d4 chore: fix build 2024-09-12 00:47:16 +08:00
Nathan.fooo 1ccff73e49
chore: bump appflowy collab (#814)
* chore: bump appflowy collab

* chore: fix build
2024-09-12 00:28:26 +08:00
Nathan.fooo fff93e6083
chore: Adjust gen history interval (#812)
* chore: adjust generate history interval

* chore: disable verbose log
2024-09-11 13:45:53 +08:00
Nathan.fooo 07d6001cf8
chore: check before write to hisotry (#809)
* chore: check before write to hisotry

* chore: clippy

* chore: clippy

* chore: calculate edit count

* chore: clippy

* chore: exit loop

* chore: exit loop

* chore: update log
2024-09-10 22:10:59 +08:00
Nathan.fooo 5d356718fa
fix: using spawn_blocking in order to not block the runtime (#793)
* fix: using blocking in order to not block the runtime

* chore: increase deps count
2024-09-05 09:19:34 +08:00
Zack 826546c5cb
feat: duplicate published doc (#700)
* chore: test collab sync

* feat: folder view for user workspace

* feat: add private indicator

* chore: use collab cache instead

* chore: initial impl

* chore: cargo sqlx

* fix: write back to collab cache

* fix: assign page id

* fix: text map

* chore: connect api and refactor

* chore: switch to using mem storage

* fix: collab type

* feat: use group manager to manage sync

* feat: try add send command instead

* chore: add client api code

* feat: try use sink and stream from group collab

* chore: disable sync first

* fix: insert page before stopping group

* feat: add extra for view

* feat: add metadata to doc

* fix: icon

* fix: page circular dep

* fix: page circular dep

* fix: live update

* feat: database initial impl

* feat: workspace database

* chore: link database

* fix: database validation

* fix: workspace database oid

* fix: workspace database oid

* fix: specify view layout

* feat: add txn when inserting collab and rework database views

* fix: parent view id for new database

* fix: database view for folder

* fix: database ids

* fix: database row id

* fix: main database layout and write database before folder

* fix: metadata for non database main view

* chore: database in doc wip

* chore: filter visible views

* chore: use structure value instead of json

* chore: database in doc wip

* fix: remove child item push

* fix: main database view meta

* chore: rework inline database in doc

* fix: make duplicate more error forgiving

* chore: use get instead of get key value

* chore: merge with main

* feat: set max depth for folder view

* chore: update dependency counter

* chore: remove unneeded arg

* chore: simplify collab new from source

* chore: remove unneeded param

* chore: rename and doc

* feat: rework inline database and use duplicated ref

* chore: simplify params

* chore: fmt

* feat: deduplicate database wip

* fix: compatible with newer appflowy version

* fix: database views

* feat: database in doc

* chore: cargo clippy

* chore: update dockerfile rust toolchain

* fix: doc inline db parent id

* fix: database id

* fix: document data modification

* chore: minor refactor and todo

* chore: remove unneeded nesting

* fix: enforce ordering for views to add

* chore: add doc and test case for folder view

* fix: remove the need for cloning published collab

* fix: some review

* chore: move folder conversion logic

* fix: remove collab folder deps on shared entity

* chore: cargo fmt

* fix: compile

* chore: remove group manager dependency

* fix: dep count

* fix: add messages sent by server

* fix: dep count

* chore: add test for doc ref and inline doc database

* chore: cargo clippy

* chore: add more test scenarios

* chore: fix tests

* chore: get database id

* chore: update collab

* chore: add more assert and database row id checks

* fix: suggestions from review

* chore: sqlx

* fix: accumulate collab before insert

* chore: add tokio spawn blocking for encoding

* fix: reduce limit for publish collabs

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
Co-authored-by: nathan <nathan@appflowy.io>
2024-09-03 09:12:29 +08:00
Nathan.fooo 365c64c5c2
chore: use colla storage instead of select from db directly (#782) 2024-09-02 21:25:21 +08:00
Nathan.fooo 299680c14a
chore: decode encode collab using spawn blocking (#781) 2024-09-02 20:27:40 +08:00
Nathan.fooo abd96d8b56
chore: add APPFLOWY_COLLAB_REMOVE_BATCH_SIZE env to control num of co… (#779)
* chore: add APPFLOWY_COLLAB_REMOVE_BATCH_SIZE env to control num of collabs to be removed in one tick

* chore: clippy
2024-09-02 11:24:40 +08:00
Nathan.fooo c2a5369313
chore: set chat request timeout (#777)
* chore: set chat request timeout

* chore: clippy
2024-09-01 15:16:11 +08:00
Bartosz Sypytkowski 6972f9c4ab
feat: Measure sync (#772)
* chore: redesign collab sync protocol to enable injection of metric tracking

* chore: track metrics for apply update on the server side

* chore: close locks

* chore: post rebase fixes
2024-08-30 21:48:19 +08:00
Bartosz Sypytkowski f75413566e chore: reconnect realtime metrics 2024-08-30 09:56:51 +02:00
Nathan.fooo 1f9a03a83d
chore: enable lock timeout feature (#771) 2024-08-30 14:24:34 +08:00
Nathan.fooo 3e701a1f8b
chore: remove no require data error log (#766)
* chore: remove no require data error log

* chore: clippy
2024-08-30 13:55:53 +08:00
Bartosz Sypytkowski 5b2b717fe7 chore: remove redundant metrics collector 2024-08-30 05:14:44 +02:00
Nathan.fooo 54b811125e
chore: wrap spawn blocking when decoding collab (#767) 2024-08-29 22:53:33 +08:00
Bartosz Sypytkowski 2af1999375
chore: added locks with timeouts (#765)
* chore: added locks with timeouts

* chore: roll back collab locks in client api
2024-08-29 16:13:27 +08:00
Lucas.Xu e7bf221ff0
feat: update built-in README for new users (#757)
* feat: add getting_started, desktop_guide and mobile_guide json

* feat: update built-in readme data

* feat: support adding database as template

* feat: support creating nested documents

* chore: refactor code

* chore: refactor code

* chore: remove println

* chore: update collab version

* feat: update built-in readme and image ref

* chore: remove template icon

* feat: use database::create_with_view to create collab

* chore: add template tests

* chore: update collab version

* chore: remove debug code

* chore: add comment

* chore: fix lint & test

* fix: code review

* fix: rust lint

* chore: update comment

* test: add default workspace test

* test: add default user workspace test

* chore: use workspace database body

* chore: fix typo and clippy

* fix: insert_folder_data_success test

* fix: insert_folder_data_success test

* feat: update content in gettting_started

* chore: update to-dos json

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-08-28 19:40:23 +08:00
Bartosz Sypytkowski 8beac5c85f
chore: reuse group collab for indexing (#737)
* chore: reuse group collab for indexing

* chore: fix linting errors

* chore: post rebase fixes
2024-08-28 00:13:41 +08:00
Nathan.fooo ab14568bbf
chore: use env to use control multiple thread runtime or not (#760) 2024-08-28 00:13:24 +08:00
nathan fee2c37aa4 chore: disable multiple thread in group 2024-08-27 18:12:11 +08:00
Nathan.fooo c8ee6b43ee
chore: try to fix inifinite sync (#756) 2024-08-27 16:41:19 +08:00
Nathan.fooo a21c55cbcc
chore: modify log level for some cases (#754)
* chore: modify log level for some cases

* chore: update logs
2024-08-27 14:57:00 +08:00
Khor Shu Heng 045b6f09cb
feat: add metrics for number of editing users (#730) 2024-08-27 11:56:07 +08:00
Bartosz Sypytkowski 15b2e81579
chore: enable setting up periodic sync step 1 sends from sync plugin (#738)
* chore: enable setting up periodic sync step 1 sends from sync plugin

* chore: rollback to server sending sync step 1 to response to the client

* chore: increase sync step 1 interval in tests
2024-08-27 11:55:27 +08:00
Nathan.fooo cbb9adc29d
chore: enable multiple threads (#753) 2024-08-27 11:15:54 +08:00
Khor Shu Heng c182ad7099
Merge pull request #750 from AppFlowy-IO/ws-client-min-version
add minimum client version validation in websocket connection establishment
2024-08-27 01:35:20 +08:00
Nathan.fooo 8cc410ce65
chore: revamp get collab api request (#752)
* chore: stop retry if record is not found
2024-08-26 23:41:06 +08:00
Bartosz Sypytkowski 8d1d563076 chore: fix formatting 2024-08-26 14:20:39 +02:00
Bartosz Sypytkowski 11bbb70d54 chore: add minimum client version validation in websocket connection establishment 2024-08-26 14:14:04 +02:00
Nathan.fooo 364d31f825
chore: drop group with maximum timeout (#747) 2024-08-26 17:01:42 +08:00
nathan c77d0f9c2c chore: spawn indexer 2024-08-26 09:47:46 +08:00
Nathan.fooo d111282f7e
fix: panic when apply invalid update (#745) 2024-08-24 14:55:49 +08:00
Nathan.fooo 1122031735
chore: update group active (#743)
* chore: opti logs

* chore: update group active logic

* chore: fmt
2024-08-24 09:43:12 +08:00
nathan b4d79b954b chore: update logs 2024-08-23 10:30:52 +08:00
nathan 12a1539f32 chore: initialize before lock collab 2024-08-22 23:26:20 +08:00
Nathan.fooo 1a053172c2
chore: write collab to disk after first sync step2 (#739)
* chore: write collab to disk after first sync step2

* chore: clippy

* chore: fix test & disable history plugin

* chore: upgrade appflowy collab that disbale document undo redo
2024-08-22 23:11:20 +08:00
Bartosz Sypytkowski ae3833ea91
chore: Remove last sync at (#735)
* chore: remove last sync at field

* chore: post rebase fixes

* chore: update test for missing update detection
2024-08-22 07:47:01 +08:00
nathan 2d7a4bde92 Merge branch 'main' into no-lock-collab 2024-08-19 10:38:07 +08:00
nathan 809d0df607 chore: only log on debug 2024-08-16 20:48:43 +08:00
Bartosz Sypytkowski d503905931 chore: make sync plugin work over any collab type without generics 2024-08-14 14:42:12 +02:00
Bartosz Sypytkowski f2fa4d7c22 chore: post rebase fixes 2024-08-14 05:26:38 +02:00
Bartosz Sypytkowski 320d62f46c chore: change awareness emit to trigger on update instead of on change 2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski ef860c2d5a chore: fix cargo fmt and clippy errors 2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski 8b2f698068 chore: fixed api changes in appflowy history service 2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski c27866fb25 chore: upgrade code to use asynchronous locks 2024-08-13 19:59:46 +02:00
Nathan.fooo 73127fb886
chore: shorten group lifetime (#726) 2024-08-13 16:20:06 +08:00
Bartosz Sypytkowski 44406ccdae
chore: update yrs and appflowy-collab (#677)
* chore: update yrs and appflowy-collab

* chore: remove wasm compilation target

* chore: fixed number conversion in tests

* chore: remove wasm integration tests

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-07-10 10:10:07 +08:00
Bartosz Sypytkowski 6c0f4985c3
Merge pull request #645 from AppFlowy-IO/merge-indexer-collaborate
Merge indexer collaborate
2024-06-28 07:48:32 +02:00
Khor Shu Heng 7dfb52f80b
feat: add telemetry to appflowy collaborate service (#662) 2024-06-28 13:44:59 +08:00
Bartosz Sypytkowski b6f301b3ad chore: sqlx prepare workspace json 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski cce52a5185 chore: do not throw errors on invalid document schema during indexing 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski 5d3574d643 chore: save collab embeddings on collab create 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski 8bf6aff923 chore: post rebase fixes 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski 42b3cca886 chore: remove appflowy indexer service 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski f13b9ee787 chore: add indexing of collabs at application start 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski 95912e266c fix: add types removed after rebase 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski a706c312b3 chore: making embeddings code compile 2024-06-28 05:40:41 +02:00
Bartosz Sypytkowski b79fe41af3 chore: moving embeddings into collabparams 2024-06-28 05:39:56 +02:00
Bartosz Sypytkowski b1ebbecc5f chore: moving appflowy indexer into appflowy cloud 2024-06-28 05:39:53 +02:00
Nathan.fooo a6539dd963
chore: shorten default write interval (#661) 2024-06-28 10:06:09 +08:00
Nathan.fooo 50ed9f4a6a
chore: update create collab list api endpoint (#657)
* chore: update create collab list api endpoint

* chore: clippy

* chore: fix compile
2024-06-27 15:41:10 +08:00
Nathan.fooo 1a22813113
chore: stop indexing when stream is not exist (#652) 2024-06-26 14:24:23 +08:00
Bartosz Sypytkowski 9b308bceaa chore: appflowy indexer - do not break the document handler on missing data 2024-06-26 07:18:28 +02:00
Bartosz Sypytkowski 7d03e9cf85
Merge pull request #650 from AppFlowy-IO/fix-indexing-order
fix: do not throw errors if indexer found document before workspace was created
2024-06-25 09:23:33 +02:00
Bartosz Sypytkowski b7ce1617cd chore: fix appflowy indexer tests 2024-06-25 08:47:40 +02:00
Bartosz Sypytkowski 6592f00a20 chore: change query to use workspace directly 2024-06-25 08:07:32 +02:00
Bartosz Sypytkowski 2ff2a77465 fix: do not throw errors if indexer found document before workspace was created 2024-06-25 07:30:48 +02:00
Khor Shu Heng c25d78f691
Merge pull request #649 from AppFlowy-IO/collab-service-dockerfile
feat: dockerfile for collab service
2024-06-25 13:30:37 +08:00
Khor Shu Heng bdae165849
feat: add post realtime message stream handler to independent collab ws (#647) 2024-06-25 13:30:05 +08:00
khorshuheng 8e0f28fe1d feat: dockerfile for collab service 2024-06-25 10:02:55 +08:00
Khor Shu Heng 6e3f666ce4
feat: independent collab websocket server (#640) 2024-06-24 13:59:51 +08:00
Khor Shu Heng c7d474c9cf
chore: allow collab persistence and edit state behaviour to be configurable (#637) 2024-06-23 23:19:54 +08:00
Khor Shu Heng 537824e82b
chore: fix clippy linting errors and warnings (#639) 2024-06-23 23:18:38 +08:00
Nathan.fooo 30f87457f3
feat: support uploading file with multiple part (#625)
* refactor: replace crate

* chore: remove s3-rust crate

* chore: test multiple upload

* chore: client api

* chore: client api

* chore: v1 version upload,download

* chore: fix test

* chore: fix test

* chore: remove workspace test

* chore: fix wasm build

* chore: update path

* chore: update path

* chore: rename

* chore: expose file entity

* chore: introduce client-api-entity

* chore: fix build

* chore: new url

* chore: fix test

* chore: merge main

* chore: fix clippy
2024-06-19 13:06:58 +08:00
Bartosz Sypytkowski d9354202cd chore: specify chunk size for search and index 2024-06-18 11:45:33 +02:00
Bartosz Sypytkowski ae2a2a4fa0 chore: appflowy indexer uses appflowy ai as open ai proxy 2024-06-18 10:04:38 +02:00
Bartosz Sypytkowski f11703949c chore: turn off sqlx macros in tests 2024-06-18 09:34:10 +02:00
Bartosz Sypytkowski a5bca1852b chore: change test query to macro 2024-06-18 08:53:02 +02:00
Bartosz Sypytkowski 9ca904f943 chore: change open ai token tracking to daily basis 2024-06-18 06:53:39 +02:00
nathan f0a32330b2 chore: fix clippy 2024-06-17 22:08:02 +08:00
Bartosz Sypytkowski 3c72f1292d chore: fixed tests for document content extraction 2024-06-14 13:01:16 +02:00
Bartosz Sypytkowski 7ad105ee34 fix: index all of the document blocks 2024-06-14 11:23:19 +02:00
Bartosz Sypytkowski b52369de7f
feat: add workspace settings with disable indexing option (#606)
* feat: add workspace settings with disable indexing option

* chore: added api workspace settings endpoint

* chore: add workspace settings read and write to client api

* chore: add tests for workspace settings client api

* fix: enforce authorization rules on workspace settings api

* chore: fix appflowy indexer test configuration

* chore: add dotenvy to appflowy indexer tests

* chore: override appflowy indexer env vars for tests

* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
Bartosz Sypytkowski 58e01f4e8d
fix: index documents with missing embeddings at service start (#597)
* feat: appflowy-indexer indexes documents with missing embeddings at start

* chore: add tests to check initial indexing of collabs

* chore: log user search requests and response

* fix: wrong appflowy openai api key env var name

* chore: fill openai keys for integration testing

* chore: silence flaky test
2024-06-04 16:50:06 +08:00
Nathan.fooo 1cc5b58254
chore: update client api (#593) 2024-06-02 20:20:14 +08:00
Nathan.fooo 9b4bfce616
chore: fix ai client test (#589) 2024-05-30 07:50:25 +08:00
Bartosz Sypytkowski 128e978016
chore: add appflowy indexer service start to cargo run xtask (#586) 2024-05-29 23:45:30 +08:00
Bartosz Sypytkowski c4702bbbdf
feat: Workspace token usage (#584)
* feat: register open ai token usage during indexing

* feat: register open ai token usage during search

* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
Bartosz Sypytkowski d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint (#582)
* feat: implement appflowy-indexer and search api endpoint

* chore: store embedding content type

* chore: more descriptive messages for open ai missing key

* chore: fix sqlx errors in tests

* chore: document watcher - change plain text rendering to use depth-first scan

* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
Nathan.fooo 3f2d5f0785
chore: optimize redis stream space usage (#579)
* chore: set maxlen for redis stream

* chore: update log

* chore: set expiration time
2024-05-27 13:22:14 +08:00
Khor Shu Heng 93b4a1516c
feat: add postgres listeners for collab service (#575) 2024-05-27 09:12:32 +08:00
Nathan.fooo 7284430cad
chore: add test (#571) 2024-05-23 21:03:36 +08:00
Nathan.fooo 4eb1e6bceb
chore: generate history using redis steam (#570)
* chore: combine test

* chore: add snapshot test

* chore: add test
2024-05-23 07:57:20 +08:00
Nathan.fooo 05e7f1cda7
Integrate ai chat (#569)
* chore: fix compile

* chore: implement client api

* chore: implement client api

* chore: clippy
2024-05-22 11:18:07 +08:00
Khor Shu Heng 67d9fad7d7
chore: migrate collab storage to appflowy-collaborate (#566)
* chore: migrate collab storage to appflowy-collaborate

* fix: clippy error

* chore: remove handler

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-21 10:06:26 +08:00
Nathan.fooo 2736fa60a7
chore: integrate redis stream (#559)
* chore: integrate redis stream

* chore: make CollabUpdateStreaming::send_update synchronous

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
2024-05-18 08:28:57 +08:00
Khor Shu Heng fbdcbd6e08
chore: migrate collab actors to appflowy-collaborate (#556) 2024-05-17 12:22:43 +08:00
Khor Shu Heng c79267d42a
feat: migrate collab access control to collaboration service (#548)
* feat: migrate collab access control to collaborate service

* feat: migrate workspace access control to separate crate
2024-05-15 15:24:07 +08:00
Khor Shu Heng d9d874ab8a
feat: migrate collab cache to collaborate service (#524)
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-09 23:12:13 +08:00
Nathan.fooo 388d38428b
chore: revamp post realtime endpoint (#536)
* chore: revamp  post realtime endpoint

* chore: fix clippy

* chore: fix fmt
2024-05-08 22:06:37 +08:00
Nathan.fooo 70262a1ac4
chore: try to not block actor mailbox (#534)
* chore: add test

* chore: spawn task to handle message

* chore: update error message
2024-05-08 16:54:05 +08:00
Nathan.fooo 3508262d1d
chore: using env to control mailbox size (#532)
* chore: using env to control mailbox size

* chore: update logs
2024-05-07 22:15:53 +08:00
Bartosz Sypytkowski 47e6f1e8b1
Update Yrs and AppFlowy-Collab (#518)
* chore: updated collab dependencies to v0.2

* chore: update collab to v0.2 and yrs to v0.18

* chore: pinned collab to specific revision

* chore: fix clippy errors

* chore: update commit id

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-06 11:30:02 +08:00
Nathan.fooo eba2e0d4db
ci: add test (#516)
* ci: add test

* ci: add test

* ci: add readme

* ci: update test
2024-05-02 21:30:23 +08:00
nathan 60967e51e6 chore: disable gc 2024-05-02 07:52:38 +08:00
Nathan.fooo 59b3d69c42
chore: fix local set warnings (#515)
* chore: fix local set warnings

* chore: clippy
2024-05-01 23:07:57 +08:00
nathan ca1623fcc2 chore: update logs 2024-05-01 22:05:04 +08:00
nathan 885e6f31b4 chore: enable gc 2024-05-01 21:00:40 +08:00
Bartosz Sypytkowski 29928cb4a7
chore: add more detailed logging around errors in Transaction::try_encode_state_as_update_v1 (#514) 2024-05-01 20:14:27 +08:00
Nathan.fooo 79bb510aaf
ci: run history test (#513)
* ci: run history test

* chore: fix ci
2024-05-01 16:28:07 +08:00
Nathan.fooo e2fd049333
chore: awarenss with origin (#498) 2024-04-26 19:39:08 +08:00
nathan 32bdfb7037 chore: update logs 2024-04-26 13:29:57 +08:00
Nathan.fooo 7b4b9d0c10
chore: folder data check (#496)
* chore: folder data check

* chore: stop observe remote change when specific type of collaboration object override with incorrect data

* chore: commit sqlx file
2024-04-26 13:20:06 +08:00
nathan a045713222 chore: update log 2024-04-25 12:19:26 +08:00
Nathan.fooo a0593b5502
chore: refactor return response with object id (#494)
* chore: refactor return response with object id

* chore: fix ci

* chore: fix ci
2024-04-24 12:07:54 +08:00
Nathan.fooo 5f970a625a
chore: use rust 1.77 (#493) 2024-04-24 10:47:18 +08:00
Nathan.fooo 1019b8c5b6
chore: update collab rev (#490) 2024-04-22 17:15:12 +08:00
Nathan.fooo efbe9c4a93
chore: move collab rt crate (#489)
* chore: create appflowy collaborate crate

* chore: remove collab-rt

* chore: fmt

* chore: main
2024-04-22 12:14:41 +08:00
Nathan.fooo 123484c864
chore: sync missing update from vector (#481) 2024-04-20 20:50:16 +08:00
Nathan.fooo 4168d72390
chore: using redis conn for each action (#476)
* chore: batch insert

* chore: opti redis conn

* chore: fix test
2024-04-17 11:41:50 +08:00
Nathan.fooo 8ab7815740
chore: reduce pool lock (#475)
* chore: reduce pool lock

* chore: clippy
2024-04-16 20:26:26 +08:00
Nathan.fooo 0be4d2d5b5
ci: try to fix flaky test (#473)
* chore: update ping config

* chore: fix test

* chore: fix test
2024-04-16 18:20:36 +08:00
Nathan.fooo f3279e9b4e
feat: implement grpc for history server (#470)
* ci: docker compose for ci

* chore: add test

* chore: imple grpc

* chore: fix test

* chore: fix ci
2024-04-16 14:10:56 +08:00
Nathan.fooo 3901356e8a
chore: bump collab version (#471) 2024-04-15 12:35:14 +08:00
Nathan.fooo 28e0e74fd1
feat: Implement history(1) (#466)
* chore: update collab commit

* chore: collab history test

* chore: collab history test

* chore: impl redis stream

* chore: impl redis stream test

* chore: impl migration

* chore: implement history sql

* chore: add test

* chore: add test

* chore: fix test

* chore: update log and test

* chore: add xtask

* chore: clippy

* chore: impl api

* chore: add missing sqlx files

* chore: fix test

* chore: fix test
2024-04-15 09:18:19 +08:00
Nathan.fooo c85383b21d
chore: project folder structture (#392)
* chore: docker build

* chore: update

* chore: update

* chore: test stream pubsub

* chore: fix wanrings

* chore: realtime crate

* chore: realtime crate

* chore: realtime crate

* chore: realtime crate

* chore: reanme crates

* chore: reanme crates

* chore: project structure

* chore: disable docker for collab hisotry
2024-03-22 11:24:28 +08:00
nathan 7b706b54ce refactor: auth 2023-03-11 22:01:25 +08:00
appflowy 3012acce30 refactor: use cargo workspace 2022-02-07 15:08:49 +08:00