8beac5c85f
chore: reuse group collab for indexing ( #737 )
...
* chore: reuse group collab for indexing
* chore: fix linting errors
* chore: post rebase fixes
2024-08-28 00:13:41 +08:00
ab14568bbf
chore: use env to use control multiple thread runtime or not ( #760 )
2024-08-28 00:13:24 +08:00
fee2c37aa4
chore: disable multiple thread in group
2024-08-27 18:12:11 +08:00
c8ee6b43ee
chore: try to fix inifinite sync ( #756 )
2024-08-27 16:41:19 +08:00
a21c55cbcc
chore: modify log level for some cases ( #754 )
...
* chore: modify log level for some cases
* chore: update logs
2024-08-27 14:57:00 +08:00
045b6f09cb
feat: add metrics for number of editing users ( #730 )
2024-08-27 11:56:07 +08:00
15b2e81579
chore: enable setting up periodic sync step 1 sends from sync plugin ( #738 )
...
* chore: enable setting up periodic sync step 1 sends from sync plugin
* chore: rollback to server sending sync step 1 to response to the client
* chore: increase sync step 1 interval in tests
2024-08-27 11:55:27 +08:00
cbb9adc29d
chore: enable multiple threads ( #753 )
2024-08-27 11:15:54 +08:00
c182ad7099
Merge pull request #750 from AppFlowy-IO/ws-client-min-version
...
add minimum client version validation in websocket connection establishment
2024-08-27 01:35:20 +08:00
8cc410ce65
chore: revamp get collab api request ( #752 )
...
* chore: stop retry if record is not found
2024-08-26 23:41:06 +08:00
8d1d563076
chore: fix formatting
2024-08-26 14:20:39 +02:00
11bbb70d54
chore: add minimum client version validation in websocket connection establishment
2024-08-26 14:14:04 +02:00
364d31f825
chore: drop group with maximum timeout ( #747 )
2024-08-26 17:01:42 +08:00
c77d0f9c2c
chore: spawn indexer
2024-08-26 09:47:46 +08:00
d111282f7e
fix: panic when apply invalid update ( #745 )
2024-08-24 14:55:49 +08:00
1122031735
chore: update group active ( #743 )
...
* chore: opti logs
* chore: update group active logic
* chore: fmt
2024-08-24 09:43:12 +08:00
b4d79b954b
chore: update logs
2024-08-23 10:30:52 +08:00
12a1539f32
chore: initialize before lock collab
2024-08-22 23:26:20 +08:00
1a053172c2
chore: write collab to disk after first sync step2 ( #739 )
...
* chore: write collab to disk after first sync step2
* chore: clippy
* chore: fix test & disable history plugin
* chore: upgrade appflowy collab that disbale document undo redo
2024-08-22 23:11:20 +08:00
ae3833ea91
chore: Remove last sync at ( #735 )
...
* chore: remove last sync at field
* chore: post rebase fixes
* chore: update test for missing update detection
2024-08-22 07:47:01 +08:00
2d7a4bde92
Merge branch 'main' into no-lock-collab
2024-08-19 10:38:07 +08:00
809d0df607
chore: only log on debug
2024-08-16 20:48:43 +08:00
d503905931
chore: make sync plugin work over any collab type without generics
2024-08-14 14:42:12 +02:00
f2fa4d7c22
chore: post rebase fixes
2024-08-14 05:26:38 +02:00
320d62f46c
chore: change awareness emit to trigger on update instead of on change
2024-08-13 19:59:48 +02:00
ef860c2d5a
chore: fix cargo fmt and clippy errors
2024-08-13 19:59:48 +02:00
8b2f698068
chore: fixed api changes in appflowy history service
2024-08-13 19:59:48 +02:00
c27866fb25
chore: upgrade code to use asynchronous locks
2024-08-13 19:59:46 +02:00
73127fb886
chore: shorten group lifetime ( #726 )
2024-08-13 16:20:06 +08:00
44406ccdae
chore: update yrs and appflowy-collab ( #677 )
...
* chore: update yrs and appflowy-collab
* chore: remove wasm compilation target
* chore: fixed number conversion in tests
* chore: remove wasm integration tests
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-07-10 10:10:07 +08:00
6c0f4985c3
Merge pull request #645 from AppFlowy-IO/merge-indexer-collaborate
...
Merge indexer collaborate
2024-06-28 07:48:32 +02:00
7dfb52f80b
feat: add telemetry to appflowy collaborate service ( #662 )
2024-06-28 13:44:59 +08:00
b6f301b3ad
chore: sqlx prepare workspace json
2024-06-28 05:40:44 +02:00
cce52a5185
chore: do not throw errors on invalid document schema during indexing
2024-06-28 05:40:44 +02:00
5d3574d643
chore: save collab embeddings on collab create
2024-06-28 05:40:44 +02:00
8bf6aff923
chore: post rebase fixes
2024-06-28 05:40:44 +02:00
42b3cca886
chore: remove appflowy indexer service
2024-06-28 05:40:44 +02:00
f13b9ee787
chore: add indexing of collabs at application start
2024-06-28 05:40:44 +02:00
95912e266c
fix: add types removed after rebase
2024-06-28 05:40:44 +02:00
a706c312b3
chore: making embeddings code compile
2024-06-28 05:40:41 +02:00
b79fe41af3
chore: moving embeddings into collabparams
2024-06-28 05:39:56 +02:00
b1ebbecc5f
chore: moving appflowy indexer into appflowy cloud
2024-06-28 05:39:53 +02:00
a6539dd963
chore: shorten default write interval ( #661 )
2024-06-28 10:06:09 +08:00
50ed9f4a6a
chore: update create collab list api endpoint ( #657 )
...
* chore: update create collab list api endpoint
* chore: clippy
* chore: fix compile
2024-06-27 15:41:10 +08:00
1a22813113
chore: stop indexing when stream is not exist ( #652 )
2024-06-26 14:24:23 +08:00
9b308bceaa
chore: appflowy indexer - do not break the document handler on missing data
2024-06-26 07:18:28 +02:00
7d03e9cf85
Merge pull request #650 from AppFlowy-IO/fix-indexing-order
...
fix: do not throw errors if indexer found document before workspace was created
2024-06-25 09:23:33 +02:00
b7ce1617cd
chore: fix appflowy indexer tests
2024-06-25 08:47:40 +02:00
6592f00a20
chore: change query to use workspace directly
2024-06-25 08:07:32 +02:00
2ff2a77465
fix: do not throw errors if indexer found document before workspace was created
2024-06-25 07:30:48 +02:00
c25d78f691
Merge pull request #649 from AppFlowy-IO/collab-service-dockerfile
...
feat: dockerfile for collab service
2024-06-25 13:30:37 +08:00
bdae165849
feat: add post realtime message stream handler to independent collab ws ( #647 )
2024-06-25 13:30:05 +08:00
8e0f28fe1d
feat: dockerfile for collab service
2024-06-25 10:02:55 +08:00
6e3f666ce4
feat: independent collab websocket server ( #640 )
2024-06-24 13:59:51 +08:00
c7d474c9cf
chore: allow collab persistence and edit state behaviour to be configurable ( #637 )
2024-06-23 23:19:54 +08:00
537824e82b
chore: fix clippy linting errors and warnings ( #639 )
2024-06-23 23:18:38 +08:00
30f87457f3
feat: support uploading file with multiple part ( #625 )
...
* refactor: replace crate
* chore: remove s3-rust crate
* chore: test multiple upload
* chore: client api
* chore: client api
* chore: v1 version upload,download
* chore: fix test
* chore: fix test
* chore: remove workspace test
* chore: fix wasm build
* chore: update path
* chore: update path
* chore: rename
* chore: expose file entity
* chore: introduce client-api-entity
* chore: fix build
* chore: new url
* chore: fix test
* chore: merge main
* chore: fix clippy
2024-06-19 13:06:58 +08:00
d9354202cd
chore: specify chunk size for search and index
2024-06-18 11:45:33 +02:00
ae2a2a4fa0
chore: appflowy indexer uses appflowy ai as open ai proxy
2024-06-18 10:04:38 +02:00
f11703949c
chore: turn off sqlx macros in tests
2024-06-18 09:34:10 +02:00
a5bca1852b
chore: change test query to macro
2024-06-18 08:53:02 +02:00
9ca904f943
chore: change open ai token tracking to daily basis
2024-06-18 06:53:39 +02:00
f0a32330b2
chore: fix clippy
2024-06-17 22:08:02 +08:00
3c72f1292d
chore: fixed tests for document content extraction
2024-06-14 13:01:16 +02:00
7ad105ee34
fix: index all of the document blocks
2024-06-14 11:23:19 +02:00
b52369de7f
feat: add workspace settings with disable indexing option ( #606 )
...
* feat: add workspace settings with disable indexing option
* chore: added api workspace settings endpoint
* chore: add workspace settings read and write to client api
* chore: add tests for workspace settings client api
* fix: enforce authorization rules on workspace settings api
* chore: fix appflowy indexer test configuration
* chore: add dotenvy to appflowy indexer tests
* chore: override appflowy indexer env vars for tests
* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
58e01f4e8d
fix: index documents with missing embeddings at service start ( #597 )
...
* feat: appflowy-indexer indexes documents with missing embeddings at start
* chore: add tests to check initial indexing of collabs
* chore: log user search requests and response
* fix: wrong appflowy openai api key env var name
* chore: fill openai keys for integration testing
* chore: silence flaky test
2024-06-04 16:50:06 +08:00
1cc5b58254
chore: update client api ( #593 )
2024-06-02 20:20:14 +08:00
9b4bfce616
chore: fix ai client test ( #589 )
2024-05-30 07:50:25 +08:00
128e978016
chore: add appflowy indexer service start to cargo run xtask ( #586 )
2024-05-29 23:45:30 +08:00
c4702bbbdf
feat: Workspace token usage ( #584 )
...
* feat: register open ai token usage during indexing
* feat: register open ai token usage during search
* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint ( #582 )
...
* feat: implement appflowy-indexer and search api endpoint
* chore: store embedding content type
* chore: more descriptive messages for open ai missing key
* chore: fix sqlx errors in tests
* chore: document watcher - change plain text rendering to use depth-first scan
* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
3f2d5f0785
chore: optimize redis stream space usage ( #579 )
...
* chore: set maxlen for redis stream
* chore: update log
* chore: set expiration time
2024-05-27 13:22:14 +08:00
93b4a1516c
feat: add postgres listeners for collab service ( #575 )
2024-05-27 09:12:32 +08:00
7284430cad
chore: add test ( #571 )
2024-05-23 21:03:36 +08:00
4eb1e6bceb
chore: generate history using redis steam ( #570 )
...
* chore: combine test
* chore: add snapshot test
* chore: add test
2024-05-23 07:57:20 +08:00
05e7f1cda7
Integrate ai chat ( #569 )
...
* chore: fix compile
* chore: implement client api
* chore: implement client api
* chore: clippy
2024-05-22 11:18:07 +08:00
67d9fad7d7
chore: migrate collab storage to appflowy-collaborate ( #566 )
...
* chore: migrate collab storage to appflowy-collaborate
* fix: clippy error
* chore: remove handler
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-21 10:06:26 +08:00
2736fa60a7
chore: integrate redis stream ( #559 )
...
* chore: integrate redis stream
* chore: make CollabUpdateStreaming::send_update synchronous
---------
Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
2024-05-18 08:28:57 +08:00
fbdcbd6e08
chore: migrate collab actors to appflowy-collaborate ( #556 )
2024-05-17 12:22:43 +08:00
c79267d42a
feat: migrate collab access control to collaboration service ( #548 )
...
* feat: migrate collab access control to collaborate service
* feat: migrate workspace access control to separate crate
2024-05-15 15:24:07 +08:00
d9d874ab8a
feat: migrate collab cache to collaborate service ( #524 )
...
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-09 23:12:13 +08:00
388d38428b
chore: revamp post realtime endpoint ( #536 )
...
* chore: revamp post realtime endpoint
* chore: fix clippy
* chore: fix fmt
2024-05-08 22:06:37 +08:00
70262a1ac4
chore: try to not block actor mailbox ( #534 )
...
* chore: add test
* chore: spawn task to handle message
* chore: update error message
2024-05-08 16:54:05 +08:00
3508262d1d
chore: using env to control mailbox size ( #532 )
...
* chore: using env to control mailbox size
* chore: update logs
2024-05-07 22:15:53 +08:00
47e6f1e8b1
Update Yrs and AppFlowy-Collab ( #518 )
...
* chore: updated collab dependencies to v0.2
* chore: update collab to v0.2 and yrs to v0.18
* chore: pinned collab to specific revision
* chore: fix clippy errors
* chore: update commit id
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-06 11:30:02 +08:00
eba2e0d4db
ci: add test ( #516 )
...
* ci: add test
* ci: add test
* ci: add readme
* ci: update test
2024-05-02 21:30:23 +08:00
60967e51e6
chore: disable gc
2024-05-02 07:52:38 +08:00
59b3d69c42
chore: fix local set warnings ( #515 )
...
* chore: fix local set warnings
* chore: clippy
2024-05-01 23:07:57 +08:00
ca1623fcc2
chore: update logs
2024-05-01 22:05:04 +08:00
885e6f31b4
chore: enable gc
2024-05-01 21:00:40 +08:00
29928cb4a7
chore: add more detailed logging around errors in Transaction::try_encode_state_as_update_v1 ( #514 )
2024-05-01 20:14:27 +08:00
79bb510aaf
ci: run history test ( #513 )
...
* ci: run history test
* chore: fix ci
2024-05-01 16:28:07 +08:00
e2fd049333
chore: awarenss with origin ( #498 )
2024-04-26 19:39:08 +08:00
32bdfb7037
chore: update logs
2024-04-26 13:29:57 +08:00
7b4b9d0c10
chore: folder data check ( #496 )
...
* chore: folder data check
* chore: stop observe remote change when specific type of collaboration object override with incorrect data
* chore: commit sqlx file
2024-04-26 13:20:06 +08:00
a045713222
chore: update log
2024-04-25 12:19:26 +08:00
a0593b5502
chore: refactor return response with object id ( #494 )
...
* chore: refactor return response with object id
* chore: fix ci
* chore: fix ci
2024-04-24 12:07:54 +08:00
5f970a625a
chore: use rust 1.77 ( #493 )
2024-04-24 10:47:18 +08:00
1019b8c5b6
chore: update collab rev ( #490 )
2024-04-22 17:15:12 +08:00
Bartosz Sypytkowski
Nathan.fooo
nathan
Khor Shu Heng
khorshuheng