6aed9609b9
chore: removed realtime shared state tests
2024-11-04 09:21:10 +01:00
356cf5d132
chore: fix clippy errors
2024-11-04 08:29:32 +01:00
f105c2dbc2
chore: fix clippy errors
2024-11-04 08:20:56 +01:00
f9397eaaf2
chore: remove realtime shared state
2024-11-04 07:58:16 +01:00
a5a5a6b59f
fix: import notion file base cases ( #957 )
2024-11-02 16:50:51 +08:00
9629d4cefa
chore: add limit for importing zip file ( #938 )
...
* chore: add limitation for import zip file
* chore: support upload big file
* chore: implement client api
* chore: implement client api
* chore: implement client api
* chore: update logs
* chore: check file size
* chore: last process at
* chore: set content type
* chore: fix test
* chore: try test
* chore: temporary disable test
2024-10-28 08:51:34 +08:00
246cbd3ec4
chore: update nginx config for import ( #935 )
2024-10-25 16:47:29 +08:00
e738508d79
fix: Support notion database row document ( #929 )
...
* chore: fix import notion database
2024-10-24 19:04:06 +08:00
16fb9584f9
fix: masked postgres password in logs
2024-10-24 00:34:31 +08:00
9eb1c36c92
chore: access control interface to return error instead of boolean ( #914 )
2024-10-21 20:20:14 +08:00
57c44818e2
feat: Import metrics ( #911 )
...
* chore: implement metrics for import
* chore: add metrics
2024-10-20 11:05:22 +08:00
b1f37dbbf6
chore: fix petential unzip issues ( #910 )
2024-10-20 10:48:09 +08:00
773f17e524
fix: import zip without root dir ( #898 )
...
* fix: import notion zip file that do not have root dir
* fix: compile
2024-10-18 00:51:53 +08:00
ffee47d0f7
chore: remove workspace and collab listener ( #893 )
2024-10-17 17:43:00 +08:00
3623d9f296
chore: check file md5 before import ( #895 )
2024-10-17 17:18:07 +08:00
8ab5da4aef
fix: limit concurrency level of batch get encode collab ( #892 )
2024-10-17 13:29:27 +08:00
9942e68089
chore: imported workspace should not become the latest visting workspace ( #890 )
...
* chore: imported workspace should not become the latest visting workspace
* chore: sqlx files
* chore: update test
* chore: fmt
2024-10-16 21:02:05 +08:00
d3e4a6870d
chore: template ( #889 )
...
* chore: template
* fix: auto del file lifetime
* chore: delete file if fail to write to disk
* fix: modified html
* chore: set content type
* chore: md5 content
* chore: clippy
* fix: image loaded failed
* fix: build
* chore: bump collab
---------
Co-authored-by: Kilu <lu@appflowy.io>
2024-10-16 17:39:24 +08:00
ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
...
feat: additional access control config
2024-10-16 17:00:54 +08:00
383629ab1c
chore: simplify not enough permission error
2024-10-16 15:10:31 +08:00
d89cbe1c8c
chore: support streaming unzip using env ( #888 )
2024-10-16 14:02:03 +08:00
3c02fa253f
chore: retry import ( #887 )
...
* chore: retry import
* chore: delete temp files
* chore: bump collab
2024-10-16 12:55:53 +08:00
2b02a8d12b
chore: bump collab ( #884 )
2024-10-15 15:56:14 +08:00
1616ceaf4f
chore: use workspace deps ( #880 )
2024-10-14 16:02:22 +08:00
95e8b30f11
chore: bump collab that use yrs 0.21.2 ( #872 )
...
* chore: bump collab that use yrs 0.21.2
* chore: fmt
2024-10-14 00:58:32 +08:00
bbd21dfef6
chore: import mailer ( #869 )
...
* chore: import mailer
* chore: update template
* chore: config template
* fix: add missing config parameter
* chore: update template
* chore: show error with task id
* chore: show error with task id
---------
Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
14cfaa0bbd
chore: insert metadata after import notion zip file ( #871 )
...
* chore: insert metadata after import notion zip file
* chore: update logs
2024-10-10 22:32:02 +08:00
8c14612f98
feat: refactor access control to enable swapping implementation ( #859 )
2024-10-10 13:04:47 +08:00
98347b81ea
fix: import notion zip file as workspace ( #868 )
...
* chore: insert content length in header
* chore: custom header
* chore: workspace name
* chore: file name
* chore: handle file name that is not utf8 encode
* chore: clippy
* fix: end of file when unzip file
* chore: docs
2024-10-09 21:27:24 +08:00
33e63fae5c
chore: try to fix pg lock timeout ( #864 )
...
* chore: try to fix pg lock timeout
* chore: add logs for insert collab
* chore: add timeout for duplicate
* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
820db6564e
chore: create space view for imported notion zip file ( #863 )
2024-10-07 12:41:45 +08:00
38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint ( #862 )
...
* chore: using copy to improve write speed of batch collab api endpoint
* chore: insert to redis
* chore: fix compile
2024-10-07 08:58:19 +08:00
9c0dffacef
feat: implement import notion zip file api endpoint ( #840 )
...
* chore: implement api endpoint
* chore: worker
* chore: async zip
* chore: test bulk insert
* chore: insert collab
* chore: custom task
* chore: consume un acked message
* chore: fix compile
* chore: add test
* test: update
* chore: save import record
* chore: save import record
* chore: fix ci
* chore: remove unused deps
* chore: update docker file
* chore: build worker images
* chore: use small int
* chore: use small int
* chore: rm protoc deps in runtime
* chore: move collab cache to database crate
* chore: update test
* chore: rm health api endpoint
* chore: clippy
* chore: update ci
* chore: add test
* chore: upgrade collab
* chore: clippy
* chore: update test
* chore: use custom host
* chore: config nginx
* chore: install cert
2024-10-03 22:22:29 +08:00
11732324b5
feat: support fetching encoded collab in batch from memory ( #837 )
2024-10-02 10:22:40 +08:00
4c54481d70
chore: bump collab version ( #822 )
...
* chore: bump collab version
* chore: update deps count
2024-09-14 23:59:50 +08:00
a4b885e13b
chore: set exp time for collab base on collab type ( #820 )
...
* chore: set exp time for collab base on collab type
* chore: fix test
2024-09-13 19:04:56 +08:00
96896101d4
chore: fix build
2024-09-12 00:47:16 +08:00
1ccff73e49
chore: bump appflowy collab ( #814 )
...
* chore: bump appflowy collab
* chore: fix build
2024-09-12 00:28:26 +08:00
fff93e6083
chore: Adjust gen history interval ( #812 )
...
* chore: adjust generate history interval
* chore: disable verbose log
2024-09-11 13:45:53 +08:00
07d6001cf8
chore: check before write to hisotry ( #809 )
...
* chore: check before write to hisotry
* chore: clippy
* chore: clippy
* chore: calculate edit count
* chore: clippy
* chore: exit loop
* chore: exit loop
* chore: update log
2024-09-10 22:10:59 +08:00
5d356718fa
fix: using spawn_blocking in order to not block the runtime ( #793 )
...
* fix: using blocking in order to not block the runtime
* chore: increase deps count
2024-09-05 09:19:34 +08:00
826546c5cb
feat: duplicate published doc ( #700 )
...
* chore: test collab sync
* feat: folder view for user workspace
* feat: add private indicator
* chore: use collab cache instead
* chore: initial impl
* chore: cargo sqlx
* fix: write back to collab cache
* fix: assign page id
* fix: text map
* chore: connect api and refactor
* chore: switch to using mem storage
* fix: collab type
* feat: use group manager to manage sync
* feat: try add send command instead
* chore: add client api code
* feat: try use sink and stream from group collab
* chore: disable sync first
* fix: insert page before stopping group
* feat: add extra for view
* feat: add metadata to doc
* fix: icon
* fix: page circular dep
* fix: page circular dep
* fix: live update
* feat: database initial impl
* feat: workspace database
* chore: link database
* fix: database validation
* fix: workspace database oid
* fix: workspace database oid
* fix: specify view layout
* feat: add txn when inserting collab and rework database views
* fix: parent view id for new database
* fix: database view for folder
* fix: database ids
* fix: database row id
* fix: main database layout and write database before folder
* fix: metadata for non database main view
* chore: database in doc wip
* chore: filter visible views
* chore: use structure value instead of json
* chore: database in doc wip
* fix: remove child item push
* fix: main database view meta
* chore: rework inline database in doc
* fix: make duplicate more error forgiving
* chore: use get instead of get key value
* chore: merge with main
* feat: set max depth for folder view
* chore: update dependency counter
* chore: remove unneeded arg
* chore: simplify collab new from source
* chore: remove unneeded param
* chore: rename and doc
* feat: rework inline database and use duplicated ref
* chore: simplify params
* chore: fmt
* feat: deduplicate database wip
* fix: compatible with newer appflowy version
* fix: database views
* feat: database in doc
* chore: cargo clippy
* chore: update dockerfile rust toolchain
* fix: doc inline db parent id
* fix: database id
* fix: document data modification
* chore: minor refactor and todo
* chore: remove unneeded nesting
* fix: enforce ordering for views to add
* chore: add doc and test case for folder view
* fix: remove the need for cloning published collab
* fix: some review
* chore: move folder conversion logic
* fix: remove collab folder deps on shared entity
* chore: cargo fmt
* fix: compile
* chore: remove group manager dependency
* fix: dep count
* fix: add messages sent by server
* fix: dep count
* chore: add test for doc ref and inline doc database
* chore: cargo clippy
* chore: add more test scenarios
* chore: fix tests
* chore: get database id
* chore: update collab
* chore: add more assert and database row id checks
* fix: suggestions from review
* chore: sqlx
* fix: accumulate collab before insert
* chore: add tokio spawn blocking for encoding
* fix: reduce limit for publish collabs
---------
Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
Co-authored-by: nathan <nathan@appflowy.io>
2024-09-03 09:12:29 +08:00
365c64c5c2
chore: use colla storage instead of select from db directly ( #782 )
2024-09-02 21:25:21 +08:00
299680c14a
chore: decode encode collab using spawn blocking ( #781 )
2024-09-02 20:27:40 +08:00
abd96d8b56
chore: add APPFLOWY_COLLAB_REMOVE_BATCH_SIZE env to control num of co… ( #779 )
...
* chore: add APPFLOWY_COLLAB_REMOVE_BATCH_SIZE env to control num of collabs to be removed in one tick
* chore: clippy
2024-09-02 11:24:40 +08:00
c2a5369313
chore: set chat request timeout ( #777 )
...
* chore: set chat request timeout
* chore: clippy
2024-09-01 15:16:11 +08:00
6972f9c4ab
feat: Measure sync ( #772 )
...
* chore: redesign collab sync protocol to enable injection of metric tracking
* chore: track metrics for apply update on the server side
* chore: close locks
* chore: post rebase fixes
2024-08-30 21:48:19 +08:00
f75413566e
chore: reconnect realtime metrics
2024-08-30 09:56:51 +02:00
1f9a03a83d
chore: enable lock timeout feature ( #771 )
2024-08-30 14:24:34 +08:00
3e701a1f8b
chore: remove no require data error log ( #766 )
...
* chore: remove no require data error log
* chore: clippy
2024-08-30 13:55:53 +08:00
5b2b717fe7
chore: remove redundant metrics collector
2024-08-30 05:14:44 +02:00
54b811125e
chore: wrap spawn blocking when decoding collab ( #767 )
2024-08-29 22:53:33 +08:00
2af1999375
chore: added locks with timeouts ( #765 )
...
* chore: added locks with timeouts
* chore: roll back collab locks in client api
2024-08-29 16:13:27 +08:00
e7bf221ff0
feat: update built-in README for new users ( #757 )
...
* feat: add getting_started, desktop_guide and mobile_guide json
* feat: update built-in readme data
* feat: support adding database as template
* feat: support creating nested documents
* chore: refactor code
* chore: refactor code
* chore: remove println
* chore: update collab version
* feat: update built-in readme and image ref
* chore: remove template icon
* feat: use database::create_with_view to create collab
* chore: add template tests
* chore: update collab version
* chore: remove debug code
* chore: add comment
* chore: fix lint & test
* fix: code review
* fix: rust lint
* chore: update comment
* test: add default workspace test
* test: add default user workspace test
* chore: use workspace database body
* chore: fix typo and clippy
* fix: insert_folder_data_success test
* fix: insert_folder_data_success test
* feat: update content in gettting_started
* chore: update to-dos json
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-08-28 19:40:23 +08:00
8beac5c85f
chore: reuse group collab for indexing ( #737 )
...
* chore: reuse group collab for indexing
* chore: fix linting errors
* chore: post rebase fixes
2024-08-28 00:13:41 +08:00
ab14568bbf
chore: use env to use control multiple thread runtime or not ( #760 )
2024-08-28 00:13:24 +08:00
fee2c37aa4
chore: disable multiple thread in group
2024-08-27 18:12:11 +08:00
c8ee6b43ee
chore: try to fix inifinite sync ( #756 )
2024-08-27 16:41:19 +08:00
a21c55cbcc
chore: modify log level for some cases ( #754 )
...
* chore: modify log level for some cases
* chore: update logs
2024-08-27 14:57:00 +08:00
045b6f09cb
feat: add metrics for number of editing users ( #730 )
2024-08-27 11:56:07 +08:00
15b2e81579
chore: enable setting up periodic sync step 1 sends from sync plugin ( #738 )
...
* chore: enable setting up periodic sync step 1 sends from sync plugin
* chore: rollback to server sending sync step 1 to response to the client
* chore: increase sync step 1 interval in tests
2024-08-27 11:55:27 +08:00
cbb9adc29d
chore: enable multiple threads ( #753 )
2024-08-27 11:15:54 +08:00
c182ad7099
Merge pull request #750 from AppFlowy-IO/ws-client-min-version
...
add minimum client version validation in websocket connection establishment
2024-08-27 01:35:20 +08:00
8cc410ce65
chore: revamp get collab api request ( #752 )
...
* chore: stop retry if record is not found
2024-08-26 23:41:06 +08:00
8d1d563076
chore: fix formatting
2024-08-26 14:20:39 +02:00
11bbb70d54
chore: add minimum client version validation in websocket connection establishment
2024-08-26 14:14:04 +02:00
364d31f825
chore: drop group with maximum timeout ( #747 )
2024-08-26 17:01:42 +08:00
c77d0f9c2c
chore: spawn indexer
2024-08-26 09:47:46 +08:00
d111282f7e
fix: panic when apply invalid update ( #745 )
2024-08-24 14:55:49 +08:00
1122031735
chore: update group active ( #743 )
...
* chore: opti logs
* chore: update group active logic
* chore: fmt
2024-08-24 09:43:12 +08:00
b4d79b954b
chore: update logs
2024-08-23 10:30:52 +08:00
12a1539f32
chore: initialize before lock collab
2024-08-22 23:26:20 +08:00
1a053172c2
chore: write collab to disk after first sync step2 ( #739 )
...
* chore: write collab to disk after first sync step2
* chore: clippy
* chore: fix test & disable history plugin
* chore: upgrade appflowy collab that disbale document undo redo
2024-08-22 23:11:20 +08:00
ae3833ea91
chore: Remove last sync at ( #735 )
...
* chore: remove last sync at field
* chore: post rebase fixes
* chore: update test for missing update detection
2024-08-22 07:47:01 +08:00
2d7a4bde92
Merge branch 'main' into no-lock-collab
2024-08-19 10:38:07 +08:00
809d0df607
chore: only log on debug
2024-08-16 20:48:43 +08:00
d503905931
chore: make sync plugin work over any collab type without generics
2024-08-14 14:42:12 +02:00
f2fa4d7c22
chore: post rebase fixes
2024-08-14 05:26:38 +02:00
320d62f46c
chore: change awareness emit to trigger on update instead of on change
2024-08-13 19:59:48 +02:00
ef860c2d5a
chore: fix cargo fmt and clippy errors
2024-08-13 19:59:48 +02:00
8b2f698068
chore: fixed api changes in appflowy history service
2024-08-13 19:59:48 +02:00
c27866fb25
chore: upgrade code to use asynchronous locks
2024-08-13 19:59:46 +02:00
73127fb886
chore: shorten group lifetime ( #726 )
2024-08-13 16:20:06 +08:00
44406ccdae
chore: update yrs and appflowy-collab ( #677 )
...
* chore: update yrs and appflowy-collab
* chore: remove wasm compilation target
* chore: fixed number conversion in tests
* chore: remove wasm integration tests
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-07-10 10:10:07 +08:00
6c0f4985c3
Merge pull request #645 from AppFlowy-IO/merge-indexer-collaborate
...
Merge indexer collaborate
2024-06-28 07:48:32 +02:00
7dfb52f80b
feat: add telemetry to appflowy collaborate service ( #662 )
2024-06-28 13:44:59 +08:00
b6f301b3ad
chore: sqlx prepare workspace json
2024-06-28 05:40:44 +02:00
cce52a5185
chore: do not throw errors on invalid document schema during indexing
2024-06-28 05:40:44 +02:00
5d3574d643
chore: save collab embeddings on collab create
2024-06-28 05:40:44 +02:00
8bf6aff923
chore: post rebase fixes
2024-06-28 05:40:44 +02:00
42b3cca886
chore: remove appflowy indexer service
2024-06-28 05:40:44 +02:00
f13b9ee787
chore: add indexing of collabs at application start
2024-06-28 05:40:44 +02:00
95912e266c
fix: add types removed after rebase
2024-06-28 05:40:44 +02:00
a706c312b3
chore: making embeddings code compile
2024-06-28 05:40:41 +02:00
b79fe41af3
chore: moving embeddings into collabparams
2024-06-28 05:39:56 +02:00
b1ebbecc5f
chore: moving appflowy indexer into appflowy cloud
2024-06-28 05:39:53 +02:00
a6539dd963
chore: shorten default write interval ( #661 )
2024-06-28 10:06:09 +08:00
50ed9f4a6a
chore: update create collab list api endpoint ( #657 )
...
* chore: update create collab list api endpoint
* chore: clippy
* chore: fix compile
2024-06-27 15:41:10 +08:00
1a22813113
chore: stop indexing when stream is not exist ( #652 )
2024-06-26 14:24:23 +08:00
9b308bceaa
chore: appflowy indexer - do not break the document handler on missing data
2024-06-26 07:18:28 +02:00
Bartosz Sypytkowski
Nathan.fooo
khorshuheng
Khor Shu Heng
nathan
Zack
Lucas.Xu