Commit Graph

728 Commits

Author SHA1 Message Date
Nathan.fooo 33e63fae5c
chore: try to fix pg lock timeout (#864)
* chore: try to fix pg lock timeout

* chore: add logs for insert collab

* chore: add timeout for duplicate

* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
Nathan.fooo 38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint (#862)
* chore: using copy to improve write speed of batch collab api endpoint

* chore: insert to redis

* chore: fix compile
2024-10-07 08:58:19 +08:00
Nathan.fooo 9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
khorshuheng 5b799208a8 chore: remove publish collab related dead code 2024-10-03 11:05:28 +08:00
Khor Shu Heng 56f8f395fa
fix: add default serialization to owner email field (#856) 2024-10-02 22:22:25 +08:00
Khor Shu Heng 11732324b5
feat: support fetching encoded collab in batch from memory (#837) 2024-10-02 10:22:40 +08:00
Khor Shu Heng 3b320b0619
feat: support protobuf serialization and deserialization for CollabParams (#834) 2024-10-02 09:49:55 +08:00
khorshuheng 81c9042439 feat: send email to workspace owner when user request access 2024-10-01 11:54:55 +08:00
Khor Shu Heng 757d0e5380
fix: incorrect requester avatar url and workspace member count (#847) 2024-09-29 11:03:08 +08:00
Khor Shu Heng 47a1aae75c
feat: Endpoint for server info (#835)
* feat: provide endpoint so that client can detect server information

* feat: add server info endpoint
2024-09-29 11:01:22 +08:00
khorshuheng 6c6de08eaa fix: access not granted after approval 2024-09-26 18:19:33 +08:00
khorshuheng 813fa29253 feat: add endpoints to allow workspace owner to approve web page view request 2024-09-26 14:59:33 +08:00
Nathan.fooo b023e2f511
chore: fix incompleted response (#841) 2024-09-24 23:50:45 +08:00
khorshuheng 89ae8e9f64 fix: update page view collab endpoint to follow naming convention 2024-09-19 13:00:07 +08:00
Khor Shu Heng 0b193e1606
feat: add endpoint for getting page view collab (#831) 2024-09-18 12:56:34 +08:00
Zack Fu Zi Xiang a08b325e24
fix: linting 2024-09-17 23:26:10 +08:00
Zack Fu Zi Xiang 62980a780e
fix: view id 2024-09-17 14:58:36 +08:00
Zack Fu Zi Xiang 4497f0673f
Merge branch 'main' into feat/dup-refactor 2024-09-16 15:47:26 +08:00
Nathan.fooo 054fd2e7d8
chore: ignore create redis stream error when create a new group (#826) 2024-09-16 15:31:05 +08:00
Zack Fu Zi Xiang 704b8517c6
Merge branch 'main' into feat/dup-refactor 2024-09-16 15:12:40 +08:00
Zack Fu Zi Xiang 4345f8b2a5
chore: merge with main 2024-09-16 10:55:14 +08:00
khorshuheng 180db846d9 fix: filter out templates which has not been published 2024-09-16 00:05:22 +08:00
Zack Fu Zi Xiang 35786fb2d5
Merge branch 'main' into feat/workspace-invite-fields 2024-09-15 13:59:25 +08:00
Nathan.fooo 4c54481d70
chore: bump collab version (#822)
* chore: bump collab version

* chore: update deps count
2024-09-14 23:59:50 +08:00
Zack Fu Zi Xiang 4b59574392
chore: add specific error code for wrong invitee 2024-09-13 21:02:09 +08:00
Zack Fu Zi Xiang 11cdc862f2
feat: additional fields for workspace invitation 2024-09-13 17:43:10 +08:00
Zack Fu Zi Xiang 87ef341724
Merge branch 'main' into feat/dup-refactor 2024-09-13 14:51:40 +08:00
Zack Fu Zi Xiang df66cfc6f4
chore: update dep 2024-09-13 14:51:15 +08:00
Zack Fu Zi Xiang 53c98c8bd6
chore: use gen env var optional 2024-09-13 11:25:57 +08:00
Zack Fu Zi Xiang adb9acf799
Merge branch 'main' into feat/workspace-invite-get 2024-09-13 09:25:07 +08:00
Zack Fu Zi Xiang 8dc606e68e
Merge branch 'main' into feat/dup-refactor 2024-09-12 21:18:22 +08:00
Zack Fu Zi Xiang f25066f51f
feat: add get invitation by id 2024-09-12 15:10:48 +08:00
khorshuheng c686aa91a6 feat: add retrieve sections endpoints 2024-09-12 13:02:14 +08:00
Zack Fu Zi Xiang 922418b122
chore: merge with main 2024-09-12 10:09:42 +08:00
Zack Fu Zi Xiang 306faad11e
feat: use database row body 2024-09-12 01:13:07 +08:00
Nathan.fooo 1ccff73e49
chore: bump appflowy collab (#814)
* chore: bump appflowy collab

* chore: fix build
2024-09-12 00:28:26 +08:00
Khor Shu Heng 57a30817fe
Merge pull request #811 from AppFlowy-IO/add-is-published-to-folder-struct
feat: add additional fields to FolderView and support different root id
2024-09-11 23:23:37 +08:00
Nathan.fooo cbad6f22be
chore: use rayon to do compression on client api (#813)
* chore: use rayon to do compression on client api

* chore: update client deps
2024-09-11 21:47:14 +08:00
Khor Shu Heng abae8d2d1b
feat: Support s3 as published collab storage (#798)
* chore: remove unused published collab methods

* feat: support s3 as published collab storage
2024-09-11 20:52:33 +08:00
khorshuheng a97c1fbf1b feat: add additional folder view fields, allow different root id, filter invalid view 2024-09-11 17:37:55 +08:00
Zack Fu Zi Xiang cff144a857
chore: add test for duplicating doc in database row 2024-09-11 16:38:24 +08:00
Zack 5bf08621de
feat: dup doc in db row (#806)
* feat: support doc in duplicated database row

* fix: use db row collab

* fix: use meta

* fix: set correct values

* feat: allow insertion of standalone view

* fix: use correct id for duplicating doc in db row

* feat: add attachment count

* fix: compile
2024-09-11 10:16:56 +08:00
Zack Fu Zi Xiang bcb2f520a2
Merge branch 'main' into feat/dup-doc-in-db-row 2024-09-10 22:59:04 +08:00
Nathan.fooo 07d6001cf8
chore: check before write to hisotry (#809)
* chore: check before write to hisotry

* chore: clippy

* chore: clippy

* chore: calculate edit count

* chore: clippy

* chore: exit loop

* chore: exit loop

* chore: update log
2024-09-10 22:10:59 +08:00
Zack Fu Zi Xiang 1cf858aab7
chore: merge with upstream 2024-09-10 19:41:14 +08:00
Zack Fu Zi Xiang bf9aed5384
Merge branch 'main' into feat/dup-doc-in-db-row 2024-09-10 19:37:49 +08:00
Zack Fu Zi Xiang 5564fab4c5
chore: fix compile 2024-09-10 14:45:21 +08:00
Zack Fu Zi Xiang 3c90395d46
Merge branch 'main' into feat/duplicate-relation 2024-09-10 14:42:57 +08:00
Nathan.fooo e742a9039a
chore: bump collab version (#807) 2024-09-10 11:18:20 +08:00
Zack Fu Zi Xiang 0dbd8fd633
chore: merge with main 2024-09-09 19:27:45 +08:00
Zack Fu Zi Xiang 28a2d269e9
chore: merge with main 2024-09-09 19:25:24 +08:00
Nathan.fooo 3f59c650f4
chore: bump appflowy collab (#805)
* chore: bump appflowy collab

* chore: fix test

* chore: bump collab
2024-09-09 18:50:47 +08:00
Zack Fu Zi Xiang 321286bed2
chore: use into 2024-09-09 16:07:28 +08:00
Zack Fu Zi Xiang d99687e080
feat: support doc in duplicated database row 2024-09-09 12:48:04 +08:00
Zack Fu Zi Xiang d1635cb99c
chore: add test 2024-09-06 15:30:28 +08:00
Zack Fu Zi Xiang cf7d4b0ac9
Merge branch 'main' into fix/del-collab-emb 2024-09-05 11:21:06 +08:00
Nathan.fooo 5d356718fa
fix: using spawn_blocking in order to not block the runtime (#793)
* fix: using blocking in order to not block the runtime

* chore: increase deps count
2024-09-05 09:19:34 +08:00
Zack Fu Zi Xiang 312411cca2
fix: slow query deleting collab embeddings 2024-09-05 00:06:04 +08:00
nathan 886376e8bd chore: update client api log 2024-09-04 22:02:37 +08:00
Khor Shu Heng 348f2c8ff1
feat: add is published field to published outline response (#790) 2024-09-04 19:14:39 +08:00
Nathan.fooo 4e384b982e
chore: pass chat metadata (#789)
* chore: pass chat metadata

* chore: clippy
2024-09-04 17:19:39 +08:00
Zack Fu Zi Xiang 584ed0863f
chore: fmt sqlx 2024-09-04 12:03:25 +08:00
Zack Fu Zi Xiang 6d0a7cc95b
fix: delete user should only remove owned workspaces 2024-09-04 12:00:34 +08:00
Nathan.fooo 5b5e561afb
chore: decode file url (#786) 2024-09-03 21:30:33 +08:00
Zack Fu Zi Xiang 292740ec58
fix: compile for release mode 2024-09-03 17:21:39 +08:00
khorshuheng 89f43bb24a chore: replace query with query scalar for retrieving published view id 2024-09-03 15:28:01 +08:00
khorshuheng 56b9f9daf4 feat: published view outline endpoint 2024-09-03 15:27:59 +08:00
Zack 8015e34841
Merge pull request #780 from AppFlowy-IO/feat/delete-user
Feat/delete user
2024-09-03 14:10:09 +08:00
Zack Fu Zi Xiang 0fc6a3c4e7
feat: use common table expression to improve user profile sql 2024-09-03 12:08:37 +08:00
Zack Fu Zi Xiang 7980bb04c5
chore: merge with main 2024-09-03 09:43:14 +08:00
Zack 826546c5cb
feat: duplicate published doc (#700)
* chore: test collab sync

* feat: folder view for user workspace

* feat: add private indicator

* chore: use collab cache instead

* chore: initial impl

* chore: cargo sqlx

* fix: write back to collab cache

* fix: assign page id

* fix: text map

* chore: connect api and refactor

* chore: switch to using mem storage

* fix: collab type

* feat: use group manager to manage sync

* feat: try add send command instead

* chore: add client api code

* feat: try use sink and stream from group collab

* chore: disable sync first

* fix: insert page before stopping group

* feat: add extra for view

* feat: add metadata to doc

* fix: icon

* fix: page circular dep

* fix: page circular dep

* fix: live update

* feat: database initial impl

* feat: workspace database

* chore: link database

* fix: database validation

* fix: workspace database oid

* fix: workspace database oid

* fix: specify view layout

* feat: add txn when inserting collab and rework database views

* fix: parent view id for new database

* fix: database view for folder

* fix: database ids

* fix: database row id

* fix: main database layout and write database before folder

* fix: metadata for non database main view

* chore: database in doc wip

* chore: filter visible views

* chore: use structure value instead of json

* chore: database in doc wip

* fix: remove child item push

* fix: main database view meta

* chore: rework inline database in doc

* fix: make duplicate more error forgiving

* chore: use get instead of get key value

* chore: merge with main

* feat: set max depth for folder view

* chore: update dependency counter

* chore: remove unneeded arg

* chore: simplify collab new from source

* chore: remove unneeded param

* chore: rename and doc

* feat: rework inline database and use duplicated ref

* chore: simplify params

* chore: fmt

* feat: deduplicate database wip

* fix: compatible with newer appflowy version

* fix: database views

* feat: database in doc

* chore: cargo clippy

* chore: update dockerfile rust toolchain

* fix: doc inline db parent id

* fix: database id

* fix: document data modification

* chore: minor refactor and todo

* chore: remove unneeded nesting

* fix: enforce ordering for views to add

* chore: add doc and test case for folder view

* fix: remove the need for cloning published collab

* fix: some review

* chore: move folder conversion logic

* fix: remove collab folder deps on shared entity

* chore: cargo fmt

* fix: compile

* chore: remove group manager dependency

* fix: dep count

* fix: add messages sent by server

* fix: dep count

* chore: add test for doc ref and inline doc database

* chore: cargo clippy

* chore: add more test scenarios

* chore: fix tests

* chore: get database id

* chore: update collab

* chore: add more assert and database row id checks

* fix: suggestions from review

* chore: sqlx

* fix: accumulate collab before insert

* chore: add tokio spawn blocking for encoding

* fix: reduce limit for publish collabs

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
Co-authored-by: nathan <nathan@appflowy.io>
2024-09-03 09:12:29 +08:00
Lucas.Xu cf1bae3ccb
chore: update getting_started icon and remove empty paragraph (#778)
* chore: update getting_started icon and remove empty paragraph

* fix: get_user_default_workspace test
2024-09-03 09:02:27 +08:00
Zack Fu Zi Xiang 6acaf69add
Merge branch 'main' into feat/delete-user 2024-09-03 02:24:58 +08:00
Nathan.fooo 365c64c5c2
chore: use colla storage instead of select from db directly (#782) 2024-09-02 21:25:21 +08:00
Zack Fu Zi Xiang fd22e1d472
chore: preserve provider token 2024-09-02 21:13:33 +08:00
Zack Fu Zi Xiang 25cec9982f
chore: revoke for apple user 2024-09-02 17:25:21 +08:00
Zack Fu Zi Xiang 89f2c7003b
feat: support user deletion 2024-09-02 11:14:04 +08:00
Zack Fu Zi Xiang a2af9c3b63
Merge branch 'main' into feat/delete-user 2024-09-02 01:00:28 +08:00
Nathan.fooo c2a5369313
chore: set chat request timeout (#777)
* chore: set chat request timeout

* chore: clippy
2024-09-01 15:16:11 +08:00
Zack Fu Zi Xiang 1b7f3f817c
Merge branch 'main' into feat/delete-user 2024-09-01 00:51:38 +08:00
Zack Fu Zi Xiang 06a5a22032
feat: delete user 2024-09-01 00:51:05 +08:00
Bartosz Sypytkowski 6972f9c4ab
feat: Measure sync (#772)
* chore: redesign collab sync protocol to enable injection of metric tracking

* chore: track metrics for apply update on the server side

* chore: close locks

* chore: post rebase fixes
2024-08-30 21:48:19 +08:00
Lucas.Xu fbe5ed4deb chore: remove spaces around em dash in mobile_guide.json 2024-08-30 16:06:43 +08:00
Nathan.fooo 5278203394
chore: decode update when spawn blocking when update size exceeds the… (#769)
* chore: decode update when spawn blocking when update size exceeds the threshold size

* chore: use 1mb as threshold
2024-08-30 11:30:15 +08:00
Nathan.fooo 773efcd91a
chore: increase chat timeout (#768) 2024-08-30 09:37:22 +08:00
Nathan.fooo 54b811125e
chore: wrap spawn blocking when decoding collab (#767) 2024-08-29 22:53:33 +08:00
Bartosz Sypytkowski 2af1999375
chore: added locks with timeouts (#765)
* chore: added locks with timeouts

* chore: roll back collab locks in client api
2024-08-29 16:13:27 +08:00
Nathan.fooo c9504d4081
fix: invalid message id (#762)
* chore: add logs

* chore: remove all pending message when server missing update
2024-08-28 21:05:15 +08:00
Lucas.Xu e7bf221ff0
feat: update built-in README for new users (#757)
* feat: add getting_started, desktop_guide and mobile_guide json

* feat: update built-in readme data

* feat: support adding database as template

* feat: support creating nested documents

* chore: refactor code

* chore: refactor code

* chore: remove println

* chore: update collab version

* feat: update built-in readme and image ref

* chore: remove template icon

* feat: use database::create_with_view to create collab

* chore: add template tests

* chore: update collab version

* chore: remove debug code

* chore: add comment

* chore: fix lint & test

* fix: code review

* fix: rust lint

* chore: update comment

* test: add default workspace test

* test: add default user workspace test

* chore: use workspace database body

* chore: fix typo and clippy

* fix: insert_folder_data_success test

* fix: insert_folder_data_success test

* feat: update content in gettting_started

* chore: update to-dos json

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-08-28 19:40:23 +08:00
Nathan.fooo cccdf76116
chore: Update client protocol sync interval (#761)
* chore: separate server/client miss update

* chore: short pull timeout

* chore: short tick interval

* chore: fix clippy
2024-08-28 14:46:55 +08:00
Bartosz Sypytkowski 5badffc97b
chore: update yrs and appflowy collab (#759)
* chore: update yrs and appflowy collab

* chore: increased allowed number of dependencies
2024-08-27 19:58:58 +08:00
Nathan.fooo c8ee6b43ee
chore: try to fix inifinite sync (#756) 2024-08-27 16:41:19 +08:00
Nathan.fooo a21c55cbcc
chore: modify log level for some cases (#754)
* chore: modify log level for some cases

* chore: update logs
2024-08-27 14:57:00 +08:00
Zack Fu Zi Xiang 66f74f2e4b
Merge branch 'main' into gotrue-2.159.0 2024-08-27 12:55:31 +08:00
Bartosz Sypytkowski 15b2e81579
chore: enable setting up periodic sync step 1 sends from sync plugin (#738)
* chore: enable setting up periodic sync step 1 sends from sync plugin

* chore: rollback to server sending sync step 1 to response to the client

* chore: increase sync step 1 interval in tests
2024-08-27 11:55:27 +08:00
Zack Fu Zi Xiang 96e1463b39
fix: compatibility error 2024-08-27 11:36:51 +08:00
Zack Fu Zi Xiang eb74e095b5
fix: update for later version of gotrue 2024-08-27 10:15:20 +08:00
Nathan.fooo 8cc410ce65
chore: revamp get collab api request (#752)
* chore: stop retry if record is not found
2024-08-26 23:41:06 +08:00
Zack Fu Zi Xiang 6adf8f0fb2
chore: add single upload limit 2024-08-26 15:02:35 +08:00
Khor Shu Heng 52f33e4d85
feat: endpoint for avatar upload (#736) 2024-08-23 16:36:09 +08:00