Commit Graph

910 Commits

Author SHA1 Message Date
khorshuheng 484cd595e0 feat: add support for create database pages via API 2024-11-26 15:58:16 +08:00
Zack Fu Zi Xiang 2da78b351f
feat: api to get database fields 2024-11-26 14:20:10 +08:00
Zack Fu Zi Xiang c4d52859fb
feat: add a polling api for getting database row id updates 2024-11-24 23:24:29 +08:00
Zack Fu Zi Xiang 298698ac0e
feat: format selection 2024-11-24 05:58:31 +08:00
Zack Fu Zi Xiang ddecd8457c
feat: use folder view minimal for database list 2024-11-23 19:24:08 +08:00
Zack Fu Zi Xiang a6bd54f447
feat: simplify listing databases 2024-11-23 12:11:27 +08:00
Zack Fu Zi Xiang 6d4200d1e7
feat: add row details 2024-11-23 02:40:26 +08:00
Zack Fu Zi Xiang f3a2444615
feat: list database row ids 2024-11-22 20:21:31 +08:00
Nathan.fooo 0ec12c5f2f
chore: add file size (#1015) 2024-11-22 16:31:50 +08:00
Zack Fu Zi Xiang 687b5d9f6d
Merge branch 'main' into feat/search-database-by-name 2024-11-21 09:17:09 +08:00
Bartosz Sypytkowski d0f9059f3f Merge branch 'main' into stateless 2024-11-20 08:36:28 +01:00
Khor Shu Heng afeaeb7796
chore: simplify collab level access control (#1008) 2024-11-20 12:29:16 +08:00
Khor Shu Heng e6dbc95641
feat: api to update space (#1009) 2024-11-20 11:32:29 +08:00
Zack Fu Zi Xiang d7478fb37a
chore: merge with main 2024-11-20 07:51:33 +08:00
khorshuheng 40835f00d1 fix: revert changes to casbin matcher 2024-11-19 21:11:18 +08:00
khorshuheng 00a6189cf3 fix: stop loading collab policies to improve access control evaluation 2024-11-19 12:58:21 +08:00
Khor Shu Heng 0818cf7565
feat: api for create space (#1006) 2024-11-19 12:54:10 +08:00
Khor Shu Heng 2647d41f3a
feat: allow create page API to accept a view name (#1005) 2024-11-19 11:46:23 +08:00
Bartosz Sypytkowski 3799966f12
chore: store pending collab writes in memory (#1000)
* chore: write immediatelly actually writes immediatelly

* chore: fix clippy errors

* chore: add metrics to new storage queue impl

* chore: set collab batch write capacity to the same as on main branch
2024-11-17 13:25:42 +08:00
Nathan.fooo 655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Bartosz Sypytkowski 401cc3ad25 Merge branch 'main' into stateless 2024-11-16 07:22:34 +01:00
Khor Shu Heng d0c212ff10
refactor: remove enforcer group (#948) 2024-11-15 14:08:12 +08:00
Zack d8075a9368
Merge pull request #994 from AppFlowy-IO/fix/smtp-email-username
feat: separate smtp username from email
2024-11-14 22:00:43 +08:00
Zack Fu Zi Xiang 4b2eb1b1ba
feat: separate smtp username from email 2024-11-14 16:00:15 +08:00
Nathan.fooo 06a6ea2985
chore: retry upload file when get s3 service error (#993)
* chore: retry upload file when get s3 service error

* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Bartosz Sypytkowski f6fef9918b
chore: split document content into multiple embeddings (#990)
* chore: split document content into multiple embeddings

* chore: fallback to uuid v4 generation due to unmaintained transient dependency

* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Nathan.fooo e9c374bfe2
chore: remove wasm client api (#989)
* chore: revamp client api

* chore: fmt
2024-11-14 00:53:30 +08:00
Zack Fu Zi Xiang f3cfd87cb8
fix: patch publish name 2024-11-13 17:21:49 +08:00
Nathan.fooo 91b0c50722
chore: remove logs (#986) 2024-11-13 13:59:23 +08:00
Zack Fu Zi Xiang 787e6beb0d
feat: add name filtering 2024-11-12 23:48:41 +08:00
Zack 85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack 288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
feat: support last publish name
2024-11-12 08:42:00 +08:00
Nathan.fooo 14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Zack Fu Zi Xiang ed4c14d53a
fix: also specify workspace id when deleting collab 2024-11-11 17:31:44 +08:00
Zack Fu Zi Xiang 8d8c3282ff
Merge branch 'main' into feat/last-publish-name 2024-11-11 17:15:41 +08:00
Zack 2028f4bffd
feat: use batch insert collab for workspace creation (#977)
* feat: use batch insert collab for workspace creation

* fix: separate user creation from initial workspace creation

* feat: separate workspace creation and collab initialization
2024-11-11 16:02:03 +08:00
Zack Fu Zi Xiang b62552f382
fix: fetch published collab sql 2024-11-11 00:24:30 +08:00
Zack Fu Zi Xiang e5623023aa
chore: cargo clippy 2024-11-10 04:46:51 +08:00
Zack Fu Zi Xiang c705d500ce
Merge branch 'main' into feat/last-publish-name 2024-11-10 04:42:21 +08:00
Zack 3e3e78b684
Merge pull request #842 from AppFlowy-IO/feat/list-database
feat: add database listings
2024-11-08 17:36:25 +08:00
Zack Fu Zi Xiang a07b453c0b
feat: support last publish name 2024-11-08 17:29:02 +08:00
khorshuheng f3604edf2e feat: api for restore all pages from trash 2024-11-08 13:52:23 +08:00
Bartosz Sypytkowski eb54947ab7 chore: add config option for redis stream group workers count 2024-11-08 04:39:44 +01:00
khorshuheng d04a0d8871 feat: api for restore page from trash 2024-11-08 10:58:32 +08:00
Bartosz Sypytkowski bc49d73b40 chore: split redis stream readers to active and one shot 2024-11-07 11:43:19 +01:00
Zack Fu Zi Xiang 867ee8eeff
chore: cargo fmt 2024-11-07 17:08:17 +08:00
Zack Fu Zi Xiang 30dff6c25b
chore: add missing imports 2024-11-07 16:33:27 +08:00
khorshuheng c8dab0fb2c Merge branch 'main' into stateless 2024-11-07 15:55:26 +08:00
Zack Fu Zi Xiang 2e2ec23430
chore: merge with main 2024-11-07 14:59:51 +08:00
Bartosz Sypytkowski 2d9a024554 chore: use redis stream router 2024-11-07 07:18:20 +01:00
khorshuheng eb67e9617c feat: api for updating page 2024-11-07 10:35:21 +08:00
khorshuheng 7f53343c4b Merge branch 'main' into stateless 2024-11-07 09:24:40 +08:00
Bartosz Sypytkowski 9c428f1d89 chore: add stream key info to stream length exceeded check 2024-11-06 07:49:25 +01:00
Bartosz Sypytkowski f328e96763 chore: reduce log visibility level 2024-11-06 07:31:32 +01:00
khorshuheng 3b37112fc5 feat: api for moving page to trash 2024-11-05 21:46:57 +08:00
Bartosz Sypytkowski 5388d419e6 chore: remove unused import 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 183e915f5e chore: lease drop log message - use tracing crate 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 25f0461389 chore: added metrics for new stateless operations 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski e86c9de316 chore: when saving collab snapshot, do not load it unless there are pending updates in redis 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski b6ba52672a chore: add exponential backoff to collab update stream 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 961c482995 chore: prevent hot loops in collab updates stream 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 2511bd720d chore: fix clippy errors 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 923fe7ffde chore: fix errors in lease code 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski e9a7d42b2e chore: fix issues mentioned in nathan review 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 7dc90904cb chore: fix clippy warnings 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski fc1a7d28e2 chore: better stress test scenario 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 279a599b66 chore: fix early return from redis collab update stream reader 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 85e25f887c chore: don't try to prune empty redis stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d0b7c7d8e3 chore: update stream - live and current queries 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 00f5a5bb7e chore: code cleanup 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 3e612e2db6 chore: create method for receiving the most recent snapshot 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 9c674d5777 chore: changes to make appflowy cloud compile under the latest appflowy collab 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 97335a94ec chore: basics of snapshots (unoptimized) 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 253bb97825 chore: a dirty draft of snapshot saving 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 9164c494b1 chore: redis stream for awareness 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d26d0ff1a7 chore: collab streams 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski 0d6b595ee8 chore: create collab update sink and stream 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski fe3611cc88 chore: remove broadcast and introduce lease 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski d3d3378b86 chore: draft of stateless collab group 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski e31e541d07
Merge pull request #961 from AppFlowy-IO/remove-realitime-shared-state
chore: remove realtime shared state
2024-11-05 07:32:18 +01:00
Khor Shu Heng 10fb3dc258
Merge pull request #962 from AppFlowy-IO/web-create-collab
feat: api for space and default collab creation
2024-11-05 12:03:40 +08:00
khorshuheng ba95d94c96 feat: api for space and default collab creation 2024-11-05 10:33:48 +08:00
Zack Fu Zi Xiang d69a2dce1b
fix: update publish namespace 2024-11-04 17:22:47 +08:00
Zack Fu Zi Xiang 8d8c895703
feat: support for original and modified namespace 2024-11-04 16:58:33 +08:00
Bartosz Sypytkowski f9397eaaf2 chore: remove realtime shared state 2024-11-04 07:58:16 +01:00
Zack Fu Zi Xiang d6d7e7312e
fix: namespace already taken 2024-11-03 15:08:38 +08:00
Nathan.fooo 7c42cee11a
chore: Upgrade the collab library to fix the issue with importing Notion zip files that contain embedded zip attachments. (#955)
* chore: bump collab that fixs import notion zip file contains zip attachment

* chore: fix compile
2024-11-01 22:26:27 +08:00
Nathan.fooo a3a581ea4e
chore: fix import test (#941)
* chore: fix import test

* chore: enable test

* chore: fix build

* chore: update test
2024-10-31 15:18:30 +08:00
Nathan.fooo 860a921ea5
chore: remove inline view id (#945)
* chore: remove inline view id

* test: fix test compile

* chore: logs

* chore: update test
2024-10-30 12:47:15 +08:00
Zack Fu Zi Xiang 855cc58ad8
fix: add invalid character error for publish namespace 2024-10-29 15:49:39 +08:00
Zack Fu Zi Xiang 7bcb6cf5f4
chore: merge with main 2024-10-29 09:49:42 +08:00
Zack Fu Zi Xiang a6af0300ee
feat: add specific error code for invalid publish names 2024-10-29 09:48:24 +08:00
Zack 56c55fb6a9
feat: handle duplicated publish names for a workspace (#944)
* feat: handle duplicated publish names for a workspace

* chore: cargo sqlx
2024-10-29 09:39:41 +08:00
Zack Fu Zi Xiang fdc889f73e
feat: handle duplicated publish names for a workspace 2024-10-28 17:58:14 +08:00
Nathan.fooo 1cbb5052f1
chore: revert local host test setting (#942) 2024-10-28 17:21:34 +08:00
Zack Fu Zi Xiang f701abd2a7
feat: delete default view for workspace 2024-10-28 13:32:41 +08:00
Zack Fu Zi Xiang 0fe7d8def7
chore: merge with main 2024-10-28 09:46:31 +08:00
Nathan.fooo 9629d4cefa
chore: add limit for importing zip file (#938)
* chore: add limitation for import zip file

* chore: support upload big file

* chore: implement client api

* chore: implement client api

* chore: implement client api

* chore: update logs

* chore: check file size

* chore: last process at

* chore: set content type

* chore: fix test

* chore: try test

* chore: temporary disable test
2024-10-28 08:51:34 +08:00
Zack Fu Zi Xiang dc44d0ae4e
fix: remove assert that might cause panic 2024-10-27 13:36:17 +08:00
Zack Fu Zi Xiang e29d5d058d
Merge branch 'main' into feat/custom-namespace-change-publish-name 2024-10-27 13:31:45 +08:00
khorshuheng 3c0258b42a feat: add publish info to template home page 2024-10-25 17:30:56 +08:00
Zack Fu Zi Xiang a1e9d56bcf
chore: make pin project workspace dependency 2024-10-25 17:23:35 +08:00
Zack Fu Zi Xiang 920cc69729
feat: add more cases to disambiguate update custom namespace error 2024-10-25 14:48:09 +08:00
Zack Fu Zi Xiang f13916a49a
Merge branch 'main' into feat/custom-namespace-change-publish-name 2024-10-25 14:47:02 +08:00
Zack 42bf807a8e
fix: wait for a second after duplication to workspace (#930)
* fix: wait for a second after duplication to workspace

* chore: rust lint
2024-10-25 13:22:33 +08:00
Zack Fu Zi Xiang b775aa9d4c
feat: patching of publish name 2024-10-24 22:06:52 +08:00
Nathan.fooo f74757e41a
chore: remove deprecate chat api endpoint and update tests (#922)
* chore: remove deprecate chat api endpoint and update tests

* chore: fix test

* chore: clippy
2024-10-24 16:46:41 +08:00
khorshuheng 3169277830 feat: add section timestamp to get favorite/recent/trash endpoints 2024-10-24 12:22:21 +08:00
khorshuheng 23e1da2910 feat: add publish info to list templates 2024-10-23 17:26:32 +08:00
khorshuheng ee9e335152 feat: add publish info to template 2024-10-22 17:29:20 +08:00
Khor Shu Heng 9eb1c36c92
chore: access control interface to return error instead of boolean (#914) 2024-10-21 20:20:14 +08:00
Zack Fu Zi Xiang 3aabf09b21
fix: client url path 2024-10-21 14:09:01 +08:00
Zack Fu Zi Xiang 9ee04b8958
chore: publish metadata wrapper 2024-10-21 12:48:02 +08:00
khorshuheng bd3e5acd86 chore: fix misleading metric description and method name for access control metrics 2024-10-21 10:49:25 +08:00
Nathan.fooo 2f715c3136
feat: custom completion prompt (#906)
* feat: custom completion prompt

* chore: custom prompt
2024-10-20 14:27:41 +08:00
Khor Shu Heng ba8a670101
fix: workspace invitation failure due to email case sensitivity (#904)
* fix: integration test failure due to password mismatch

* fix: workspace invitation failure due to email case sensitivity
2024-10-19 10:10:35 +08:00
Zack 60c589bd9c
feat: CRUD interface for custom namespace (#882)
* feat: listing all published_info

* fix: add sqlx files

* feat: add additional fields for publish info

* feat: get and set default publish info

* chore: cargo sqlx prepare

* fix: cargo clippy

* fix: test case exe order

* chore: cargo sqlx

* feat: get info and meta from workspace namespace

* chore: cargo sqlx

* feat: add original doc info for published view

* chore: log all publish endpoints

* fix: default values for publish info extra fields

* feat: move namespace restriction to gateway
2024-10-19 10:09:54 +08:00
Nathan.fooo 9942e68089
chore: imported workspace should not become the latest visting workspace (#890)
* chore: imported workspace should not become the latest visting workspace

* chore: sqlx files

* chore: update test

* chore: fmt
2024-10-16 21:02:05 +08:00
Nathan.fooo d3e4a6870d
chore: template (#889)
* chore: template

* fix: auto del file lifetime

* chore: delete file if fail to write to disk

* fix: modified html

* chore: set content type

* chore: md5 content

* chore: clippy

* fix: image loaded failed

* fix: build

* chore: bump collab

---------

Co-authored-by: Kilu <lu@appflowy.io>
2024-10-16 17:39:24 +08:00
Khor Shu Heng ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
feat: additional access control config
2024-10-16 17:00:54 +08:00
khorshuheng 383629ab1c chore: simplify not enough permission error 2024-10-16 15:10:31 +08:00
khorshuheng 34a7fd3633 feat: additional access control config 2024-10-16 15:10:01 +08:00
Nathan.fooo 3c02fa253f
chore: retry import (#887)
* chore: retry import

* chore: delete temp files

* chore: bump collab
2024-10-16 12:55:53 +08:00
Khor Shu Heng 1c51656865
chore: update casbin to version 2.5.0 (#878)
Co-authored-by: Nathan.fooo <86001920+appflowy@users.noreply.github.com>
2024-10-15 15:56:29 +08:00
Khor Shu Heng 2a15c8e4b5
feat: support appflowy web editing for document (#877) 2024-10-15 15:05:45 +08:00
Nathan.fooo 1616ceaf4f
chore: use workspace deps (#880) 2024-10-14 16:02:22 +08:00
Nathan.fooo 95e8b30f11
chore: bump collab that use yrs 0.21.2 (#872)
* chore: bump collab that use yrs 0.21.2

* chore: fmt
2024-10-14 00:58:32 +08:00
Nathan.fooo bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Nathan.fooo 14cfaa0bbd
chore: insert metadata after import notion zip file (#871)
* chore: insert metadata after import notion zip file

* chore: update logs
2024-10-10 22:32:02 +08:00
Khor Shu Heng 8c14612f98
feat: refactor access control to enable swapping implementation (#859) 2024-10-10 13:04:47 +08:00
Nathan.fooo 98347b81ea
fix: import notion zip file as workspace (#868)
* chore: insert content length in header

* chore: custom header

* chore: workspace name

* chore: file name

* chore: handle file name that is not utf8 encode

* chore: clippy

* fix: end of file when unzip file

* chore: docs
2024-10-09 21:27:24 +08:00
Nathan.fooo 33e63fae5c
chore: try to fix pg lock timeout (#864)
* chore: try to fix pg lock timeout

* chore: add logs for insert collab

* chore: add timeout for duplicate

* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
Nathan.fooo 38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint (#862)
* chore: using copy to improve write speed of batch collab api endpoint

* chore: insert to redis

* chore: fix compile
2024-10-07 08:58:19 +08:00
Nathan.fooo 9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
khorshuheng 5b799208a8 chore: remove publish collab related dead code 2024-10-03 11:05:28 +08:00
Khor Shu Heng 56f8f395fa
fix: add default serialization to owner email field (#856) 2024-10-02 22:22:25 +08:00
Khor Shu Heng 11732324b5
feat: support fetching encoded collab in batch from memory (#837) 2024-10-02 10:22:40 +08:00
Khor Shu Heng 3b320b0619
feat: support protobuf serialization and deserialization for CollabParams (#834) 2024-10-02 09:49:55 +08:00
khorshuheng 81c9042439 feat: send email to workspace owner when user request access 2024-10-01 11:54:55 +08:00
Khor Shu Heng 757d0e5380
fix: incorrect requester avatar url and workspace member count (#847) 2024-09-29 11:03:08 +08:00
Khor Shu Heng 47a1aae75c
feat: Endpoint for server info (#835)
* feat: provide endpoint so that client can detect server information

* feat: add server info endpoint
2024-09-29 11:01:22 +08:00
khorshuheng 6c6de08eaa fix: access not granted after approval 2024-09-26 18:19:33 +08:00
khorshuheng 813fa29253 feat: add endpoints to allow workspace owner to approve web page view request 2024-09-26 14:59:33 +08:00
Zack Fu Zi Xiang 6777ed8f5d
feat: add database listings 2024-09-25 14:46:26 +08:00
Nathan.fooo b023e2f511
chore: fix incompleted response (#841) 2024-09-24 23:50:45 +08:00
khorshuheng 89ae8e9f64 fix: update page view collab endpoint to follow naming convention 2024-09-19 13:00:07 +08:00
Khor Shu Heng 0b193e1606
feat: add endpoint for getting page view collab (#831) 2024-09-18 12:56:34 +08:00
Zack Fu Zi Xiang a08b325e24
fix: linting 2024-09-17 23:26:10 +08:00
Zack Fu Zi Xiang 62980a780e
fix: view id 2024-09-17 14:58:36 +08:00
Zack Fu Zi Xiang 4497f0673f
Merge branch 'main' into feat/dup-refactor 2024-09-16 15:47:26 +08:00