51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable ( #1035 )
2024-12-03 14:09:09 +08:00
9ff6f1c744
S3 collab cache ( #1028 )
...
* chore: collab cache for S3
* chore: adjust disk cache api to accomodate s3
* chore: move postgres dependent ops to disk cache
* chore: replace blob inserts from pg to s3
* chore: delete blob and collab exist now use s3
* chore: fix clippy erorrs
* chore: post rebase fixes
* chore: fix clippy warnings
* chore: fix imports
* chore: make snapshots work over S3
* chore: remove dead code
* chore: use compressed snapshots
* chore: add zstd compression
* chore: introduce collab size threshold to keep smaller collabs in postgres
* chore: remove collabs from S3 if they were put to postgres
* chore: update tests
2024-12-03 13:08:55 +08:00
e31928e77a
Merge pull request #1019 from AppFlowy-IO/feat/get-database-fields
...
feat: api to get database fields
2024-11-27 19:04:20 -08:00
3e3bf693fd
chore: upload api endpoint for web upload ( #1024 )
...
* chore: upload api endpoint for web upload
* chore: use rust 1.78
* fix: test
2024-11-28 09:09:09 +08:00
7457371208
Merge branch 'main' into feat/get-database-fields
2024-11-27 18:18:34 +08:00
ed83fba242
feat: add type options
2024-11-27 17:24:14 +08:00
a4b598db5b
fix: remove only parent page when move to trash ( #1021 )
2024-11-27 13:00:58 +08:00
4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab ( #1022 )
...
* chore: reduce number of SQL statements executed when inserting new collab
* chore: add workspace id check
* chore: fix previous query
* chore: upsert collabs and embddings as stored procedures
* chore: fix clippy errors
* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
b4def2278d
chore: merge with main
2024-11-26 21:18:37 +08:00
484cd595e0
feat: add support for create database pages via API
2024-11-26 15:58:16 +08:00
2da78b351f
feat: api to get database fields
2024-11-26 14:20:10 +08:00
c4d52859fb
feat: add a polling api for getting database row id updates
2024-11-24 23:24:29 +08:00
298698ac0e
feat: format selection
2024-11-24 05:58:31 +08:00
ddecd8457c
feat: use folder view minimal for database list
2024-11-23 19:24:08 +08:00
a6bd54f447
feat: simplify listing databases
2024-11-23 12:11:27 +08:00
6d4200d1e7
feat: add row details
2024-11-23 02:40:26 +08:00
f3a2444615
feat: list database row ids
2024-11-22 20:21:31 +08:00
0ec12c5f2f
chore: add file size ( #1015 )
2024-11-22 16:31:50 +08:00
687b5d9f6d
Merge branch 'main' into feat/search-database-by-name
2024-11-21 09:17:09 +08:00
d0f9059f3f
Merge branch 'main' into stateless
2024-11-20 08:36:28 +01:00
afeaeb7796
chore: simplify collab level access control ( #1008 )
2024-11-20 12:29:16 +08:00
e6dbc95641
feat: api to update space ( #1009 )
2024-11-20 11:32:29 +08:00
d7478fb37a
chore: merge with main
2024-11-20 07:51:33 +08:00
40835f00d1
fix: revert changes to casbin matcher
2024-11-19 21:11:18 +08:00
00a6189cf3
fix: stop loading collab policies to improve access control evaluation
2024-11-19 12:58:21 +08:00
0818cf7565
feat: api for create space ( #1006 )
2024-11-19 12:54:10 +08:00
2647d41f3a
feat: allow create page API to accept a view name ( #1005 )
2024-11-19 11:46:23 +08:00
3799966f12
chore: store pending collab writes in memory ( #1000 )
...
* chore: write immediatelly actually writes immediatelly
* chore: fix clippy errors
* chore: add metrics to new storage queue impl
* chore: set collab batch write capacity to the same as on main branch
2024-11-17 13:25:42 +08:00
655f13bc27
chore: search and chat ( #999 )
...
* chore: add test for search and chat
* chore: update test
* chore: update test
* chore: update ci
* chore: fix security audio
* chore: multiple core docker build
* chore: multiple core docker build
* chore: update ci
* chore: update model setting
* chore: test ci
* chore: use tiktoken to calcualte token length
* chore: remove env
* chore: use spawn_blocking with condition
* chore: docs
* chore: clippy
* chore: clippy
* chore: docker logs
* chore: pass message id
* chore: clippy
2024-11-16 14:52:12 +08:00
401cc3ad25
Merge branch 'main' into stateless
2024-11-16 07:22:34 +01:00
d0c212ff10
refactor: remove enforcer group ( #948 )
2024-11-15 14:08:12 +08:00
d8075a9368
Merge pull request #994 from AppFlowy-IO/fix/smtp-email-username
...
feat: separate smtp username from email
2024-11-14 22:00:43 +08:00
4b2eb1b1ba
feat: separate smtp username from email
2024-11-14 16:00:15 +08:00
06a6ea2985
chore: retry upload file when get s3 service error ( #993 )
...
* chore: retry upload file when get s3 service error
* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
f6fef9918b
chore: split document content into multiple embeddings ( #990 )
...
* chore: split document content into multiple embeddings
* chore: fallback to uuid v4 generation due to unmaintained transient dependency
* chore: fix lint errors
2024-11-14 14:15:52 +08:00
e9c374bfe2
chore: remove wasm client api ( #989 )
...
* chore: revamp client api
* chore: fmt
2024-11-14 00:53:30 +08:00
f3cfd87cb8
fix: patch publish name
2024-11-13 17:21:49 +08:00
91b0c50722
chore: remove logs ( #986 )
2024-11-13 13:59:23 +08:00
787e6beb0d
feat: add name filtering
2024-11-12 23:48:41 +08:00
85452ddfab
feat: add role for user when querying workspaces ( #983 )
2024-11-12 21:12:58 +08:00
288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
...
feat: support last publish name
2024-11-12 08:42:00 +08:00
14adf250a8
chore: update ai api endpoint & rename structs ( #953 )
...
* chore: revmap loader type
* chore: revamp context
* chore: fix test
* chore: remove unused handler
* chore: create new chat api endpoint
* chore: add docs
* chore: clippy
* chore: fix test
2024-11-11 20:10:46 +08:00
ed4c14d53a
fix: also specify workspace id when deleting collab
2024-11-11 17:31:44 +08:00
8d8c3282ff
Merge branch 'main' into feat/last-publish-name
2024-11-11 17:15:41 +08:00
2028f4bffd
feat: use batch insert collab for workspace creation ( #977 )
...
* feat: use batch insert collab for workspace creation
* fix: separate user creation from initial workspace creation
* feat: separate workspace creation and collab initialization
2024-11-11 16:02:03 +08:00
b62552f382
fix: fetch published collab sql
2024-11-11 00:24:30 +08:00
e5623023aa
chore: cargo clippy
2024-11-10 04:46:51 +08:00
c705d500ce
Merge branch 'main' into feat/last-publish-name
2024-11-10 04:42:21 +08:00
3e3e78b684
Merge pull request #842 from AppFlowy-IO/feat/list-database
...
feat: add database listings
2024-11-08 17:36:25 +08:00
a07b453c0b
feat: support last publish name
2024-11-08 17:29:02 +08:00
f3604edf2e
feat: api for restore all pages from trash
2024-11-08 13:52:23 +08:00
eb54947ab7
chore: add config option for redis stream group workers count
2024-11-08 04:39:44 +01:00
d04a0d8871
feat: api for restore page from trash
2024-11-08 10:58:32 +08:00
bc49d73b40
chore: split redis stream readers to active and one shot
2024-11-07 11:43:19 +01:00
867ee8eeff
chore: cargo fmt
2024-11-07 17:08:17 +08:00
30dff6c25b
chore: add missing imports
2024-11-07 16:33:27 +08:00
c8dab0fb2c
Merge branch 'main' into stateless
2024-11-07 15:55:26 +08:00
2e2ec23430
chore: merge with main
2024-11-07 14:59:51 +08:00
2d9a024554
chore: use redis stream router
2024-11-07 07:18:20 +01:00
eb67e9617c
feat: api for updating page
2024-11-07 10:35:21 +08:00
7f53343c4b
Merge branch 'main' into stateless
2024-11-07 09:24:40 +08:00
9c428f1d89
chore: add stream key info to stream length exceeded check
2024-11-06 07:49:25 +01:00
f328e96763
chore: reduce log visibility level
2024-11-06 07:31:32 +01:00
3b37112fc5
feat: api for moving page to trash
2024-11-05 21:46:57 +08:00
5388d419e6
chore: remove unused import
2024-11-05 07:48:14 +01:00
183e915f5e
chore: lease drop log message - use tracing crate
2024-11-05 07:48:14 +01:00
25f0461389
chore: added metrics for new stateless operations
2024-11-05 07:48:14 +01:00
e86c9de316
chore: when saving collab snapshot, do not load it unless there are pending updates in redis
2024-11-05 07:48:14 +01:00
b6ba52672a
chore: add exponential backoff to collab update stream
2024-11-05 07:48:14 +01:00
961c482995
chore: prevent hot loops in collab updates stream
2024-11-05 07:48:14 +01:00
2511bd720d
chore: fix clippy errors
2024-11-05 07:48:14 +01:00
923fe7ffde
chore: fix errors in lease code
2024-11-05 07:48:14 +01:00
e9a7d42b2e
chore: fix issues mentioned in nathan review
2024-11-05 07:48:14 +01:00
7dc90904cb
chore: fix clippy warnings
2024-11-05 07:47:17 +01:00
fc1a7d28e2
chore: better stress test scenario
2024-11-05 07:47:17 +01:00
279a599b66
chore: fix early return from redis collab update stream reader
2024-11-05 07:47:17 +01:00
85e25f887c
chore: don't try to prune empty redis stream
2024-11-05 07:47:17 +01:00
d0b7c7d8e3
chore: update stream - live and current queries
2024-11-05 07:47:17 +01:00
00f5a5bb7e
chore: code cleanup
2024-11-05 07:47:17 +01:00
3e612e2db6
chore: create method for receiving the most recent snapshot
2024-11-05 07:47:17 +01:00
9c674d5777
chore: changes to make appflowy cloud compile under the latest appflowy collab
2024-11-05 07:47:17 +01:00
97335a94ec
chore: basics of snapshots (unoptimized)
2024-11-05 07:47:17 +01:00
253bb97825
chore: a dirty draft of snapshot saving
2024-11-05 07:47:17 +01:00
9164c494b1
chore: redis stream for awareness
2024-11-05 07:47:17 +01:00
d26d0ff1a7
chore: collab streams
2024-11-05 07:47:17 +01:00
0d6b595ee8
chore: create collab update sink and stream
2024-11-05 07:47:17 +01:00
fe3611cc88
chore: remove broadcast and introduce lease
2024-11-05 07:47:17 +01:00
d3d3378b86
chore: draft of stateless collab group
2024-11-05 07:47:17 +01:00
e31e541d07
Merge pull request #961 from AppFlowy-IO/remove-realitime-shared-state
...
chore: remove realtime shared state
2024-11-05 07:32:18 +01:00
10fb3dc258
Merge pull request #962 from AppFlowy-IO/web-create-collab
...
feat: api for space and default collab creation
2024-11-05 12:03:40 +08:00
ba95d94c96
feat: api for space and default collab creation
2024-11-05 10:33:48 +08:00
d69a2dce1b
fix: update publish namespace
2024-11-04 17:22:47 +08:00
8d8c895703
feat: support for original and modified namespace
2024-11-04 16:58:33 +08:00
f9397eaaf2
chore: remove realtime shared state
2024-11-04 07:58:16 +01:00
d6d7e7312e
fix: namespace already taken
2024-11-03 15:08:38 +08:00
7c42cee11a
chore: Upgrade the collab library to fix the issue with importing Notion zip files that contain embedded zip attachments. ( #955 )
...
* chore: bump collab that fixs import notion zip file contains zip attachment
* chore: fix compile
2024-11-01 22:26:27 +08:00
a3a581ea4e
chore: fix import test ( #941 )
...
* chore: fix import test
* chore: enable test
* chore: fix build
* chore: update test
2024-10-31 15:18:30 +08:00
860a921ea5
chore: remove inline view id ( #945 )
...
* chore: remove inline view id
* test: fix test compile
* chore: logs
* chore: update test
2024-10-30 12:47:15 +08:00
855cc58ad8
fix: add invalid character error for publish namespace
2024-10-29 15:49:39 +08:00
7bcb6cf5f4
chore: merge with main
2024-10-29 09:49:42 +08:00
a6af0300ee
feat: add specific error code for invalid publish names
2024-10-29 09:48:24 +08:00
56c55fb6a9
feat: handle duplicated publish names for a workspace ( #944 )
...
* feat: handle duplicated publish names for a workspace
* chore: cargo sqlx
2024-10-29 09:39:41 +08:00
fdc889f73e
feat: handle duplicated publish names for a workspace
2024-10-28 17:58:14 +08:00
1cbb5052f1
chore: revert local host test setting ( #942 )
2024-10-28 17:21:34 +08:00
f701abd2a7
feat: delete default view for workspace
2024-10-28 13:32:41 +08:00
0fe7d8def7
chore: merge with main
2024-10-28 09:46:31 +08:00
9629d4cefa
chore: add limit for importing zip file ( #938 )
...
* chore: add limitation for import zip file
* chore: support upload big file
* chore: implement client api
* chore: implement client api
* chore: implement client api
* chore: update logs
* chore: check file size
* chore: last process at
* chore: set content type
* chore: fix test
* chore: try test
* chore: temporary disable test
2024-10-28 08:51:34 +08:00
dc44d0ae4e
fix: remove assert that might cause panic
2024-10-27 13:36:17 +08:00
e29d5d058d
Merge branch 'main' into feat/custom-namespace-change-publish-name
2024-10-27 13:31:45 +08:00
3c0258b42a
feat: add publish info to template home page
2024-10-25 17:30:56 +08:00
a1e9d56bcf
chore: make pin project workspace dependency
2024-10-25 17:23:35 +08:00
920cc69729
feat: add more cases to disambiguate update custom namespace error
2024-10-25 14:48:09 +08:00
f13916a49a
Merge branch 'main' into feat/custom-namespace-change-publish-name
2024-10-25 14:47:02 +08:00
42bf807a8e
fix: wait for a second after duplication to workspace ( #930 )
...
* fix: wait for a second after duplication to workspace
* chore: rust lint
2024-10-25 13:22:33 +08:00
b775aa9d4c
feat: patching of publish name
2024-10-24 22:06:52 +08:00
f74757e41a
chore: remove deprecate chat api endpoint and update tests ( #922 )
...
* chore: remove deprecate chat api endpoint and update tests
* chore: fix test
* chore: clippy
2024-10-24 16:46:41 +08:00
3169277830
feat: add section timestamp to get favorite/recent/trash endpoints
2024-10-24 12:22:21 +08:00
23e1da2910
feat: add publish info to list templates
2024-10-23 17:26:32 +08:00
ee9e335152
feat: add publish info to template
2024-10-22 17:29:20 +08:00
9eb1c36c92
chore: access control interface to return error instead of boolean ( #914 )
2024-10-21 20:20:14 +08:00
3aabf09b21
fix: client url path
2024-10-21 14:09:01 +08:00
9ee04b8958
chore: publish metadata wrapper
2024-10-21 12:48:02 +08:00
bd3e5acd86
chore: fix misleading metric description and method name for access control metrics
2024-10-21 10:49:25 +08:00
2f715c3136
feat: custom completion prompt ( #906 )
...
* feat: custom completion prompt
* chore: custom prompt
2024-10-20 14:27:41 +08:00
ba8a670101
fix: workspace invitation failure due to email case sensitivity ( #904 )
...
* fix: integration test failure due to password mismatch
* fix: workspace invitation failure due to email case sensitivity
2024-10-19 10:10:35 +08:00
60c589bd9c
feat: CRUD interface for custom namespace ( #882 )
...
* feat: listing all published_info
* fix: add sqlx files
* feat: add additional fields for publish info
* feat: get and set default publish info
* chore: cargo sqlx prepare
* fix: cargo clippy
* fix: test case exe order
* chore: cargo sqlx
* feat: get info and meta from workspace namespace
* chore: cargo sqlx
* feat: add original doc info for published view
* chore: log all publish endpoints
* fix: default values for publish info extra fields
* feat: move namespace restriction to gateway
2024-10-19 10:09:54 +08:00
9942e68089
chore: imported workspace should not become the latest visting workspace ( #890 )
...
* chore: imported workspace should not become the latest visting workspace
* chore: sqlx files
* chore: update test
* chore: fmt
2024-10-16 21:02:05 +08:00
d3e4a6870d
chore: template ( #889 )
...
* chore: template
* fix: auto del file lifetime
* chore: delete file if fail to write to disk
* fix: modified html
* chore: set content type
* chore: md5 content
* chore: clippy
* fix: image loaded failed
* fix: build
* chore: bump collab
---------
Co-authored-by: Kilu <lu@appflowy.io>
2024-10-16 17:39:24 +08:00
ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
...
feat: additional access control config
2024-10-16 17:00:54 +08:00
383629ab1c
chore: simplify not enough permission error
2024-10-16 15:10:31 +08:00
34a7fd3633
feat: additional access control config
2024-10-16 15:10:01 +08:00
3c02fa253f
chore: retry import ( #887 )
...
* chore: retry import
* chore: delete temp files
* chore: bump collab
2024-10-16 12:55:53 +08:00
1c51656865
chore: update casbin to version 2.5.0 ( #878 )
...
Co-authored-by: Nathan.fooo <86001920+appflowy@users.noreply.github.com>
2024-10-15 15:56:29 +08:00
2a15c8e4b5
feat: support appflowy web editing for document ( #877 )
2024-10-15 15:05:45 +08:00
1616ceaf4f
chore: use workspace deps ( #880 )
2024-10-14 16:02:22 +08:00
95e8b30f11
chore: bump collab that use yrs 0.21.2 ( #872 )
...
* chore: bump collab that use yrs 0.21.2
* chore: fmt
2024-10-14 00:58:32 +08:00
bbd21dfef6
chore: import mailer ( #869 )
...
* chore: import mailer
* chore: update template
* chore: config template
* fix: add missing config parameter
* chore: update template
* chore: show error with task id
* chore: show error with task id
---------
Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
14cfaa0bbd
chore: insert metadata after import notion zip file ( #871 )
...
* chore: insert metadata after import notion zip file
* chore: update logs
2024-10-10 22:32:02 +08:00
8c14612f98
feat: refactor access control to enable swapping implementation ( #859 )
2024-10-10 13:04:47 +08:00
98347b81ea
fix: import notion zip file as workspace ( #868 )
...
* chore: insert content length in header
* chore: custom header
* chore: workspace name
* chore: file name
* chore: handle file name that is not utf8 encode
* chore: clippy
* fix: end of file when unzip file
* chore: docs
2024-10-09 21:27:24 +08:00
33e63fae5c
chore: try to fix pg lock timeout ( #864 )
...
* chore: try to fix pg lock timeout
* chore: add logs for insert collab
* chore: add timeout for duplicate
* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint ( #862 )
...
* chore: using copy to improve write speed of batch collab api endpoint
* chore: insert to redis
* chore: fix compile
2024-10-07 08:58:19 +08:00
9c0dffacef
feat: implement import notion zip file api endpoint ( #840 )
...
* chore: implement api endpoint
* chore: worker
* chore: async zip
* chore: test bulk insert
* chore: insert collab
* chore: custom task
* chore: consume un acked message
* chore: fix compile
* chore: add test
* test: update
* chore: save import record
* chore: save import record
* chore: fix ci
* chore: remove unused deps
* chore: update docker file
* chore: build worker images
* chore: use small int
* chore: use small int
* chore: rm protoc deps in runtime
* chore: move collab cache to database crate
* chore: update test
* chore: rm health api endpoint
* chore: clippy
* chore: update ci
* chore: add test
* chore: upgrade collab
* chore: clippy
* chore: update test
* chore: use custom host
* chore: config nginx
* chore: install cert
2024-10-03 22:22:29 +08:00
5b799208a8
chore: remove publish collab related dead code
2024-10-03 11:05:28 +08:00
56f8f395fa
fix: add default serialization to owner email field ( #856 )
2024-10-02 22:22:25 +08:00
11732324b5
feat: support fetching encoded collab in batch from memory ( #837 )
2024-10-02 10:22:40 +08:00
3b320b0619
feat: support protobuf serialization and deserialization for CollabParams ( #834 )
2024-10-02 09:49:55 +08:00
81c9042439
feat: send email to workspace owner when user request access
2024-10-01 11:54:55 +08:00
757d0e5380
fix: incorrect requester avatar url and workspace member count ( #847 )
2024-09-29 11:03:08 +08:00
47a1aae75c
feat: Endpoint for server info ( #835 )
...
* feat: provide endpoint so that client can detect server information
* feat: add server info endpoint
2024-09-29 11:01:22 +08:00
Bartosz Sypytkowski
Zack
Nathan.fooo
Khor Shu Heng
khorshuheng