Commit Graph

728 Commits

Author SHA1 Message Date
khorshuheng a8c3adf166 feat: shift admin user creation responsibility to gotrue service 2024-12-08 15:01:48 +08:00
Bartosz Sypytkowski 66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045)
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
khorshuheng 0bcf1457bb fix: filter non space document from workspace's children 2024-12-06 14:32:58 +08:00
Nathan.fooo ee87bb9bd6
chore: setup tokio console (#1046)
* chore: setup tokio console

* chore: setup tokio console

* chore: clippy

* chore: clippy
2024-12-06 11:33:04 +08:00
Khor Shu Heng f79042fcc5
Merge pull request #1043 from AppFlowy-IO/web-update-fix
fix: web update should update both disk and mem cache
2024-12-06 10:44:52 +08:00
Nathan.fooo afcd1130c3
feat: chat settings (#1044)
* feat: chat settings

* chore: fix sqlx
2024-12-05 23:30:11 +08:00
khorshuheng aa64b7cd6b fix: web update should update both disk and mem cache 2024-12-05 16:51:56 +08:00
Bartosz Sypytkowski 5e7b5f87fa chore: merge branch main into stateless 2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski a827016117
fix: set default collab s3 threshold to 8000 in appflowy cloud (#1038) 2024-12-03 14:59:05 +08:00
Bartosz Sypytkowski 51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski 9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo 6718a7afb1
chore: safe alloc mem for file (#1031) 2024-11-28 22:34:26 +08:00
Zack e31928e77a
Merge pull request #1019 from AppFlowy-IO/feat/get-database-fields
feat: api to get database fields
2024-11-27 19:04:20 -08:00
Khor Shu Heng 5de2ceabe2
Merge pull request #1025 from AppFlowy-IO/fix-primary-field
fix: primary field should be unique for new database page
2024-11-28 10:19:41 +08:00
Nathan.fooo 3e3bf693fd
chore: upload api endpoint for web upload (#1024)
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
2024-11-28 09:09:09 +08:00
Zack Fu Zi Xiang 50586b1ea7
fix: filter database that is in trash 2024-11-27 19:53:47 +08:00
Zack Fu Zi Xiang 7457371208
Merge branch 'main' into feat/get-database-fields 2024-11-27 18:18:34 +08:00
Zack Fu Zi Xiang ed83fba242
feat: add type options 2024-11-27 17:24:14 +08:00
khorshuheng b00f126745 fix: primary field should be unique for new database page 2024-11-27 16:31:29 +08:00
Khor Shu Heng a4b598db5b
fix: remove only parent page when move to trash (#1021) 2024-11-27 13:00:58 +08:00
Zack Fu Zi Xiang b4def2278d
chore: merge with main 2024-11-26 21:18:37 +08:00
khorshuheng 484cd595e0 feat: add support for create database pages via API 2024-11-26 15:58:16 +08:00
Zack Fu Zi Xiang 2da78b351f
feat: api to get database fields 2024-11-26 14:20:10 +08:00
Zack Fu Zi Xiang c4d52859fb
feat: add a polling api for getting database row id updates 2024-11-24 23:24:29 +08:00
Zack Fu Zi Xiang 298698ac0e
feat: format selection 2024-11-24 05:58:31 +08:00
Zack Fu Zi Xiang ddecd8457c
feat: use folder view minimal for database list 2024-11-23 19:24:08 +08:00
Zack Fu Zi Xiang a6bd54f447
feat: simplify listing databases 2024-11-23 12:11:27 +08:00
Zack Fu Zi Xiang 6d4200d1e7
feat: add row details 2024-11-23 02:40:26 +08:00
Zack Fu Zi Xiang f3a2444615
feat: list database row ids 2024-11-22 20:21:31 +08:00
Zack Fu Zi Xiang 687b5d9f6d
Merge branch 'main' into feat/search-database-by-name 2024-11-21 09:17:09 +08:00
Bartosz Sypytkowski d0f9059f3f Merge branch 'main' into stateless 2024-11-20 08:36:28 +01:00
Khor Shu Heng e6dbc95641
feat: api to update space (#1009) 2024-11-20 11:32:29 +08:00
nathan d2a82db300 chore: remove err log 2024-11-20 10:53:35 +08:00
Zack Fu Zi Xiang d7478fb37a
chore: merge with main 2024-11-20 07:51:33 +08:00
Khor Shu Heng 0818cf7565
feat: api for create space (#1006) 2024-11-19 12:54:10 +08:00
Khor Shu Heng 2647d41f3a
feat: allow create page API to accept a view name (#1005) 2024-11-19 11:46:23 +08:00
Bartosz Sypytkowski 3799966f12
chore: store pending collab writes in memory (#1000)
* chore: write immediatelly actually writes immediatelly

* chore: fix clippy errors

* chore: add metrics to new storage queue impl

* chore: set collab batch write capacity to the same as on main branch
2024-11-17 13:25:42 +08:00
Zack 7c6a706bbd
Merge pull request #998 from AppFlowy-IO/feat/allow-underscore-in-url
feat: allow underscore in publish url
2024-11-16 15:59:15 +08:00
Nathan.fooo 655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Bartosz Sypytkowski 06b7ce0a29 chore: post merge fixes 2024-11-16 07:33:18 +01:00
Bartosz Sypytkowski 401cc3ad25 Merge branch 'main' into stateless 2024-11-16 07:22:34 +01:00
Zack Fu Zi Xiang 187cadaa01
feat: allow underscore in publish url 2024-11-15 15:45:56 +08:00
Khor Shu Heng d0c212ff10
refactor: remove enforcer group (#948) 2024-11-15 14:08:12 +08:00
Zack d8075a9368
Merge pull request #994 from AppFlowy-IO/fix/smtp-email-username
feat: separate smtp username from email
2024-11-14 22:00:43 +08:00
Zack Fu Zi Xiang 4b2eb1b1ba
feat: separate smtp username from email 2024-11-14 16:00:15 +08:00
Nathan.fooo 06a6ea2985
chore: retry upload file when get s3 service error (#993)
* chore: retry upload file when get s3 service error

* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Nathan.fooo 91b0c50722
chore: remove logs (#986) 2024-11-13 13:59:23 +08:00
Nathan.fooo 9778843746
chore: disable history service (#985)
* chore: disable history service

* chore: fix build
2024-11-13 10:46:15 +08:00
Zack Fu Zi Xiang 787e6beb0d
feat: add name filtering 2024-11-12 23:48:41 +08:00
Zack 85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack 288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
feat: support last publish name
2024-11-12 08:42:00 +08:00
Nathan.fooo 14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Zack Fu Zi Xiang 8d8c3282ff
Merge branch 'main' into feat/last-publish-name 2024-11-11 17:15:41 +08:00
Zack 2028f4bffd
feat: use batch insert collab for workspace creation (#977)
* feat: use batch insert collab for workspace creation

* fix: separate user creation from initial workspace creation

* feat: separate workspace creation and collab initialization
2024-11-11 16:02:03 +08:00
Zack Fu Zi Xiang b62552f382
fix: fetch published collab sql 2024-11-11 00:24:30 +08:00
Zack Fu Zi Xiang e5623023aa
chore: cargo clippy 2024-11-10 04:46:51 +08:00
Zack Fu Zi Xiang c705d500ce
Merge branch 'main' into feat/last-publish-name 2024-11-10 04:42:21 +08:00
Zack Fu Zi Xiang c436d8733e
chore: add new line to trigger ci 2024-11-08 18:10:41 +08:00
Zack 3e3e78b684
Merge pull request #842 from AppFlowy-IO/feat/list-database
feat: add database listings
2024-11-08 17:36:25 +08:00
Zack Fu Zi Xiang a07b453c0b
feat: support last publish name 2024-11-08 17:29:02 +08:00
khorshuheng f3604edf2e feat: api for restore all pages from trash 2024-11-08 13:52:23 +08:00
Bartosz Sypytkowski eb54947ab7 chore: add config option for redis stream group workers count 2024-11-08 04:39:44 +01:00
khorshuheng d04a0d8871 feat: api for restore page from trash 2024-11-08 10:58:32 +08:00
Bartosz Sypytkowski b9ca480143 chore: add retry limit to which collab snapshot can be made 2024-11-07 13:12:17 +01:00
khorshuheng c8dab0fb2c Merge branch 'main' into stateless 2024-11-07 15:55:26 +08:00
Zack Fu Zi Xiang 2e2ec23430
chore: merge with main 2024-11-07 14:59:51 +08:00
Bartosz Sypytkowski 2d9a024554 chore: use redis stream router 2024-11-07 07:18:20 +01:00
khorshuheng eb67e9617c feat: api for updating page 2024-11-07 10:35:21 +08:00
khorshuheng 7f53343c4b Merge branch 'main' into stateless 2024-11-07 09:24:40 +08:00
khorshuheng 3b37112fc5 feat: api for moving page to trash 2024-11-05 21:46:57 +08:00
Bartosz Sypytkowski ce793fa03e chore: make collab group prune grace period configurable 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 00f5a5bb7e chore: code cleanup 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski e31e541d07
Merge pull request #961 from AppFlowy-IO/remove-realitime-shared-state
chore: remove realtime shared state
2024-11-05 07:32:18 +01:00
Khor Shu Heng 10fb3dc258
Merge pull request #962 from AppFlowy-IO/web-create-collab
feat: api for space and default collab creation
2024-11-05 12:03:40 +08:00
khorshuheng ba95d94c96 feat: api for space and default collab creation 2024-11-05 10:33:48 +08:00
Zack Fu Zi Xiang d69a2dce1b
fix: update publish namespace 2024-11-04 17:22:47 +08:00
Zack Fu Zi Xiang 8d8c895703
feat: support for original and modified namespace 2024-11-04 16:58:33 +08:00
Bartosz Sypytkowski f9397eaaf2 chore: remove realtime shared state 2024-11-04 07:58:16 +01:00
Zack Fu Zi Xiang 09bcbc80ae
feat: update schema for custom namespace 2024-11-04 10:33:22 +08:00
Zack Fu Zi Xiang d6d7e7312e
fix: namespace already taken 2024-11-03 15:08:38 +08:00
Nathan.fooo a5a5a6b59f
fix: import notion file base cases (#957) 2024-11-02 16:50:51 +08:00
Nathan.fooo 7c42cee11a
chore: Upgrade the collab library to fix the issue with importing Notion zip files that contain embedded zip attachments. (#955)
* chore: bump collab that fixs import notion zip file contains zip attachment

* chore: fix compile
2024-11-01 22:26:27 +08:00
Nathan.fooo 860a921ea5
chore: remove inline view id (#945)
* chore: remove inline view id

* test: fix test compile

* chore: logs

* chore: update test
2024-10-30 12:47:15 +08:00
Zack Fu Zi Xiang 855cc58ad8
fix: add invalid character error for publish namespace 2024-10-29 15:49:39 +08:00
Zack Fu Zi Xiang a6af0300ee
feat: add specific error code for invalid publish names 2024-10-29 09:48:24 +08:00
Zack Fu Zi Xiang fdc889f73e
feat: handle duplicated publish names for a workspace 2024-10-28 17:58:14 +08:00
Zack 348a73685e
Merge pull request #940 from AppFlowy-IO/feat/custom-namespace-v2
feat: delete default view for workspace
2024-10-28 15:46:13 +08:00
Zack Fu Zi Xiang ca33dfb304
chore: change to use enforce action instead 2024-10-28 14:36:41 +08:00
Zack Fu Zi Xiang f701abd2a7
feat: delete default view for workspace 2024-10-28 13:32:41 +08:00
Khor Shu Heng 648c977c07
Merge pull request #927 from AppFlowy-IO/remove-access-control-middleware
chore: remove access control middleware
2024-10-28 12:16:38 +08:00
Zack Fu Zi Xiang 0fe7d8def7
chore: merge with main 2024-10-28 09:46:31 +08:00
Nathan.fooo 9629d4cefa
chore: add limit for importing zip file (#938)
* chore: add limitation for import zip file

* chore: support upload big file

* chore: implement client api

* chore: implement client api

* chore: implement client api

* chore: update logs

* chore: check file size

* chore: last process at

* chore: set content type

* chore: fix test

* chore: try test

* chore: temporary disable test
2024-10-28 08:51:34 +08:00
Zack Fu Zi Xiang e29d5d058d
Merge branch 'main' into feat/custom-namespace-change-publish-name 2024-10-27 13:31:45 +08:00
khorshuheng 3c0258b42a feat: add publish info to template home page 2024-10-25 17:30:56 +08:00
khorshuheng a0c68d8c86 chore: remove access control middleware 2024-10-25 13:19:16 +08:00
Zack Fu Zi Xiang b775aa9d4c
feat: patching of publish name 2024-10-24 22:06:52 +08:00
Khor Shu Heng 3247c8c9c6
Merge pull request #925 from AppFlowy-IO/masked-postgres-password
fix: masked postgres password in logs
2024-10-24 17:41:25 +08:00
Nathan.fooo f74757e41a
chore: remove deprecate chat api endpoint and update tests (#922)
* chore: remove deprecate chat api endpoint and update tests

* chore: fix test

* chore: clippy
2024-10-24 16:46:41 +08:00
khorshuheng 3169277830 feat: add section timestamp to get favorite/recent/trash endpoints 2024-10-24 12:22:21 +08:00
khorshuheng 16fb9584f9 fix: masked postgres password in logs 2024-10-24 00:34:31 +08:00