Commit Graph

270 Commits

Author SHA1 Message Date
Bartosz Sypytkowski 5e7b5f87fa chore: merge branch main into stateless 2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski 51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski 9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo 3e3bf693fd
chore: upload api endpoint for web upload (#1024)
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
2024-11-28 09:09:09 +08:00
Bartosz Sypytkowski 4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab (#1022)
* chore: reduce number of SQL statements executed when inserting new collab

* chore: add workspace id check

* chore: fix previous query

* chore: upsert collabs and embddings as stored procedures

* chore: fix clippy errors

* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
khorshuheng 484cd595e0 feat: add support for create database pages via API 2024-11-26 15:58:16 +08:00
Zack Fu Zi Xiang c4d52859fb
feat: add a polling api for getting database row id updates 2024-11-24 23:24:29 +08:00
Bartosz Sypytkowski 1932607ca9 Merge branch 'main' into stateless 2024-11-18 05:43:16 +01:00
Nathan.fooo 655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
Bartosz Sypytkowski 401cc3ad25 Merge branch 'main' into stateless 2024-11-16 07:22:34 +01:00
Nathan.fooo 06a6ea2985
chore: retry upload file when get s3 service error (#993)
* chore: retry upload file when get s3 service error

* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Bartosz Sypytkowski f6fef9918b
chore: split document content into multiple embeddings (#990)
* chore: split document content into multiple embeddings

* chore: fallback to uuid v4 generation due to unmaintained transient dependency

* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Zack Fu Zi Xiang f3cfd87cb8
fix: patch publish name 2024-11-13 17:21:49 +08:00
Nathan.fooo 91b0c50722
chore: remove logs (#986) 2024-11-13 13:59:23 +08:00
Zack 85452ddfab
feat: add role for user when querying workspaces (#983) 2024-11-12 21:12:58 +08:00
Zack 288fd59d3b
Merge pull request #975 from AppFlowy-IO/feat/last-publish-name
feat: support last publish name
2024-11-12 08:42:00 +08:00
Nathan.fooo 14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Zack Fu Zi Xiang ed4c14d53a
fix: also specify workspace id when deleting collab 2024-11-11 17:31:44 +08:00
Zack Fu Zi Xiang 8d8c3282ff
Merge branch 'main' into feat/last-publish-name 2024-11-11 17:15:41 +08:00
Zack 2028f4bffd
feat: use batch insert collab for workspace creation (#977)
* feat: use batch insert collab for workspace creation

* fix: separate user creation from initial workspace creation

* feat: separate workspace creation and collab initialization
2024-11-11 16:02:03 +08:00
Zack Fu Zi Xiang b62552f382
fix: fetch published collab sql 2024-11-11 00:24:30 +08:00
Zack Fu Zi Xiang e5623023aa
chore: cargo clippy 2024-11-10 04:46:51 +08:00
Zack Fu Zi Xiang a07b453c0b
feat: support last publish name 2024-11-08 17:29:02 +08:00
Bartosz Sypytkowski 3e612e2db6 chore: create method for receiving the most recent snapshot 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski e31e541d07
Merge pull request #961 from AppFlowy-IO/remove-realitime-shared-state
chore: remove realtime shared state
2024-11-05 07:32:18 +01:00
Zack Fu Zi Xiang d69a2dce1b
fix: update publish namespace 2024-11-04 17:22:47 +08:00
Zack Fu Zi Xiang 8d8c895703
feat: support for original and modified namespace 2024-11-04 16:58:33 +08:00
Bartosz Sypytkowski f9397eaaf2 chore: remove realtime shared state 2024-11-04 07:58:16 +01:00
Zack Fu Zi Xiang d6d7e7312e
fix: namespace already taken 2024-11-03 15:08:38 +08:00
Zack 56c55fb6a9
feat: handle duplicated publish names for a workspace (#944)
* feat: handle duplicated publish names for a workspace

* chore: cargo sqlx
2024-10-29 09:39:41 +08:00
Zack Fu Zi Xiang f701abd2a7
feat: delete default view for workspace 2024-10-28 13:32:41 +08:00
Zack Fu Zi Xiang 0fe7d8def7
chore: merge with main 2024-10-28 09:46:31 +08:00
Nathan.fooo 9629d4cefa
chore: add limit for importing zip file (#938)
* chore: add limitation for import zip file

* chore: support upload big file

* chore: implement client api

* chore: implement client api

* chore: implement client api

* chore: update logs

* chore: check file size

* chore: last process at

* chore: set content type

* chore: fix test

* chore: try test

* chore: temporary disable test
2024-10-28 08:51:34 +08:00
Zack Fu Zi Xiang dc44d0ae4e
fix: remove assert that might cause panic 2024-10-27 13:36:17 +08:00
Zack Fu Zi Xiang b775aa9d4c
feat: patching of publish name 2024-10-24 22:06:52 +08:00
khorshuheng 23e1da2910 feat: add publish info to list templates 2024-10-23 17:26:32 +08:00
Khor Shu Heng 9eb1c36c92
chore: access control interface to return error instead of boolean (#914) 2024-10-21 20:20:14 +08:00
Khor Shu Heng ba8a670101
fix: workspace invitation failure due to email case sensitivity (#904)
* fix: integration test failure due to password mismatch

* fix: workspace invitation failure due to email case sensitivity
2024-10-19 10:10:35 +08:00
Zack 60c589bd9c
feat: CRUD interface for custom namespace (#882)
* feat: listing all published_info

* fix: add sqlx files

* feat: add additional fields for publish info

* feat: get and set default publish info

* chore: cargo sqlx prepare

* fix: cargo clippy

* fix: test case exe order

* chore: cargo sqlx

* feat: get info and meta from workspace namespace

* chore: cargo sqlx

* feat: add original doc info for published view

* chore: log all publish endpoints

* fix: default values for publish info extra fields

* feat: move namespace restriction to gateway
2024-10-19 10:09:54 +08:00
Nathan.fooo 9942e68089
chore: imported workspace should not become the latest visting workspace (#890)
* chore: imported workspace should not become the latest visting workspace

* chore: sqlx files

* chore: update test

* chore: fmt
2024-10-16 21:02:05 +08:00
Khor Shu Heng ec124bcb46
Merge pull request #885 from AppFlowy-IO/additional-ac-config
feat: additional access control config
2024-10-16 17:00:54 +08:00
khorshuheng 383629ab1c chore: simplify not enough permission error 2024-10-16 15:10:31 +08:00
khorshuheng 34a7fd3633 feat: additional access control config 2024-10-16 15:10:01 +08:00
Nathan.fooo 3c02fa253f
chore: retry import (#887)
* chore: retry import

* chore: delete temp files

* chore: bump collab
2024-10-16 12:55:53 +08:00
Khor Shu Heng 1c51656865
chore: update casbin to version 2.5.0 (#878)
Co-authored-by: Nathan.fooo <86001920+appflowy@users.noreply.github.com>
2024-10-15 15:56:29 +08:00
Nathan.fooo 1616ceaf4f
chore: use workspace deps (#880) 2024-10-14 16:02:22 +08:00
Nathan.fooo bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Nathan.fooo 14cfaa0bbd
chore: insert metadata after import notion zip file (#871)
* chore: insert metadata after import notion zip file

* chore: update logs
2024-10-10 22:32:02 +08:00
Nathan.fooo 33e63fae5c
chore: try to fix pg lock timeout (#864)
* chore: try to fix pg lock timeout

* chore: add logs for insert collab

* chore: add timeout for duplicate

* chore: timeout for pending write
2024-10-07 16:49:50 +08:00
Nathan.fooo 38ff1874e4
chore: using copy to improve write speed of batch collab api endpoint (#862)
* chore: using copy to improve write speed of batch collab api endpoint

* chore: insert to redis

* chore: fix compile
2024-10-07 08:58:19 +08:00