Commit Graph

188 Commits

Author SHA1 Message Date
Bartosz Sypytkowski cc6b58f73d chore: add metrics to redis collab stream 2025-01-03 08:44:36 +01:00
Nathan.fooo 3ee52ad8d0
chore: fix private open api key in config (#1112)
* chore: fix private open api key in config

* chore: fmt
2025-01-02 13:03:01 +08:00
nathan 1a5c1714db Merge branch 'main' into stateless 2024-12-24 14:59:04 +08:00
Nathan.fooo 1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn (#1099)
* chore: batch index

* chore: format log

* chore: index workspace

* chore: fix stack overflow

* chore: background index

* chore: clippy

* chore: filter tasks

* chore: clippy

* chore: add metrics

* chore: fix test
2024-12-24 14:30:17 +08:00
Bartosz Sypytkowski d5252f4273 Merge branch 'main' into stateless 2024-12-17 18:24:17 +01:00
Zack 06dc3b3a00
feat: add option for tls mailer (#1078) 2024-12-17 13:53:32 +08:00
Bartosz Sypytkowski 1b35326f0a Merge branch 'main' into stateless 2024-12-16 04:47:26 +01:00
Nathan.fooo ec9c38254b
chore: open ai call directly (#1074)
* chore: use open ai embedding

* chore: update test

* chore: retry

* chore: metrics

* chore: clippy

* chore: env

* chore: delete test
2024-12-15 23:29:46 +08:00
Nathan.fooo 2ab1e94b99
chore: create embed in background (#1071)
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
2024-12-15 12:29:51 +08:00
Bartosz Sypytkowski 41e9302ff9 Merge branch 'main' into stateless 2024-12-12 16:00:45 +01:00
Zack 7cd7ea1f9e
feat: invite to workspace email wait (#1057)
* feat: invite to workspace email wait

* feat: add option to skip email

* fix: docker compose ci mailer settings
2024-12-11 09:43:27 +08:00
khorshuheng a8c3adf166 feat: shift admin user creation responsibility to gotrue service 2024-12-08 15:01:48 +08:00
Bartosz Sypytkowski 66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045)
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Bartosz Sypytkowski 5e7b5f87fa chore: merge branch main into stateless 2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski 51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski 9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Bartosz Sypytkowski 1932607ca9 Merge branch 'main' into stateless 2024-11-18 05:43:16 +01:00
Bartosz Sypytkowski 3799966f12
chore: store pending collab writes in memory (#1000)
* chore: write immediatelly actually writes immediatelly

* chore: fix clippy errors

* chore: add metrics to new storage queue impl

* chore: set collab batch write capacity to the same as on main branch
2024-11-17 13:25:42 +08:00
Bartosz Sypytkowski 06b7ce0a29 chore: post merge fixes 2024-11-16 07:33:18 +01:00
Bartosz Sypytkowski 401cc3ad25 Merge branch 'main' into stateless 2024-11-16 07:22:34 +01:00
Zack Fu Zi Xiang 4b2eb1b1ba
feat: separate smtp username from email 2024-11-14 16:00:15 +08:00
Nathan.fooo 9778843746
chore: disable history service (#985)
* chore: disable history service

* chore: fix build
2024-11-13 10:46:15 +08:00
Bartosz Sypytkowski eb54947ab7 chore: add config option for redis stream group workers count 2024-11-08 04:39:44 +01:00
Bartosz Sypytkowski b9ca480143 chore: add retry limit to which collab snapshot can be made 2024-11-07 13:12:17 +01:00
Bartosz Sypytkowski 2d9a024554 chore: use redis stream router 2024-11-07 07:18:20 +01:00
Bartosz Sypytkowski ce793fa03e chore: make collab group prune grace period configurable 2024-11-05 07:48:14 +01:00
Bartosz Sypytkowski 00f5a5bb7e chore: code cleanup 2024-11-05 07:47:17 +01:00
Bartosz Sypytkowski f9397eaaf2 chore: remove realtime shared state 2024-11-04 07:58:16 +01:00
khorshuheng a0c68d8c86 chore: remove access control middleware 2024-10-25 13:19:16 +08:00
khorshuheng 34a7fd3633 feat: additional access control config 2024-10-16 15:10:01 +08:00
Zack Fu Zi Xiang cce8616117
fix: admin initialization 2024-10-14 12:05:51 +08:00
Nathan.fooo bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Khor Shu Heng 8c14612f98
feat: refactor access control to enable swapping implementation (#859) 2024-10-10 13:04:47 +08:00
Nathan.fooo 9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
Khor Shu Heng 03fdcf4621
feat: option to skip s3 bucket creation (#852) 2024-10-02 09:54:46 +08:00
Khor Shu Heng 47a1aae75c
feat: Endpoint for server info (#835)
* feat: provide endpoint so that client can detect server information

* feat: add server info endpoint
2024-09-29 11:01:22 +08:00
khorshuheng 813fa29253 feat: add endpoints to allow workspace owner to approve web page view request 2024-09-26 14:59:33 +08:00
Khor Shu Heng abae8d2d1b
feat: Support s3 as published collab storage (#798)
* chore: remove unused published collab methods

* feat: support s3 as published collab storage
2024-09-11 20:52:33 +08:00
Zack Fu Zi Xiang 25cec9982f
chore: revoke for apple user 2024-09-02 17:25:21 +08:00
Bartosz Sypytkowski 2af1999375
chore: added locks with timeouts (#765)
* chore: added locks with timeouts

* chore: roll back collab locks in client api
2024-08-29 16:13:27 +08:00
Zack Fu Zi Xiang e5e89be371
fix: import 2024-08-29 10:16:19 +08:00
Zack Fu Zi Xiang de8387b3af
fix: admin sign in instead of only sign up 2024-08-29 10:08:14 +08:00
Khor Shu Heng 52f33e4d85
feat: endpoint for avatar upload (#736) 2024-08-23 16:36:09 +08:00
khorshuheng f6e78a941f feat: api endpoint for template categories and creators 2024-08-12 13:43:14 +08:00
Bartosz Sypytkowski b1ebbecc5f chore: moving appflowy indexer into appflowy cloud 2024-06-28 05:39:53 +02:00
Khor Shu Heng c7d474c9cf
chore: allow collab persistence and edit state behaviour to be configurable (#637) 2024-06-23 23:19:54 +08:00
Nathan.fooo 6bd75ccfbb
fix: s3 config when deploy without minio (#633)
* chore: fix s3 config when deploy without minio

* chore: remove print
2024-06-19 15:55:22 +08:00
Nathan.fooo 30f87457f3
feat: support uploading file with multiple part (#625)
* refactor: replace crate

* chore: remove s3-rust crate

* chore: test multiple upload

* chore: client api

* chore: client api

* chore: v1 version upload,download

* chore: fix test

* chore: fix test

* chore: remove workspace test

* chore: fix wasm build

* chore: update path

* chore: update path

* chore: rename

* chore: expose file entity

* chore: introduce client-api-entity

* chore: fix build

* chore: new url

* chore: fix test

* chore: merge main

* chore: fix clippy
2024-06-19 13:06:58 +08:00
Bartosz Sypytkowski 0e50650aa8 chore: use appflowy ai client for embeddings in search api 2024-06-18 10:51:11 +02:00
Bartosz Sypytkowski 3721d209f2 chore: normalize URL paths in appflowy collab server 2024-06-12 06:21:56 +02:00