Commit Graph

52 Commits

Author SHA1 Message Date
Nathan.fooo b7e08687b4
chore: use curl for gotrue health check when using docker-compose-ci.yml (#1189) 2025-01-22 21:40:47 +08:00
Nathan.fooo 56f4c0698c
chore: update subscription entity (#1162) 2025-01-14 17:35:27 +08:00
Nathan.fooo c5cdb06b77
chore: notify user file size (#1161) 2025-01-14 12:50:52 +08:00
Nathan.fooo 5a2f54bfdd
chore: delete imported task stream value (#1160)
* chore: delete import task

* chore: delete requeue task
2025-01-14 12:01:52 +08:00
Nathan.fooo 5195dae3a5
feat: Chat file metadata (#1133)
* chore: chat question metadata

* chore: update

* chore: update env

* chore: update env
2025-01-07 12:46:55 +08:00
Nathan.fooo 3ee52ad8d0
chore: fix private open api key in config (#1112)
* chore: fix private open api key in config

* chore: fmt
2025-01-02 13:03:01 +08:00
Nathan.fooo b886db1d5c
chore: fix clippy warnings (#1103) 2024-12-29 12:47:34 +08:00
khorshuheng 824d60920d Merge branch 'main' into stateless 2024-12-26 11:55:52 +08:00
Nathan.fooo c80491267b
chore: update metrics and num threads (#1102) 2024-12-26 11:55:54 +08:00
nathan 1a5c1714db Merge branch 'main' into stateless 2024-12-24 14:59:04 +08:00
Nathan.fooo 1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn (#1099)
* chore: batch index

* chore: format log

* chore: index workspace

* chore: fix stack overflow

* chore: background index

* chore: clippy

* chore: filter tasks

* chore: clippy

* chore: add metrics

* chore: fix test
2024-12-24 14:30:17 +08:00
Zack Fu Zi Xiang cafff8098b
chore: update dockerfile rust version 2024-12-20 17:10:42 +08:00
Zack Fu Zi Xiang 6f98894c6f
chore: version update to resolve sec issue 2024-12-20 09:37:25 +08:00
Nathan.fooo 5f388c7432
chore: add metrics for write embeeding to pg (#1084) 2024-12-18 17:03:38 +08:00
Zack 06dc3b3a00
feat: add option for tls mailer (#1078) 2024-12-17 13:53:32 +08:00
Nathan.fooo ec9c38254b
chore: open ai call directly (#1074)
* chore: use open ai embedding

* chore: update test

* chore: retry

* chore: metrics

* chore: clippy

* chore: env

* chore: delete test
2024-12-15 23:29:46 +08:00
Nathan.fooo af38efe6d9
feat: sync document through http request (#1064)
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
khorshuheng 719b95b94a chore: update validator crate 2024-12-11 12:33:46 +08:00
Khor Shu Heng 29cb70a362
fix: synchronization issue due to incorrect collab origin (#1054) 2024-12-09 14:19:00 +08:00
Bartosz Sypytkowski 66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045)
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
2024-12-06 19:55:51 +08:00
Nathan.fooo afcd1130c3
feat: chat settings (#1044)
* feat: chat settings

* chore: fix sqlx
2024-12-05 23:30:11 +08:00
Bartosz Sypytkowski 9ff6f1c744
S3 collab cache (#1028)
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
2024-12-03 13:08:55 +08:00
Nathan.fooo 3e3bf693fd
chore: upload api endpoint for web upload (#1024)
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
2024-11-28 09:09:09 +08:00
Nathan.fooo 0ec12c5f2f
chore: add file size (#1015) 2024-11-22 16:31:50 +08:00
Nathan.fooo 1e18180e9d
chore: set max import zip file size (#1011)
* chore: set max import zip file size

* chore: fix test
2024-11-20 14:07:36 +08:00
Nathan.fooo d798c81ba4
chore: support split by text len (#1002)
* chore: support split by text len

* chore: update docs

* chore: update tests
2024-11-17 12:45:20 +08:00
Nathan.fooo dcbc84dacc
chore: recreate group if it isn't exist (#1001) 2024-11-17 12:14:50 +08:00
Zack d8075a9368
Merge pull request #994 from AppFlowy-IO/fix/smtp-email-username
feat: separate smtp username from email
2024-11-14 22:00:43 +08:00
Zack Fu Zi Xiang 4b2eb1b1ba
feat: separate smtp username from email 2024-11-14 16:00:15 +08:00
Nathan.fooo 06a6ea2985
chore: retry upload file when get s3 service error (#993)
* chore: retry upload file when get s3 service error

* chore: ingore upload payload error
2024-11-14 14:39:36 +08:00
Nathan.fooo 50d519c4ea
fix: upload file zip file expire (#987) 2024-11-13 14:57:27 +08:00
Nathan.fooo 14adf250a8
chore: update ai api endpoint & rename structs (#953)
* chore: revmap loader type

* chore: revamp context

* chore: fix test

* chore: remove unused handler

* chore: create new chat api endpoint

* chore: add docs

* chore: clippy

* chore: fix test
2024-11-11 20:10:46 +08:00
Nathan.fooo a5a5a6b59f
fix: import notion file base cases (#957) 2024-11-02 16:50:51 +08:00
Nathan.fooo 9629d4cefa
chore: add limit for importing zip file (#938)
* chore: add limitation for import zip file

* chore: support upload big file

* chore: implement client api

* chore: implement client api

* chore: implement client api

* chore: update logs

* chore: check file size

* chore: last process at

* chore: set content type

* chore: fix test

* chore: try test

* chore: temporary disable test
2024-10-28 08:51:34 +08:00
Nathan.fooo 246cbd3ec4
chore: update nginx config for import (#935) 2024-10-25 16:47:29 +08:00
Nathan.fooo e738508d79
fix: Support notion database row document (#929)
* chore: fix import notion database
2024-10-24 19:04:06 +08:00
khorshuheng 16fb9584f9 fix: masked postgres password in logs 2024-10-24 00:34:31 +08:00
Nathan.fooo 57c44818e2
feat: Import metrics (#911)
* chore: implement metrics for import

* chore: add metrics
2024-10-20 11:05:22 +08:00
Nathan.fooo b1f37dbbf6
chore: fix petential unzip issues (#910) 2024-10-20 10:48:09 +08:00
Nathan.fooo 773f17e524
fix: import zip without root dir (#898)
* fix: import notion zip file that do not have root dir

* fix: compile
2024-10-18 00:51:53 +08:00
Nathan.fooo 3623d9f296
chore: check file md5 before import (#895) 2024-10-17 17:18:07 +08:00
Nathan.fooo 9942e68089
chore: imported workspace should not become the latest visting workspace (#890)
* chore: imported workspace should not become the latest visting workspace

* chore: sqlx files

* chore: update test

* chore: fmt
2024-10-16 21:02:05 +08:00
Nathan.fooo d3e4a6870d
chore: template (#889)
* chore: template

* fix: auto del file lifetime

* chore: delete file if fail to write to disk

* fix: modified html

* chore: set content type

* chore: md5 content

* chore: clippy

* fix: image loaded failed

* fix: build

* chore: bump collab

---------

Co-authored-by: Kilu <lu@appflowy.io>
2024-10-16 17:39:24 +08:00
Nathan.fooo d89cbe1c8c
chore: support streaming unzip using env (#888) 2024-10-16 14:02:03 +08:00
Nathan.fooo 3c02fa253f
chore: retry import (#887)
* chore: retry import

* chore: delete temp files

* chore: bump collab
2024-10-16 12:55:53 +08:00
Nathan.fooo 2b02a8d12b
chore: bump collab (#884) 2024-10-15 15:56:14 +08:00
Nathan.fooo 95e8b30f11
chore: bump collab that use yrs 0.21.2 (#872)
* chore: bump collab that use yrs 0.21.2

* chore: fmt
2024-10-14 00:58:32 +08:00
Nathan.fooo bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Nathan.fooo 14cfaa0bbd
chore: insert metadata after import notion zip file (#871)
* chore: insert metadata after import notion zip file

* chore: update logs
2024-10-10 22:32:02 +08:00
Nathan.fooo 98347b81ea
fix: import notion zip file as workspace (#868)
* chore: insert content length in header

* chore: custom header

* chore: workspace name

* chore: file name

* chore: handle file name that is not utf8 encode

* chore: clippy

* fix: end of file when unzip file

* chore: docs
2024-10-09 21:27:24 +08:00