chk
/
AppFlowy-Cloud
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,893 Commits 2 Branches 0 Tags 17 MiB
Commit Graph

266 Commits

Author SHA1 Message Date
nathan 011a5b59c9 chore: rename data to doc_state 2024-12-20 10:22:08 +08:00
nathan 971aa6d3e1 chore: map error 2024-12-20 10:13:16 +08:00
Bartosz Sypytkowski 9d6b272656 chore: merge main into stateless branch 2024-12-19 06:52:20 +01:00
Bartosz Sypytkowski c1d94e3d17 chore: add preliminary check for enabled indexing to batch collab insert 2024-12-19 06:49:32 +01:00
Nathan.fooo e758f18d75
chore: add metadata column to save embeding info (#1086) 2024-12-18 22:48:25 +08:00
Khor Shu Heng 6fa6fa00cb
chore: refactor page view APIs to write to in-memory collab group (#1083) 2024-12-18 22:47:25 +08:00
Nathan.fooo 5f388c7432
chore: add metrics for write embeeding to pg (#1084) 2024-12-18 17:03:38 +08:00
Bartosz Sypytkowski d5252f4273 Merge branch 'main' into stateless 2024-12-17 18:24:17 +01:00
Bartosz Sypytkowski 6c2ce8fc3c chore: fix snapshot s3 read and write 2024-12-17 18:22:20 +01:00
Nathan.fooo abf827f2a6
chore: query multiple collab embedding state (#1081) 
* chore: query multiple collab embedding state

* chore: clippy
 2024-12-17 23:23:43 +08:00
Zack 06dc3b3a00
feat: add option for tls mailer (#1078) 2024-12-17 13:53:32 +08:00
Bartosz Sypytkowski e85e60c0f2 chore: revert from editing collab 2024-12-17 05:43:04 +01:00
Bartosz Sypytkowski d120860312 chore: remove state vector from redis udpates 2024-12-17 04:29:41 +01:00
Bartosz Sypytkowski 73872a2b1d chore: post merge fixes 2024-12-16 08:48:09 +01:00
Bartosz Sypytkowski 1b35326f0a Merge branch 'main' into stateless 2024-12-16 04:47:26 +01:00
Nathan.fooo ec9c38254b
chore: open ai call directly (#1074) 
* chore: use open ai embedding

* chore: update test

* chore: retry

* chore: metrics

* chore: clippy

* chore: env

* chore: delete test
 2024-12-15 23:29:46 +08:00
Nathan.fooo 2ab1e94b99
chore: create embed in background (#1071) 
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
 2024-12-15 12:29:51 +08:00
Bartosz Sypytkowski ed07104aeb chore: remove from editing collab param in get encode collab method 2024-12-14 09:42:15 +01:00
Bartosz Sypytkowski dfe780d30c chore: fix linter errors 2024-12-14 09:22:42 +01:00
Nathan.fooo a549364fc9
chore: support insert space between delta (#1069) 2024-12-14 10:38:39 +08:00
Bartosz Sypytkowski 41e9302ff9 Merge branch 'main' into stateless 2024-12-12 16:00:45 +01:00
Nathan.fooo af38efe6d9
feat: sync document through http request (#1064) 
* chore: query embedding

* chore: create embeddings

* chore: apply update to editing collab

* refactor: web-update

* chore: calculate missing update the sv is not none

* chore: add test

* chore: fix audit

* chore: commit sqlx

* chore: fix client api

* test: add

* chore: clippy

* chore: fix collab drop when save
 2024-12-12 14:53:07 +08:00
Bartosz Sypytkowski cdf98d1a83
chore: add logging for reindexing docs after restart (#1056) 2024-12-11 17:17:29 +08:00
Zack 254bc23a6e
feat: insert database row into selected database (#1029) 
* feat: insert database row into selected database

* feat: inserting database row

* feat: add impl for cell

* feat: insert row selection and mulitselection

* feat: support datetime field type

* fix: other fields like rich text

* feat: add database field server impl

* feat: add client api and tests

* feat: use to json value impl from collab

* feat: use add database cell impl from collab

* feat: update to latest collab

* chore: upgrade collab and fix tests

* chore: review issues

* fix: code review feedback

* feat: filter only allow supported field types

* feat: support more field types

* feat: support created at and last modified

* feat: add timestamp cell for created at and modified at fields

* chore: linting and formatting

* fix: add created at and last modified

* fix: ci add service dependency of appflowy cloud on admin frontend

* chore: trigger ci

* feat: add logging for admin frontend client signin

* fix: server logs if error

* fix: create admin confirmation without email

* fix: ci add service dependency of appflowy cloud on admin frontend

* fix: server logs if error

* chore: update collab
 2024-12-11 15:47:29 +08:00
khorshuheng 719b95b94a chore: update validator crate 2024-12-11 12:33:46 +08:00
Bartosz Sypytkowski c4514ca5bf chore: add explanation 2024-12-10 10:12:33 +01:00
Bartosz Sypytkowski 9971c23749 fix: update redis cache when inserting collabs in batches 2024-12-10 10:07:54 +01:00
Bartosz Sypytkowski 813179fdb0
chore: Remove async awaits from RealtimeServerActor (#1059) 
* chore: reduce number of async await methods in connection manager

* chore: remove async handlers from rt actor
 2024-12-10 15:20:28 +08:00
Khor Shu Heng 29cb70a362
fix: synchronization issue due to incorrect collab origin (#1054) 2024-12-09 14:19:00 +08:00
Nathan.fooo a598aed5ec
chore: remove empty map when query is empty (#1050) 2024-12-07 10:20:53 +08:00
Bartosz Sypytkowski 66deaf3fa3
chore: move collab cache for appflowy collaborate service and add metrics (#1045) 
* chore: move collab cache for appflowy collaborate service and add metrics

* chore: add histogram for measuring time spent in postgres transactions

* chore: delete blobs in chunks

* chore: bring back redis cache filling by import worker

* chore: cargo fmt

* chore: make import workspace update existing collabs

* chore: bulk insert collab deduplicate records
 2024-12-06 19:55:51 +08:00
Nathan.fooo ee87bb9bd6
chore: setup tokio console (#1046) 
* chore: setup tokio console

* chore: setup tokio console

* chore: clippy

* chore: clippy
 2024-12-06 11:33:04 +08:00
Khor Shu Heng f79042fcc5
Merge pull request #1043 from AppFlowy-IO/web-update-fix 
fix: web update should update both disk and mem cache
 2024-12-06 10:44:52 +08:00
Nathan.fooo afcd1130c3
feat: chat settings (#1044) 
* feat: chat settings

* chore: fix sqlx
 2024-12-05 23:30:11 +08:00
khorshuheng aa64b7cd6b fix: web update should update both disk and mem cache 2024-12-05 16:51:56 +08:00
Bartosz Sypytkowski b2f8a95ec4 chore: setup new collab in the db 2024-12-05 06:29:19 +01:00
Bartosz Sypytkowski 5e7b5f87fa chore: merge branch main into stateless 2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski 51bf9a85c7
chore: make collab storage switch between s3 and postgres configurable (#1035) 2024-12-03 14:09:09 +08:00
Bartosz Sypytkowski 9ff6f1c744
S3 collab cache (#1028) 
* chore: collab cache for S3

* chore: adjust disk cache api to accomodate s3

* chore: move postgres dependent ops to disk cache

* chore: replace blob inserts from pg to s3

* chore: delete blob and collab exist now use s3

* chore: fix clippy erorrs

* chore: post rebase fixes

* chore: fix clippy warnings

* chore: fix imports

* chore: make snapshots work over S3

* chore: remove dead code

* chore: use compressed snapshots

* chore: add zstd compression

* chore: introduce collab size threshold to keep smaller collabs in postgres

* chore: remove collabs from S3 if they were put to postgres

* chore: update tests
 2024-12-03 13:08:55 +08:00
Nathan.fooo 3e3bf693fd
chore: upload api endpoint for web upload (#1024) 
* chore: upload api endpoint for web upload

* chore: use rust 1.78

* fix: test
 2024-11-28 09:09:09 +08:00
Bartosz Sypytkowski 4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab (#1022) 
* chore: reduce number of SQL statements executed when inserting new collab

* chore: add workspace id check

* chore: fix previous query

* chore: upsert collabs and embddings as stored procedures

* chore: fix clippy errors

* chore: fix stored procedure to compare workspaces correctly
 2024-11-27 13:00:00 +08:00
Nathan.fooo 0ec12c5f2f
chore: add file size (#1015) 2024-11-22 16:31:50 +08:00
Bartosz Sypytkowski d6317813d7 chore: allow dead code 2024-11-20 09:06:00 +01:00
Bartosz Sypytkowski b91a5fac8e chore: post merge fixes 2024-11-20 08:56:16 +01:00
Bartosz Sypytkowski d0f9059f3f Merge branch 'main' into stateless 2024-11-20 08:36:28 +01:00
Nathan.fooo 1e18180e9d
chore: set max import zip file size (#1011) 
* chore: set max import zip file size

* chore: fix test
 2024-11-20 14:07:36 +08:00
Nathan.fooo fd98351473
chore: adjust redis env (#1003) 2024-11-17 14:26:59 +08:00
Bartosz Sypytkowski 3799966f12
chore: store pending collab writes in memory (#1000) 
* chore: write immediatelly actually writes immediatelly

* chore: fix clippy errors

* chore: add metrics to new storage queue impl

* chore: set collab batch write capacity to the same as on main branch
 2024-11-17 13:25:42 +08:00
Nathan.fooo d798c81ba4
chore: support split by text len (#1002) 
* chore: support split by text len

* chore: update docs

* chore: update tests
 2024-11-17 12:45:20 +08:00
Nathan.fooo dcbc84dacc
chore: recreate group if it isn't exist (#1001) 2024-11-17 12:14:50 +08:00