nathan
1a5c1714db
Merge branch 'main' into stateless
2024-12-24 14:59:04 +08:00
Nathan.fooo
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn ( #1099 )
...
* chore: batch index
* chore: format log
* chore: index workspace
* chore: fix stack overflow
* chore: background index
* chore: clippy
* chore: filter tasks
* chore: clippy
* chore: add metrics
* chore: fix test
2024-12-24 14:30:17 +08:00
Bartosz Sypytkowski
1b35326f0a
Merge branch 'main' into stateless
2024-12-16 04:47:26 +01:00
Nathan.fooo
ec9c38254b
chore: open ai call directly ( #1074 )
...
* chore: use open ai embedding
* chore: update test
* chore: retry
* chore: metrics
* chore: clippy
* chore: env
* chore: delete test
2024-12-15 23:29:46 +08:00
Bartosz Sypytkowski
41e9302ff9
Merge branch 'main' into stateless
2024-12-12 16:00:45 +01:00
Nathan.fooo
af38efe6d9
feat: sync document through http request ( #1064 )
...
* chore: query embedding
* chore: create embeddings
* chore: apply update to editing collab
* refactor: web-update
* chore: calculate missing update the sv is not none
* chore: add test
* chore: fix audit
* chore: commit sqlx
* chore: fix client api
* test: add
* chore: clippy
* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
khorshuheng
719b95b94a
chore: update validator crate
2024-12-11 12:33:46 +08:00
Bartosz Sypytkowski
5e7b5f87fa
chore: merge branch main into stateless
2024-12-03 09:10:01 +01:00
Bartosz Sypytkowski
9ff6f1c744
S3 collab cache ( #1028 )
...
* chore: collab cache for S3
* chore: adjust disk cache api to accomodate s3
* chore: move postgres dependent ops to disk cache
* chore: replace blob inserts from pg to s3
* chore: delete blob and collab exist now use s3
* chore: fix clippy erorrs
* chore: post rebase fixes
* chore: fix clippy warnings
* chore: fix imports
* chore: make snapshots work over S3
* chore: remove dead code
* chore: use compressed snapshots
* chore: add zstd compression
* chore: introduce collab size threshold to keep smaller collabs in postgres
* chore: remove collabs from S3 if they were put to postgres
* chore: update tests
2024-12-03 13:08:55 +08:00
Bartosz Sypytkowski
1932607ca9
Merge branch 'main' into stateless
2024-11-18 05:43:16 +01:00
Nathan.fooo
d798c81ba4
chore: support split by text len ( #1002 )
...
* chore: support split by text len
* chore: update docs
* chore: update tests
2024-11-17 12:45:20 +08:00
Nathan.fooo
655f13bc27
chore: search and chat ( #999 )
...
* chore: add test for search and chat
* chore: update test
* chore: update test
* chore: update ci
* chore: fix security audio
* chore: multiple core docker build
* chore: multiple core docker build
* chore: update ci
* chore: update model setting
* chore: test ci
* chore: use tiktoken to calcualte token length
* chore: remove env
* chore: use spawn_blocking with condition
* chore: docs
* chore: clippy
* chore: clippy
* chore: docker logs
* chore: pass message id
* chore: clippy
2024-11-16 14:52:12 +08:00
Bartosz Sypytkowski
401cc3ad25
Merge branch 'main' into stateless
2024-11-16 07:22:34 +01:00
Nathan.fooo
97f9ff3dd8
fix: byte index 8000 is not a char boundary ( #995 )
...
* chore: fix split text boundary error and add related tests
* chore: reduce clone
2024-11-15 13:38:08 +08:00
Bartosz Sypytkowski
d3d3378b86
chore: draft of stateless collab group
2024-11-05 07:47:17 +01:00
Nathan.fooo
1616ceaf4f
chore: use workspace deps ( #880 )
2024-10-14 16:02:22 +08:00
Khor Shu Heng
8c14612f98
feat: refactor access control to enable swapping implementation ( #859 )
2024-10-10 13:04:47 +08:00
Khor Shu Heng
11732324b5
feat: support fetching encoded collab in batch from memory ( #837 )
2024-10-02 10:22:40 +08:00
Nathan.fooo
ab14568bbf
chore: use env to use control multiple thread runtime or not ( #760 )
2024-08-28 00:13:24 +08:00
Bartosz Sypytkowski
6c0f4985c3
Merge pull request #645 from AppFlowy-IO/merge-indexer-collaborate
...
Merge indexer collaborate
2024-06-28 07:48:32 +02:00
Khor Shu Heng
7dfb52f80b
feat: add telemetry to appflowy collaborate service ( #662 )
2024-06-28 13:44:59 +08:00
Bartosz Sypytkowski
cce52a5185
chore: do not throw errors on invalid document schema during indexing
2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski
b1ebbecc5f
chore: moving appflowy indexer into appflowy cloud
2024-06-28 05:39:53 +02:00
Khor Shu Heng
bdae165849
feat: add post realtime message stream handler to independent collab ws ( #647 )
2024-06-25 13:30:05 +08:00
Khor Shu Heng
6e3f666ce4
feat: independent collab websocket server ( #640 )
2024-06-24 13:59:51 +08:00
Khor Shu Heng
67d9fad7d7
chore: migrate collab storage to appflowy-collaborate ( #566 )
...
* chore: migrate collab storage to appflowy-collaborate
* fix: clippy error
* chore: remove handler
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-21 10:06:26 +08:00
Nathan.fooo
2736fa60a7
chore: integrate redis stream ( #559 )
...
* chore: integrate redis stream
* chore: make CollabUpdateStreaming::send_update synchronous
---------
Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
2024-05-18 08:28:57 +08:00
Khor Shu Heng
fbdcbd6e08
chore: migrate collab actors to appflowy-collaborate ( #556 )
2024-05-17 12:22:43 +08:00
Khor Shu Heng
c79267d42a
feat: migrate collab access control to collaboration service ( #548 )
...
* feat: migrate collab access control to collaborate service
* feat: migrate workspace access control to separate crate
2024-05-15 15:24:07 +08:00
Khor Shu Heng
d9d874ab8a
feat: migrate collab cache to collaborate service ( #524 )
...
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-09 23:12:13 +08:00
Bartosz Sypytkowski
47e6f1e8b1
Update Yrs and AppFlowy-Collab ( #518 )
...
* chore: updated collab dependencies to v0.2
* chore: update collab to v0.2 and yrs to v0.18
* chore: pinned collab to specific revision
* chore: fix clippy errors
* chore: update commit id
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-06 11:30:02 +08:00
Nathan.fooo
79bb510aaf
ci: run history test ( #513 )
...
* ci: run history test
* chore: fix ci
2024-05-01 16:28:07 +08:00
Nathan.fooo
efbe9c4a93
chore: move collab rt crate ( #489 )
...
* chore: create appflowy collaborate crate
* chore: remove collab-rt
* chore: fmt
* chore: main
2024-04-22 12:14:41 +08:00