Commit Graph

23 Commits

Author SHA1 Message Date
Nathan.fooo 655f13bc27
chore: search and chat (#999)
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
2024-11-16 14:52:12 +08:00
nathan b10a0e7829 chore: fix typo 2024-11-15 13:45:25 +08:00
Nathan.fooo 97f9ff3dd8
fix: byte index 8000 is not a char boundary (#995)
* chore: fix split text boundary error and add related tests

* chore: reduce clone
2024-11-15 13:38:08 +08:00
Bartosz Sypytkowski f6fef9918b
chore: split document content into multiple embeddings (#990)
* chore: split document content into multiple embeddings

* chore: fallback to uuid v4 generation due to unmaintained transient dependency

* chore: fix lint errors
2024-11-14 14:15:52 +08:00
Nathan.fooo 5d356718fa
fix: using spawn_blocking in order to not block the runtime (#793)
* fix: using blocking in order to not block the runtime

* chore: increase deps count
2024-09-05 09:19:34 +08:00
Nathan.fooo 365c64c5c2
chore: use colla storage instead of select from db directly (#782) 2024-09-02 21:25:21 +08:00
Nathan.fooo c2a5369313
chore: set chat request timeout (#777)
* chore: set chat request timeout

* chore: clippy
2024-09-01 15:16:11 +08:00
Nathan.fooo 3e701a1f8b
chore: remove no require data error log (#766)
* chore: remove no require data error log

* chore: clippy
2024-08-30 13:55:53 +08:00
Bartosz Sypytkowski 8beac5c85f
chore: reuse group collab for indexing (#737)
* chore: reuse group collab for indexing

* chore: fix linting errors

* chore: post rebase fixes
2024-08-28 00:13:41 +08:00
nathan c77d0f9c2c chore: spawn indexer 2024-08-26 09:47:46 +08:00
Nathan.fooo d111282f7e
fix: panic when apply invalid update (#745) 2024-08-24 14:55:49 +08:00
nathan b4d79b954b chore: update logs 2024-08-23 10:30:52 +08:00
nathan 2d7a4bde92 Merge branch 'main' into no-lock-collab 2024-08-19 10:38:07 +08:00
nathan 809d0df607 chore: only log on debug 2024-08-16 20:48:43 +08:00
Bartosz Sypytkowski f2fa4d7c22 chore: post rebase fixes 2024-08-14 05:26:38 +02:00
Bartosz Sypytkowski c27866fb25 chore: upgrade code to use asynchronous locks 2024-08-13 19:59:46 +02:00
Nathan.fooo 73127fb886
chore: shorten group lifetime (#726) 2024-08-13 16:20:06 +08:00
Bartosz Sypytkowski cce52a5185 chore: do not throw errors on invalid document schema during indexing 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski 5d3574d643 chore: save collab embeddings on collab create 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski f13b9ee787 chore: add indexing of collabs at application start 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski 95912e266c fix: add types removed after rebase 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski b79fe41af3 chore: moving embeddings into collabparams 2024-06-28 05:39:56 +02:00
Bartosz Sypytkowski b1ebbecc5f chore: moving appflowy indexer into appflowy cloud 2024-06-28 05:39:53 +02:00