chk
/
AppFlowy-Cloud
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,030 Commits 2 Branches 0 Tags 17 MiB
Commit Graph

17 Commits

Author SHA1 Message Date
Khor Shu Heng 0f7a1f41d0
feat: support disabling comments and disallow duplicate as template for published page (#1167) 2025-01-17 09:43:56 +08:00
Khor Shu Heng 832bd7f9c9
fix: children of trash views and other user's private space should not appear in search (#1146) 2025-01-10 16:30:35 +08:00
Khor Shu Heng 0ca22f7717
fix: obtain unsearchable views before searching for embeddings (#1140) 2025-01-08 21:49:06 +08:00
Nathan.fooo b47a635cfc
chore: support async embed (#1139) 2025-01-08 16:37:17 +08:00
Khor Shu Heng 327e184e28
Avoid leaking private document in search endpoint (#1113) 
* fix: auto patch workspace folder without space

* fix: avoid leaking private document contents in search endpoint

---------

Co-authored-by: weidong fu <nathan@appflowy.io>
 2025-01-05 15:28:52 +08:00
Nathan.fooo 1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn (#1099) 
* chore: batch index

* chore: format log

* chore: index workspace

* chore: fix stack overflow

* chore: background index

* chore: clippy

* chore: filter tasks

* chore: clippy

* chore: add metrics

* chore: fix test
 2024-12-24 14:30:17 +08:00
Nathan.fooo ec9c38254b
chore: open ai call directly (#1074) 
* chore: use open ai embedding

* chore: update test

* chore: retry

* chore: metrics

* chore: clippy

* chore: env

* chore: delete test
 2024-12-15 23:29:46 +08:00
Nathan.fooo 2ab1e94b99
chore: create embed in background (#1071) 
* refactor: create indexer scheduler

* refactor: replace current calls

* chore: use rayon thread pool

* chore: index unindexed collab using thread pool

* chore: index collab when write to disk

* chore: add test

* chore: add test

* chore: add test

* chore: fix client api deps

* chore: chat with document test

* chore: fix test

* chore: clippy

* chore: update test
 2024-12-15 12:29:51 +08:00
Nathan.fooo 655f13bc27
chore: search and chat (#999) 
* chore: add test for search and chat

* chore: update test

* chore: update test

* chore: update ci

* chore: fix security audio

* chore: multiple core docker build

* chore: multiple core docker build

* chore: update ci

* chore: update model setting

* chore: test ci

* chore: use tiktoken to calcualte token length

* chore: remove env

* chore: use spawn_blocking with condition

* chore: docs

* chore: clippy

* chore: clippy

* chore: docker logs

* chore: pass message id

* chore: clippy
 2024-11-16 14:52:12 +08:00
Nathan.fooo a6539dd963
chore: shorten default write interval (#661) 2024-06-28 10:06:09 +08:00
Bartosz Sypytkowski d9354202cd chore: specify chunk size for search and index 2024-06-18 11:45:33 +02:00
Bartosz Sypytkowski 0e50650aa8 chore: use appflowy ai client for embeddings in search api 2024-06-18 10:51:11 +02:00
Bartosz Sypytkowski d02c7e4ea7 feat: add workspace label to search open ai token metrics 2024-06-12 08:27:37 +02:00
Bartosz Sypytkowski 0b93190cbd chore: let prometheus track open ai tokens used on search 2024-06-12 08:20:57 +02:00
Bartosz Sypytkowski 58e01f4e8d
fix: index documents with missing embeddings at service start (#597) 
* feat: appflowy-indexer indexes documents with missing embeddings at start

* chore: add tests to check initial indexing of collabs

* chore: log user search requests and response

* fix: wrong appflowy openai api key env var name

* chore: fill openai keys for integration testing

* chore: silence flaky test
 2024-06-04 16:50:06 +08:00
Bartosz Sypytkowski c4702bbbdf
feat: Workspace token usage (#584) 
* feat: register open ai token usage during indexing

* feat: register open ai token usage during search

* chore: fixed open ai token usage when searching for documents
 2024-05-29 16:07:56 +08:00
Bartosz Sypytkowski d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint (#582) 
* feat: implement appflowy-indexer and search api endpoint

* chore: store embedding content type

* chore: more descriptive messages for open ai missing key

* chore: fix sqlx errors in tests

* chore: document watcher - change plain text rendering to use depth-first scan

* chore: added nested document blocks example
 2024-05-28 21:09:29 +08:00