Bartosz Sypytkowski
9b308bceaa
chore: appflowy indexer - do not break the document handler on missing data
2024-06-26 07:18:28 +02:00
Bartosz Sypytkowski
b7ce1617cd
chore: fix appflowy indexer tests
2024-06-25 08:47:40 +02:00
Bartosz Sypytkowski
6592f00a20
chore: change query to use workspace directly
2024-06-25 08:07:32 +02:00
Bartosz Sypytkowski
2ff2a77465
fix: do not throw errors if indexer found document before workspace was created
2024-06-25 07:30:48 +02:00
Bartosz Sypytkowski
d9354202cd
chore: specify chunk size for search and index
2024-06-18 11:45:33 +02:00
Bartosz Sypytkowski
ae2a2a4fa0
chore: appflowy indexer uses appflowy ai as open ai proxy
2024-06-18 10:04:38 +02:00
Bartosz Sypytkowski
f11703949c
chore: turn off sqlx macros in tests
2024-06-18 09:34:10 +02:00
Bartosz Sypytkowski
a5bca1852b
chore: change test query to macro
2024-06-18 08:53:02 +02:00
Bartosz Sypytkowski
9ca904f943
chore: change open ai token tracking to daily basis
2024-06-18 06:53:39 +02:00
nathan
f0a32330b2
chore: fix clippy
2024-06-17 22:08:02 +08:00
Bartosz Sypytkowski
3c72f1292d
chore: fixed tests for document content extraction
2024-06-14 13:01:16 +02:00
Bartosz Sypytkowski
7ad105ee34
fix: index all of the document blocks
2024-06-14 11:23:19 +02:00
Bartosz Sypytkowski
b52369de7f
feat: add workspace settings with disable indexing option ( #606 )
...
* feat: add workspace settings with disable indexing option
* chore: added api workspace settings endpoint
* chore: add workspace settings read and write to client api
* chore: add tests for workspace settings client api
* fix: enforce authorization rules on workspace settings api
* chore: fix appflowy indexer test configuration
* chore: add dotenvy to appflowy indexer tests
* chore: override appflowy indexer env vars for tests
* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
Bartosz Sypytkowski
58e01f4e8d
fix: index documents with missing embeddings at service start ( #597 )
...
* feat: appflowy-indexer indexes documents with missing embeddings at start
* chore: add tests to check initial indexing of collabs
* chore: log user search requests and response
* fix: wrong appflowy openai api key env var name
* chore: fill openai keys for integration testing
* chore: silence flaky test
2024-06-04 16:50:06 +08:00
Nathan.fooo
1cc5b58254
chore: update client api ( #593 )
2024-06-02 20:20:14 +08:00
Bartosz Sypytkowski
128e978016
chore: add appflowy indexer service start to cargo run xtask ( #586 )
2024-05-29 23:45:30 +08:00
Bartosz Sypytkowski
c4702bbbdf
feat: Workspace token usage ( #584 )
...
* feat: register open ai token usage during indexing
* feat: register open ai token usage during search
* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
Bartosz Sypytkowski
d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint ( #582 )
...
* feat: implement appflowy-indexer and search api endpoint
* chore: store embedding content type
* chore: more descriptive messages for open ai missing key
* chore: fix sqlx errors in tests
* chore: document watcher - change plain text rendering to use depth-first scan
* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00