832bd7f9c9
fix: children of trash views and other user's private space should not appear in search ( #1146 )
2025-01-10 16:30:35 +08:00
0ca22f7717
fix: obtain unsearchable views before searching for embeddings ( #1140 )
2025-01-08 21:49:06 +08:00
327ba7157e
chore: save fragment index ( #1106 )
2024-12-31 10:03:36 +08:00
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn ( #1099 )
...
* chore: batch index
* chore: format log
* chore: index workspace
* chore: fix stack overflow
* chore: background index
* chore: clippy
* chore: filter tasks
* chore: clippy
* chore: add metrics
* chore: fix test
2024-12-24 14:30:17 +08:00
46f9c7811f
chore: return unindex collab one by one ( #1095 )
...
* chore: return unindex collab one by one
* chore: clippy
2024-12-20 15:14:47 +08:00
e758f18d75
chore: add metadata column to save embeding info ( #1086 )
2024-12-18 22:48:25 +08:00
abf827f2a6
chore: query multiple collab embedding state ( #1081 )
...
* chore: query multiple collab embedding state
* chore: clippy
2024-12-17 23:23:43 +08:00
2ab1e94b99
chore: create embed in background ( #1071 )
...
* refactor: create indexer scheduler
* refactor: replace current calls
* chore: use rayon thread pool
* chore: index unindexed collab using thread pool
* chore: index collab when write to disk
* chore: add test
* chore: add test
* chore: add test
* chore: fix client api deps
* chore: chat with document test
* chore: fix test
* chore: clippy
* chore: update test
2024-12-15 12:29:51 +08:00
af38efe6d9
feat: sync document through http request ( #1064 )
...
* chore: query embedding
* chore: create embeddings
* chore: apply update to editing collab
* refactor: web-update
* chore: calculate missing update the sv is not none
* chore: add test
* chore: fix audit
* chore: commit sqlx
* chore: fix client api
* test: add
* chore: clippy
* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
4fb6df5c14
chore: reduce number of SQL statements executed when inserting/updating collab ( #1022 )
...
* chore: reduce number of SQL statements executed when inserting new collab
* chore: add workspace id check
* chore: fix previous query
* chore: upsert collabs and embddings as stored procedures
* chore: fix clippy errors
* chore: fix stored procedure to compare workspaces correctly
2024-11-27 13:00:00 +08:00
f6fef9918b
chore: split document content into multiple embeddings ( #990 )
...
* chore: split document content into multiple embeddings
* chore: fallback to uuid v4 generation due to unmaintained transient dependency
* chore: fix lint errors
2024-11-14 14:15:52 +08:00
14adf250a8
chore: update ai api endpoint & rename structs ( #953 )
...
* chore: revmap loader type
* chore: revamp context
* chore: fix test
* chore: remove unused handler
* chore: create new chat api endpoint
* chore: add docs
* chore: clippy
* chore: fix test
2024-11-11 20:10:46 +08:00
365c64c5c2
chore: use colla storage instead of select from db directly ( #782 )
2024-09-02 21:25:21 +08:00
2f37f621b2
fix: collab update violating primary key
2024-06-28 07:11:33 +02:00
9ea085d6db
chore: fix cargo formatting
2024-06-28 05:40:44 +02:00
b1ebbecc5f
chore: moving appflowy indexer into appflowy cloud
2024-06-28 05:39:53 +02:00
b978033c77
fix: make search results visible for members
2024-06-26 13:03:11 +02:00
6592f00a20
chore: change query to use workspace directly
2024-06-25 08:07:32 +02:00
2ff2a77465
fix: do not throw errors if indexer found document before workspace was created
2024-06-25 07:30:48 +02:00
ef27a148b9
chore: rename workspace settings disable indexing to disable search indexing in database queries
2024-06-24 10:54:42 +02:00
9ca904f943
chore: change open ai token tracking to daily basis
2024-06-18 06:53:39 +02:00
b52369de7f
feat: add workspace settings with disable indexing option ( #606 )
...
* feat: add workspace settings with disable indexing option
* chore: added api workspace settings endpoint
* chore: add workspace settings read and write to client api
* chore: add tests for workspace settings client api
* fix: enforce authorization rules on workspace settings api
* chore: fix appflowy indexer test configuration
* chore: add dotenvy to appflowy indexer tests
* chore: override appflowy indexer env vars for tests
* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
58e01f4e8d
fix: index documents with missing embeddings at service start ( #597 )
...
* feat: appflowy-indexer indexes documents with missing embeddings at start
* chore: add tests to check initial indexing of collabs
* chore: log user search requests and response
* fix: wrong appflowy openai api key env var name
* chore: fill openai keys for integration testing
* chore: silence flaky test
2024-06-04 16:50:06 +08:00
c4702bbbdf
feat: Workspace token usage ( #584 )
...
* feat: register open ai token usage during indexing
* feat: register open ai token usage during search
* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint ( #582 )
...
* feat: implement appflowy-indexer and search api endpoint
* chore: store embedding content type
* chore: more descriptive messages for open ai missing key
* chore: fix sqlx errors in tests
* chore: document watcher - change plain text rendering to use depth-first scan
* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
Khor Shu Heng
Nathan.fooo
Bartosz Sypytkowski