Commit Graph

952 Commits

Author SHA1 Message Date
Bartosz Sypytkowski 9ca904f943 chore: change open ai token tracking to daily basis 2024-06-18 06:53:39 +02:00
Bartosz Sypytkowski ab01363786
Merge pull request #628 from AppFlowy-IO/embedding_api_endpoint
feat: Embedding api endpoint
2024-06-18 04:43:38 +02:00
nathan f0a32330b2 chore: fix clippy 2024-06-17 22:08:02 +08:00
nathan 5bc39729a7 chore: implement embedding api endpoint 2024-06-17 22:06:58 +08:00
Zack a0376446d0
Merge pull request #626 from AppFlowy-IO/foreign-key-indexing
chore: add foreign key indices for workspace table
2024-06-17 16:27:18 +08:00
Zack Fu Zi Xiang 16d3c9c7bd
chore: remove unneeded key 2024-06-17 14:33:14 +08:00
Zack Fu Zi Xiang 77efd7d236
chore: add foreign key indices for workspace table 2024-06-17 14:01:21 +08:00
Zack 7b593c599b
Merge pull request #624 from AppFlowy-IO/embedding-migration-optional
chore: make vector extension optional for migrations
2024-06-15 01:50:43 +08:00
Bartosz Sypytkowski 01aae523a9 chore: moved migration to new file 2024-06-14 19:24:55 +02:00
Bartosz Sypytkowski 709f8c3cdf chore: make vector extension optional for migrations 2024-06-14 19:03:03 +02:00
Bartosz Sypytkowski 6685b24239
Merge pull request #623 from AppFlowy-IO/indexer-missing-text-data
fix: index all of the document blocks
2024-06-14 13:30:01 +02:00
Bartosz Sypytkowski 3c72f1292d chore: fixed tests for document content extraction 2024-06-14 13:01:16 +02:00
Bartosz Sypytkowski 7ad105ee34 fix: index all of the document blocks 2024-06-14 11:23:19 +02:00
Nathan.fooo 430e3e15c9
fix: chat stream (#620)
* chore: fix chat stream
2024-06-13 22:46:49 +08:00
Zack 9d3d28ad89
chore: move billing to client api http (#619) 2024-06-13 14:38:58 +08:00
Zack 6471831561
chore: move billing client (#618)
* chore: move billing client

* chore: cargo fmt
2024-06-13 13:19:40 +08:00
Zack ee16f428c9
Merge pull request #616 from AppFlowy-IO/remove-unused-docker-compose-ports
chore: try remove unused ports
2024-06-12 20:34:37 +08:00
Zack Fu Zi Xiang a2194e4ca7
chore: try remove unused ports 2024-06-12 20:20:04 +08:00
Zack d5e0157d14
Merge pull request #615 from AppFlowy-IO/hide-postgres-port
chore: hide postgres port from docker compose
2024-06-12 19:39:53 +08:00
Bartosz Sypytkowski 2b9fd57eba chore: hide postgres port from docker compose 2024-06-12 13:37:41 +02:00
Bartosz Sypytkowski 64baf9ea00
Merge pull request #608 from AppFlowy-IO/search-tokens-metrics
let prometheus track open ai tokens used on search
2024-06-12 09:06:30 +02:00
Bartosz Sypytkowski d02c7e4ea7 feat: add workspace label to search open ai token metrics 2024-06-12 08:27:37 +02:00
Bartosz Sypytkowski 0b93190cbd chore: let prometheus track open ai tokens used on search 2024-06-12 08:20:57 +02:00
Bartosz Sypytkowski 0109597330
Merge pull request #613 from AppFlowy-IO/normalize-paths
chore: normalize URL paths in appflowy collab server
2024-06-12 08:13:05 +02:00
Nathan.fooo ff4384fbd0
feat: translate api endpoint (#612)
* chore: support translate

* chore: support translate

* chore: update endpoint structs
2024-06-12 12:37:11 +08:00
Bartosz Sypytkowski 3721d209f2 chore: normalize URL paths in appflowy collab server 2024-06-12 06:21:56 +02:00
Nathan.fooo d0467e7e2e
feat: Stream chat message (#610)
* chore: test stream

* chore: fix test

* chore: fix test

* chore: add log

* chore: fix parsing

* chore: fix parsing

* chore: fix parsing

* chore: create answer

* chore: create answer
2024-06-08 22:51:19 +08:00
Zack 8a0c098fe8
feat: add payment success redirect (#607) 2024-06-06 09:56:51 +08:00
Bartosz Sypytkowski b52369de7f
feat: add workspace settings with disable indexing option (#606)
* feat: add workspace settings with disable indexing option

* chore: added api workspace settings endpoint

* chore: add workspace settings read and write to client api

* chore: add tests for workspace settings client api

* fix: enforce authorization rules on workspace settings api

* chore: fix appflowy indexer test configuration

* chore: add dotenvy to appflowy indexer tests

* chore: override appflowy indexer env vars for tests

* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
Zack 928d1dfe77
chore: remove auto deploy to test env (#601) 2024-06-05 11:02:46 +08:00
Nathan.fooo 3f55cea9ca
chore: using json stream to deserialize data (#605)
* chore: update log

* chore: use json stream

* chore: use json stream

* chore: fix compile

* chore: fix compile
2024-06-04 22:42:27 +08:00
Nathan.fooo 56b5c4c843
chore: disable old version history test (#604) 2024-06-04 20:41:31 +08:00
Nathan.fooo 6bb2a20888
fix: nginx ai test (#603)
* chore: add config for ai/chat

* chore: update config
2024-06-04 20:11:19 +08:00
Nathan.fooo 093c3ef430
fix: disable ai message test (#600) 2024-06-04 16:52:14 +08:00
Bartosz Sypytkowski 58e01f4e8d
fix: index documents with missing embeddings at service start (#597)
* feat: appflowy-indexer indexes documents with missing embeddings at start

* chore: add tests to check initial indexing of collabs

* chore: log user search requests and response

* fix: wrong appflowy openai api key env var name

* chore: fill openai keys for integration testing

* chore: silence flaky test
2024-06-04 16:50:06 +08:00
Nathan.fooo 50ff40f9d1
chore: add ai completoin scope (#599)
* chore: add ai completoin scope

* chore: fix ci to run test
2024-06-04 10:49:28 +08:00
Nathan.fooo da9b9d730e
chore: fix ai docker compose (#598) 2024-06-03 20:01:31 +08:00
Zack 45bfcc0a31
Merge pull request #596 from AppFlowy-IO/nginx-ai-config
fix: nginx optional resolution for ai service
2024-06-03 11:03:51 +08:00
Zack Fu Zi Xiang 49fe92c725
fix: nginx optional resolution for ai service 2024-06-03 09:56:22 +08:00
Nathan.fooo b36715dc24
chore: generate answer manually (#594)
* chore: generate answer manually

* chore: rename

* chore: return reply message id

* chore: save message

* chore: commit schema files
2024-06-03 08:06:23 +08:00
Nathan.fooo 1cc5b58254
chore: update client api (#593) 2024-06-02 20:20:14 +08:00
Nathan.fooo edfcb5c1ea
chore: extend chat message with meta (#592) 2024-06-01 19:32:39 +08:00
Nathan.fooo 89030c420f
chore: rename open api env name (#591) 2024-05-31 10:46:18 +08:00
nathan 33a68983b0 chore: update logs 2024-05-30 21:41:01 +08:00
Nathan.fooo 1537c4d1f6
chore: update chat test (#590) 2024-05-30 17:15:13 +08:00
Mathias Mogensen 06272364b7
feat: get workspace member by user id (#588)
* feat: get workspace member by user id

* chore: remove unneccessary arg
2024-05-30 07:50:58 +08:00
Nathan.fooo 9b4bfce616
chore: fix ai client test (#589) 2024-05-30 07:50:25 +08:00
Bartosz Sypytkowski 128e978016
chore: add appflowy indexer service start to cargo run xtask (#586) 2024-05-29 23:45:30 +08:00
Bartosz Sypytkowski 24429357de
chore: fix after merge compilation issues (#585) 2024-05-29 17:09:49 +08:00
Bartosz Sypytkowski c4702bbbdf
feat: Workspace token usage (#584)
* feat: register open ai token usage during indexing

* feat: register open ai token usage during search

* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00