Commit Graph

935 Commits

Author SHA1 Message Date
Zack Fu Zi Xiang a2194e4ca7
chore: try remove unused ports 2024-06-12 20:20:04 +08:00
Zack d5e0157d14
Merge pull request #615 from AppFlowy-IO/hide-postgres-port
chore: hide postgres port from docker compose
2024-06-12 19:39:53 +08:00
Bartosz Sypytkowski 2b9fd57eba chore: hide postgres port from docker compose 2024-06-12 13:37:41 +02:00
Bartosz Sypytkowski 64baf9ea00
Merge pull request #608 from AppFlowy-IO/search-tokens-metrics
let prometheus track open ai tokens used on search
2024-06-12 09:06:30 +02:00
Bartosz Sypytkowski d02c7e4ea7 feat: add workspace label to search open ai token metrics 2024-06-12 08:27:37 +02:00
Bartosz Sypytkowski 0b93190cbd chore: let prometheus track open ai tokens used on search 2024-06-12 08:20:57 +02:00
Bartosz Sypytkowski 0109597330
Merge pull request #613 from AppFlowy-IO/normalize-paths
chore: normalize URL paths in appflowy collab server
2024-06-12 08:13:05 +02:00
Nathan.fooo ff4384fbd0
feat: translate api endpoint (#612)
* chore: support translate

* chore: support translate

* chore: update endpoint structs
2024-06-12 12:37:11 +08:00
Bartosz Sypytkowski 3721d209f2 chore: normalize URL paths in appflowy collab server 2024-06-12 06:21:56 +02:00
Nathan.fooo d0467e7e2e
feat: Stream chat message (#610)
* chore: test stream

* chore: fix test

* chore: fix test

* chore: add log

* chore: fix parsing

* chore: fix parsing

* chore: fix parsing

* chore: create answer

* chore: create answer
2024-06-08 22:51:19 +08:00
Zack 8a0c098fe8
feat: add payment success redirect (#607) 2024-06-06 09:56:51 +08:00
Bartosz Sypytkowski b52369de7f
feat: add workspace settings with disable indexing option (#606)
* feat: add workspace settings with disable indexing option

* chore: added api workspace settings endpoint

* chore: add workspace settings read and write to client api

* chore: add tests for workspace settings client api

* fix: enforce authorization rules on workspace settings api

* chore: fix appflowy indexer test configuration

* chore: add dotenvy to appflowy indexer tests

* chore: override appflowy indexer env vars for tests

* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
Zack 928d1dfe77
chore: remove auto deploy to test env (#601) 2024-06-05 11:02:46 +08:00
Nathan.fooo 3f55cea9ca
chore: using json stream to deserialize data (#605)
* chore: update log

* chore: use json stream

* chore: use json stream

* chore: fix compile

* chore: fix compile
2024-06-04 22:42:27 +08:00
Nathan.fooo 56b5c4c843
chore: disable old version history test (#604) 2024-06-04 20:41:31 +08:00
Nathan.fooo 6bb2a20888
fix: nginx ai test (#603)
* chore: add config for ai/chat

* chore: update config
2024-06-04 20:11:19 +08:00
Nathan.fooo 093c3ef430
fix: disable ai message test (#600) 2024-06-04 16:52:14 +08:00
Bartosz Sypytkowski 58e01f4e8d
fix: index documents with missing embeddings at service start (#597)
* feat: appflowy-indexer indexes documents with missing embeddings at start

* chore: add tests to check initial indexing of collabs

* chore: log user search requests and response

* fix: wrong appflowy openai api key env var name

* chore: fill openai keys for integration testing

* chore: silence flaky test
2024-06-04 16:50:06 +08:00
Nathan.fooo 50ff40f9d1
chore: add ai completoin scope (#599)
* chore: add ai completoin scope

* chore: fix ci to run test
2024-06-04 10:49:28 +08:00
Nathan.fooo da9b9d730e
chore: fix ai docker compose (#598) 2024-06-03 20:01:31 +08:00
Zack 45bfcc0a31
Merge pull request #596 from AppFlowy-IO/nginx-ai-config
fix: nginx optional resolution for ai service
2024-06-03 11:03:51 +08:00
Zack Fu Zi Xiang 49fe92c725
fix: nginx optional resolution for ai service 2024-06-03 09:56:22 +08:00
Nathan.fooo b36715dc24
chore: generate answer manually (#594)
* chore: generate answer manually

* chore: rename

* chore: return reply message id

* chore: save message

* chore: commit schema files
2024-06-03 08:06:23 +08:00
Nathan.fooo 1cc5b58254
chore: update client api (#593) 2024-06-02 20:20:14 +08:00
Nathan.fooo edfcb5c1ea
chore: extend chat message with meta (#592) 2024-06-01 19:32:39 +08:00
Nathan.fooo 89030c420f
chore: rename open api env name (#591) 2024-05-31 10:46:18 +08:00
nathan 33a68983b0 chore: update logs 2024-05-30 21:41:01 +08:00
Nathan.fooo 1537c4d1f6
chore: update chat test (#590) 2024-05-30 17:15:13 +08:00
Mathias Mogensen 06272364b7
feat: get workspace member by user id (#588)
* feat: get workspace member by user id

* chore: remove unneccessary arg
2024-05-30 07:50:58 +08:00
Nathan.fooo 9b4bfce616
chore: fix ai client test (#589) 2024-05-30 07:50:25 +08:00
Bartosz Sypytkowski 128e978016
chore: add appflowy indexer service start to cargo run xtask (#586) 2024-05-29 23:45:30 +08:00
Bartosz Sypytkowski 24429357de
chore: fix after merge compilation issues (#585) 2024-05-29 17:09:49 +08:00
Bartosz Sypytkowski c4702bbbdf
feat: Workspace token usage (#584)
* feat: register open ai token usage during indexing

* feat: register open ai token usage during search

* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
Khor Shu Heng a6bcbd583f
chore: share library for authentication (#576)
* chore: share library for authentication

* fix: return error from requesting app data instead of unwrap

* fix: return internal server error when jwt secret is missing

* chore: remove argon dep from main crate

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-29 16:00:21 +08:00
Bartosz Sypytkowski 219d84af69
chore: add appflowy indexer service image to docker publish (#583) 2024-05-29 13:46:39 +08:00
Bartosz Sypytkowski d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint (#582)
* feat: implement appflowy-indexer and search api endpoint

* chore: store embedding content type

* chore: more descriptive messages for open ai missing key

* chore: fix sqlx errors in tests

* chore: document watcher - change plain text rendering to use depth-first scan

* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
nathan 1a32339056 chore: fix typo 2024-05-27 17:08:47 +08:00
Nathan.fooo 80d46a2e3c
chore: Clean redis update script (#581)
* chore: rename folder

* chore: add script to remove redis stream

* chore: add script to remove redis stream

* chore: fix ci
2024-05-27 16:48:13 +08:00
Nathan.fooo 115d046094
chore: periodicall check redis stream capacity (#580) 2024-05-27 14:09:57 +08:00
Nathan.fooo 3f2d5f0785
chore: optimize redis stream space usage (#579)
* chore: set maxlen for redis stream

* chore: update log

* chore: set expiration time
2024-05-27 13:22:14 +08:00
Khor Shu Heng 93b4a1516c
feat: add postgres listeners for collab service (#575) 2024-05-27 09:12:32 +08:00
Nathan.fooo 559d924cd1
feat: stream chat message (#577)
* chore: save author id

* chore: stream response

* chore: stream chat message
2024-05-26 22:44:08 +08:00
Nathan.fooo ae3e075475
chore: Integrate with client-api, update chat message (#574)
* chore: update

* chore: get chat message with next back option

* chore: update next back

* chore: return answer

* chore: return answer

* chore: return answer

* chore: update client api

* chore: fix ci
2024-05-24 15:04:50 +08:00
Nathan.fooo 7284430cad
chore: add test (#571) 2024-05-23 21:03:36 +08:00
Nathan.fooo 4eb1e6bceb
chore: generate history using redis steam (#570)
* chore: combine test

* chore: add snapshot test

* chore: add test
2024-05-23 07:57:20 +08:00
Nathan.fooo 05e7f1cda7
Integrate ai chat (#569)
* chore: fix compile

* chore: implement client api

* chore: implement client api

* chore: clippy
2024-05-22 11:18:07 +08:00
Nathan.fooo 5f126375ed
chore: separate client api (#567) 2024-05-21 12:20:15 +08:00
Kilu.He 27cb3d01d5
feat: add get user workspace (#526)
* feat: add get user workspace

* feat: support batch get collab

* fix: decode batch collab

* fix: modified the method of batch_get_collab to post

* fix: modified a private function for batch collab

* fix: warning
2024-05-21 10:08:09 +08:00
Khor Shu Heng 67d9fad7d7
chore: migrate collab storage to appflowy-collaborate (#566)
* chore: migrate collab storage to appflowy-collaborate

* fix: clippy error

* chore: remove handler

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-21 10:06:26 +08:00
Zack ec7eb54bfc
chore: Self host improvement (#561)
* fix: remove multiple ways to specify database name

* feat: resent email for already invited user

* feat: mailer address from smtp username

* feat: allow user defined smtp port
2024-05-18 08:33:08 +08:00