Commit Graph

553 Commits

Author SHA1 Message Date
Zack Fu Zi Xiang 013653bc66
chore: improve billing api 2024-07-10 16:12:26 +08:00
Zack Fu Zi Xiang 4623077cdd
chore: add method to query status only for a workspace 2024-07-10 13:52:50 +08:00
Zack Fu Zi Xiang f223d278b7
Merge branch 'main' into billing-support 2024-07-10 12:12:34 +08:00
Bartosz Sypytkowski 44406ccdae
chore: update yrs and appflowy-collab (#677)
* chore: update yrs and appflowy-collab

* chore: remove wasm compilation target

* chore: fixed number conversion in tests

* chore: remove wasm integration tests

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-07-10 10:10:07 +08:00
Zack Fu Zi Xiang cba2248132
chore: add clone 2024-07-09 14:42:44 +08:00
Zack Fu Zi Xiang 95b314d97e
chore: support into trait for subscription plan and recurring interval 2024-07-09 13:28:39 +08:00
Zack Fu Zi Xiang 9c3529f0ca
chore: support into trait for subscription plan and recurring interval 2024-07-09 13:23:15 +08:00
Zack Fu Zi Xiang 8b5a803d44
chore: trait support for plan and recurring interval 2024-07-09 13:07:39 +08:00
Zack Fu Zi Xiang e1e6ad0e95
chore: add from trait for subscription plan 2024-07-09 13:01:20 +08:00
Zack Fu Zi Xiang 23d1c2433b
chore: fix naming consistency 2024-07-08 14:50:52 +08:00
Zack Fu Zi Xiang 8a2ba59ce8
chore: add more param for plan cancellation 2024-07-08 01:27:41 +08:00
Zack Fu Zi Xiang 430fbf845a
chore: update usage and limits api 2024-07-07 15:55:10 +08:00
Zack Fu Zi Xiang b77ac38ea3
chore: add http api for usage and limit 2024-07-06 23:33:49 +08:00
Zack Fu Zi Xiang a41344fbae
chore: configurable base billing url 2024-07-06 16:52:31 +08:00
Zack Fu Zi Xiang d9b668fab0
chore: add ai response limit service error code 2024-07-03 00:34:33 +08:00
Nathan.fooo c0bc7020d9
fix: return ai stream error when service unavailable (#673) 2024-07-02 13:24:40 +08:00
Bartosz Sypytkowski 117612415f fix: make collab params deserialize from older version 2024-07-01 12:03:59 +02:00
Zack Fu Zi Xiang d06dbadc05
fix: update publish collab 2024-06-29 13:50:56 +08:00
Zack Fu Zi Xiang 395486adc3
fix: fix various publish issues 2024-06-29 11:23:23 +08:00
Bartosz Sypytkowski 71899ec792 chore: disabling indexing on workspace prunes collab embeddings 2024-06-28 09:09:18 +02:00
Bartosz Sypytkowski 6c0f4985c3
Merge pull request #645 from AppFlowy-IO/merge-indexer-collaborate
Merge indexer collaborate
2024-06-28 07:48:32 +02:00
Nathan.fooo 9884d93aa2
chore: rename function and add docs (#663) 2024-06-28 13:43:58 +08:00
Bartosz Sypytkowski 2f37f621b2 fix: collab update violating primary key 2024-06-28 07:11:33 +02:00
Bartosz Sypytkowski 9ea085d6db chore: fix cargo formatting 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski 95912e266c fix: add types removed after rebase 2024-06-28 05:40:44 +02:00
Bartosz Sypytkowski b79fe41af3 chore: moving embeddings into collabparams 2024-06-28 05:39:56 +02:00
Bartosz Sypytkowski b1ebbecc5f chore: moving appflowy indexer into appflowy cloud 2024-06-28 05:39:53 +02:00
Bartosz Sypytkowski b978033c77 fix: make search results visible for members 2024-06-26 13:03:11 +02:00
Nathan.fooo 1a22813113
chore: stop indexing when stream is not exist (#652) 2024-06-26 14:24:23 +08:00
Bartosz Sypytkowski 6592f00a20 chore: change query to use workspace directly 2024-06-25 08:07:32 +02:00
Bartosz Sypytkowski 2ff2a77465 fix: do not throw errors if indexer found document before workspace was created 2024-06-25 07:30:48 +02:00
Bartosz Sypytkowski ef27a148b9 chore: rename workspace settings disable indexing to disable search indexing in database queries 2024-06-24 10:54:42 +02:00
Khor Shu Heng 537824e82b
chore: fix clippy linting errors and warnings (#639) 2024-06-23 23:18:38 +08:00
Nathan.fooo d61524d636
chore: client api log (#644)
* chore: update logs

* chore: support stream completion
2024-06-23 21:42:01 +08:00
Nathan.fooo 72affd99e5
chore: update logs (#643) 2024-06-23 15:40:26 +08:00
Nathan.fooo e33ef45d05
feat: Integrate workspace setting (#642)
* chore: update workspace setting

* chore: update workspace setting with changes

* chore: fix test
2024-06-23 15:36:32 +08:00
Nathan.fooo c0937bfbeb
feat: support switch model (#641)
* feat: support switch model
2024-06-22 15:01:33 +08:00
Zack Fu Zi Xiang 0bf6d3bd60
feat: change doc name to publish name 2024-06-21 11:18:44 +08:00
Zack Fu Zi Xiang 0adbf132be
chore: merge with main 2024-06-20 21:15:25 +08:00
Nathan.fooo a3af38162e
chore: fix upload filem meta key by adding parent dir as prefix (#635)
* chore: fix upload filem meta key by adding parent dir as prefix

* chore: fix test
2024-06-20 21:12:28 +08:00
Zack Fu Zi Xiang 94af813b04
chore: cargo clippy 2024-06-20 18:12:49 +08:00
Zack Fu Zi Xiang 1d57c80fa6
feat: use custome async reader 2024-06-20 17:55:52 +08:00
Zack Fu Zi Xiang ab5c7bb830
fix: try without chunk headers 2024-06-20 15:05:06 +08:00
Zack Fu Zi Xiang f7fcb66c95
fix: wasm build 2024-06-20 13:15:51 +08:00
Zack Fu Zi Xiang f2f3695cfb
chore: try use stream feature flag 2024-06-20 12:32:51 +08:00
Zack Fu Zi Xiang b525e333f0
feat: batch unpublish 2024-06-20 12:05:12 +08:00
Zack Fu Zi Xiang 31f5c786a6
chore: merge with main 2024-06-20 11:20:16 +08:00
Zack Fu Zi Xiang d4dd350da1
feat: batch publish item with metadata 2024-06-20 11:15:08 +08:00
nathan 6262816043 chore: remove unused deps in appflowy-ai-client 2024-06-19 13:11:07 +08:00
Nathan.fooo 30f87457f3
feat: support uploading file with multiple part (#625)
* refactor: replace crate

* chore: remove s3-rust crate

* chore: test multiple upload

* chore: client api

* chore: client api

* chore: v1 version upload,download

* chore: fix test

* chore: fix test

* chore: remove workspace test

* chore: fix wasm build

* chore: update path

* chore: update path

* chore: rename

* chore: expose file entity

* chore: introduce client-api-entity

* chore: fix build

* chore: new url

* chore: fix test

* chore: merge main

* chore: fix clippy
2024-06-19 13:06:58 +08:00
Zack Fu Zi Xiang 6c09839728
feat: batch metadata 2024-06-19 01:30:51 +08:00
Zack Fu Zi Xiang 09828c5eea
feat: add impl for get collab info 2024-06-18 19:07:48 +08:00
Zack Fu Zi Xiang 18e9d0abae
feat: use view id 2024-06-18 18:20:05 +08:00
Zack Fu Zi Xiang 31b3275d8d
feat: improve interface 2024-06-18 17:07:47 +08:00
Bartosz Sypytkowski 9ea4de06fd
Merge pull request #630 from AppFlowy-IO/track-ai-responses
chore: change open ai token tracking to daily basis
2024-06-18 10:04:04 +02:00
Zack 0bf33efe02
Merge pull request #629 from AppFlowy-IO/feat/publish-document
Feat/publish document
2024-06-18 14:31:17 +08:00
Bartosz Sypytkowski 9ca904f943 chore: change open ai token tracking to daily basis 2024-06-18 06:53:39 +02:00
Zack Fu Zi Xiang 7530d78ab6
fix: get workspace namespace 2024-06-18 12:33:52 +08:00
Zack Fu Zi Xiang 236a22ac97
fix: get workspace namespace 2024-06-18 12:32:01 +08:00
Zack Fu Zi Xiang 99fc95f33a
chore: refine api 2024-06-17 22:55:04 +08:00
nathan f0a32330b2 chore: fix clippy 2024-06-17 22:08:02 +08:00
nathan 5bc39729a7 chore: implement embedding api endpoint 2024-06-17 22:06:58 +08:00
Zack Fu Zi Xiang d2cb0d4486
chore: remove unneeded api 2024-06-17 21:33:36 +08:00
Zack Fu Zi Xiang ae29bbe9fe
fix: published doc alias 2024-06-17 01:07:40 +08:00
Zack Fu Zi Xiang cb74f38ac8
fix: json metadata 2024-06-16 20:41:50 +08:00
Zack Fu Zi Xiang 05b284f7e7
feat: client code for namespace changes 2024-06-16 14:06:04 +08:00
Zack Fu Zi Xiang 233b757698
feat: add published endpoints 2024-06-15 21:47:11 +08:00
Zack Fu Zi Xiang 2ab59e79a3
feat: get published collab meta data 2024-06-15 21:20:59 +08:00
Zack Fu Zi Xiang de413844dc
feat: put and get published collab data 2024-06-15 14:59:18 +08:00
Zack Fu Zi Xiang 94bd62869c
feat: delete publish collab 2024-06-15 11:51:05 +08:00
Zack Fu Zi Xiang 2c7cdefb83
Merge branch 'main' into feat/publish-document 2024-06-14 21:36:17 +08:00
Zack Fu Zi Xiang 18da7b873b
feat: publish namespace and metadata 2024-06-14 21:35:39 +08:00
Bartosz Sypytkowski 6685b24239
Merge pull request #623 from AppFlowy-IO/indexer-missing-text-data
fix: index all of the document blocks
2024-06-14 13:30:01 +02:00
Bartosz Sypytkowski 7ad105ee34 fix: index all of the document blocks 2024-06-14 11:23:19 +02:00
Nathan.fooo 430e3e15c9
fix: chat stream (#620)
* chore: fix chat stream
2024-06-13 22:46:49 +08:00
Zack 9d3d28ad89
chore: move billing to client api http (#619) 2024-06-13 14:38:58 +08:00
Zack 6471831561
chore: move billing client (#618)
* chore: move billing client

* chore: cargo fmt
2024-06-13 13:19:40 +08:00
Bartosz Sypytkowski 0109597330
Merge pull request #613 from AppFlowy-IO/normalize-paths
chore: normalize URL paths in appflowy collab server
2024-06-12 08:13:05 +02:00
Nathan.fooo ff4384fbd0
feat: translate api endpoint (#612)
* chore: support translate

* chore: support translate

* chore: update endpoint structs
2024-06-12 12:37:11 +08:00
Bartosz Sypytkowski 3721d209f2 chore: normalize URL paths in appflowy collab server 2024-06-12 06:21:56 +02:00
Nathan.fooo d0467e7e2e
feat: Stream chat message (#610)
* chore: test stream

* chore: fix test

* chore: fix test

* chore: add log

* chore: fix parsing

* chore: fix parsing

* chore: fix parsing

* chore: create answer

* chore: create answer
2024-06-08 22:51:19 +08:00
Bartosz Sypytkowski b52369de7f
feat: add workspace settings with disable indexing option (#606)
* feat: add workspace settings with disable indexing option

* chore: added api workspace settings endpoint

* chore: add workspace settings read and write to client api

* chore: add tests for workspace settings client api

* fix: enforce authorization rules on workspace settings api

* chore: fix appflowy indexer test configuration

* chore: add dotenvy to appflowy indexer tests

* chore: override appflowy indexer env vars for tests

* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
Nathan.fooo 3f55cea9ca
chore: using json stream to deserialize data (#605)
* chore: update log

* chore: use json stream

* chore: use json stream

* chore: fix compile

* chore: fix compile
2024-06-04 22:42:27 +08:00
Nathan.fooo 6bb2a20888
fix: nginx ai test (#603)
* chore: add config for ai/chat

* chore: update config
2024-06-04 20:11:19 +08:00
Bartosz Sypytkowski 58e01f4e8d
fix: index documents with missing embeddings at service start (#597)
* feat: appflowy-indexer indexes documents with missing embeddings at start

* chore: add tests to check initial indexing of collabs

* chore: log user search requests and response

* fix: wrong appflowy openai api key env var name

* chore: fill openai keys for integration testing

* chore: silence flaky test
2024-06-04 16:50:06 +08:00
Nathan.fooo b36715dc24
chore: generate answer manually (#594)
* chore: generate answer manually

* chore: rename

* chore: return reply message id

* chore: save message

* chore: commit schema files
2024-06-03 08:06:23 +08:00
Nathan.fooo 1cc5b58254
chore: update client api (#593) 2024-06-02 20:20:14 +08:00
Nathan.fooo edfcb5c1ea
chore: extend chat message with meta (#592) 2024-06-01 19:32:39 +08:00
Nathan.fooo 1537c4d1f6
chore: update chat test (#590) 2024-05-30 17:15:13 +08:00
Mathias Mogensen 06272364b7
feat: get workspace member by user id (#588)
* feat: get workspace member by user id

* chore: remove unneccessary arg
2024-05-30 07:50:58 +08:00
Nathan.fooo 9b4bfce616
chore: fix ai client test (#589) 2024-05-30 07:50:25 +08:00
Bartosz Sypytkowski c4702bbbdf
feat: Workspace token usage (#584)
* feat: register open ai token usage during indexing

* feat: register open ai token usage during search

* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
Khor Shu Heng a6bcbd583f
chore: share library for authentication (#576)
* chore: share library for authentication

* fix: return error from requesting app data instead of unwrap

* fix: return internal server error when jwt secret is missing

* chore: remove argon dep from main crate

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-29 16:00:21 +08:00
Bartosz Sypytkowski d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint (#582)
* feat: implement appflowy-indexer and search api endpoint

* chore: store embedding content type

* chore: more descriptive messages for open ai missing key

* chore: fix sqlx errors in tests

* chore: document watcher - change plain text rendering to use depth-first scan

* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
nathan 1a32339056 chore: fix typo 2024-05-27 17:08:47 +08:00
Nathan.fooo 80d46a2e3c
chore: Clean redis update script (#581)
* chore: rename folder

* chore: add script to remove redis stream

* chore: add script to remove redis stream

* chore: fix ci
2024-05-27 16:48:13 +08:00
Nathan.fooo 115d046094
chore: periodicall check redis stream capacity (#580) 2024-05-27 14:09:57 +08:00
Nathan.fooo 3f2d5f0785
chore: optimize redis stream space usage (#579)
* chore: set maxlen for redis stream

* chore: update log

* chore: set expiration time
2024-05-27 13:22:14 +08:00
Khor Shu Heng 93b4a1516c
feat: add postgres listeners for collab service (#575) 2024-05-27 09:12:32 +08:00
Nathan.fooo 559d924cd1
feat: stream chat message (#577)
* chore: save author id

* chore: stream response

* chore: stream chat message
2024-05-26 22:44:08 +08:00