Commit Graph

431 Commits

Author SHA1 Message Date
Bartosz Sypytkowski 6685b24239
Merge pull request #623 from AppFlowy-IO/indexer-missing-text-data
fix: index all of the document blocks
2024-06-14 13:30:01 +02:00
Bartosz Sypytkowski 7ad105ee34 fix: index all of the document blocks 2024-06-14 11:23:19 +02:00
Nathan.fooo 430e3e15c9
fix: chat stream (#620)
* chore: fix chat stream
2024-06-13 22:46:49 +08:00
Zack 9d3d28ad89
chore: move billing to client api http (#619) 2024-06-13 14:38:58 +08:00
Zack 6471831561
chore: move billing client (#618)
* chore: move billing client

* chore: cargo fmt
2024-06-13 13:19:40 +08:00
Bartosz Sypytkowski 0109597330
Merge pull request #613 from AppFlowy-IO/normalize-paths
chore: normalize URL paths in appflowy collab server
2024-06-12 08:13:05 +02:00
Nathan.fooo ff4384fbd0
feat: translate api endpoint (#612)
* chore: support translate

* chore: support translate

* chore: update endpoint structs
2024-06-12 12:37:11 +08:00
Bartosz Sypytkowski 3721d209f2 chore: normalize URL paths in appflowy collab server 2024-06-12 06:21:56 +02:00
Nathan.fooo d0467e7e2e
feat: Stream chat message (#610)
* chore: test stream

* chore: fix test

* chore: fix test

* chore: add log

* chore: fix parsing

* chore: fix parsing

* chore: fix parsing

* chore: create answer

* chore: create answer
2024-06-08 22:51:19 +08:00
Bartosz Sypytkowski b52369de7f
feat: add workspace settings with disable indexing option (#606)
* feat: add workspace settings with disable indexing option

* chore: added api workspace settings endpoint

* chore: add workspace settings read and write to client api

* chore: add tests for workspace settings client api

* fix: enforce authorization rules on workspace settings api

* chore: fix appflowy indexer test configuration

* chore: add dotenvy to appflowy indexer tests

* chore: override appflowy indexer env vars for tests

* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
Nathan.fooo 3f55cea9ca
chore: using json stream to deserialize data (#605)
* chore: update log

* chore: use json stream

* chore: use json stream

* chore: fix compile

* chore: fix compile
2024-06-04 22:42:27 +08:00
Nathan.fooo 6bb2a20888
fix: nginx ai test (#603)
* chore: add config for ai/chat

* chore: update config
2024-06-04 20:11:19 +08:00
Bartosz Sypytkowski 58e01f4e8d
fix: index documents with missing embeddings at service start (#597)
* feat: appflowy-indexer indexes documents with missing embeddings at start

* chore: add tests to check initial indexing of collabs

* chore: log user search requests and response

* fix: wrong appflowy openai api key env var name

* chore: fill openai keys for integration testing

* chore: silence flaky test
2024-06-04 16:50:06 +08:00
Nathan.fooo b36715dc24
chore: generate answer manually (#594)
* chore: generate answer manually

* chore: rename

* chore: return reply message id

* chore: save message

* chore: commit schema files
2024-06-03 08:06:23 +08:00
Nathan.fooo 1cc5b58254
chore: update client api (#593) 2024-06-02 20:20:14 +08:00
Nathan.fooo edfcb5c1ea
chore: extend chat message with meta (#592) 2024-06-01 19:32:39 +08:00
Nathan.fooo 1537c4d1f6
chore: update chat test (#590) 2024-05-30 17:15:13 +08:00
Mathias Mogensen 06272364b7
feat: get workspace member by user id (#588)
* feat: get workspace member by user id

* chore: remove unneccessary arg
2024-05-30 07:50:58 +08:00
Nathan.fooo 9b4bfce616
chore: fix ai client test (#589) 2024-05-30 07:50:25 +08:00
Bartosz Sypytkowski c4702bbbdf
feat: Workspace token usage (#584)
* feat: register open ai token usage during indexing

* feat: register open ai token usage during search

* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
Khor Shu Heng a6bcbd583f
chore: share library for authentication (#576)
* chore: share library for authentication

* fix: return error from requesting app data instead of unwrap

* fix: return internal server error when jwt secret is missing

* chore: remove argon dep from main crate

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-29 16:00:21 +08:00
Bartosz Sypytkowski d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint (#582)
* feat: implement appflowy-indexer and search api endpoint

* chore: store embedding content type

* chore: more descriptive messages for open ai missing key

* chore: fix sqlx errors in tests

* chore: document watcher - change plain text rendering to use depth-first scan

* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
nathan 1a32339056 chore: fix typo 2024-05-27 17:08:47 +08:00
Nathan.fooo 80d46a2e3c
chore: Clean redis update script (#581)
* chore: rename folder

* chore: add script to remove redis stream

* chore: add script to remove redis stream

* chore: fix ci
2024-05-27 16:48:13 +08:00
Nathan.fooo 115d046094
chore: periodicall check redis stream capacity (#580) 2024-05-27 14:09:57 +08:00
Nathan.fooo 3f2d5f0785
chore: optimize redis stream space usage (#579)
* chore: set maxlen for redis stream

* chore: update log

* chore: set expiration time
2024-05-27 13:22:14 +08:00
Khor Shu Heng 93b4a1516c
feat: add postgres listeners for collab service (#575) 2024-05-27 09:12:32 +08:00
Nathan.fooo 559d924cd1
feat: stream chat message (#577)
* chore: save author id

* chore: stream response

* chore: stream chat message
2024-05-26 22:44:08 +08:00
Nathan.fooo ae3e075475
chore: Integrate with client-api, update chat message (#574)
* chore: update

* chore: get chat message with next back option

* chore: update next back

* chore: return answer

* chore: return answer

* chore: return answer

* chore: update client api

* chore: fix ci
2024-05-24 15:04:50 +08:00
Nathan.fooo 4eb1e6bceb
chore: generate history using redis steam (#570)
* chore: combine test

* chore: add snapshot test

* chore: add test
2024-05-23 07:57:20 +08:00
Nathan.fooo 05e7f1cda7
Integrate ai chat (#569)
* chore: fix compile

* chore: implement client api

* chore: implement client api

* chore: clippy
2024-05-22 11:18:07 +08:00
Nathan.fooo 5f126375ed
chore: separate client api (#567) 2024-05-21 12:20:15 +08:00
Kilu.He 27cb3d01d5
feat: add get user workspace (#526)
* feat: add get user workspace

* feat: support batch get collab

* fix: decode batch collab

* fix: modified the method of batch_get_collab to post

* fix: modified a private function for batch collab

* fix: warning
2024-05-21 10:08:09 +08:00
Khor Shu Heng 67d9fad7d7
chore: migrate collab storage to appflowy-collaborate (#566)
* chore: migrate collab storage to appflowy-collaborate

* fix: clippy error

* chore: remove handler

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-21 10:06:26 +08:00
Zack ec7eb54bfc
chore: Self host improvement (#561)
* fix: remove multiple ways to specify database name

* feat: resent email for already invited user

* feat: mailer address from smtp username

* feat: allow user defined smtp port
2024-05-18 08:33:08 +08:00
Nathan.fooo 2736fa60a7
chore: integrate redis stream (#559)
* chore: integrate redis stream

* chore: make CollabUpdateStreaming::send_update synchronous

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
2024-05-18 08:28:57 +08:00
Nathan.fooo 2fae260e4f
chore: complete text endpoints (#557)
* chore: complete text endpoints
2024-05-16 22:48:44 +08:00
Khor Shu Heng c79267d42a
feat: migrate collab access control to collaboration service (#548)
* feat: migrate collab access control to collaborate service

* feat: migrate workspace access control to separate crate
2024-05-15 15:24:07 +08:00
Zack Fu Zi Xiang 40369e6915
fix: remove unneeded time verification 2024-05-13 09:53:04 +08:00
Nathan.fooo c491f1a560
chore: fix ci (#549)
* chore: fix ci
2024-05-12 21:02:28 +08:00
Nathan.fooo d994b10115
chore: appflowy ai client (#547)
* chore: appflowy ai client

* chore: clippy

* chore: clippy

* chore: fix ci

* chore: disable index search
2024-05-12 09:23:32 +08:00
Nathan.fooo 4c00ddd593
chore: Chat history (#546)
* chore: imple sql curd

* chore: update chat

* chore: select messages

* chore: update test

* chore: update schema

* chore: update
2024-05-11 20:41:21 +08:00
Nathan.fooo 388d38428b
chore: revamp post realtime endpoint (#536)
* chore: revamp  post realtime endpoint

* chore: fix clippy

* chore: fix fmt
2024-05-08 22:06:37 +08:00
Nathan.fooo 70262a1ac4
chore: try to not block actor mailbox (#534)
* chore: add test

* chore: spawn task to handle message

* chore: update error message
2024-05-08 16:54:05 +08:00
Nathan.fooo 359433f14c
fix: pool timeout when there are too many put blob requests (#533)
* fix: pool timeout when there are too many put blob requests

* chore: fix clippy

* fix: dont use transaction while putting data

---------

Co-authored-by: Zack Fu Zi Xiang <speed2exe@live.com.sg>
2024-05-08 12:20:06 +08:00
Nathan.fooo ef8e6f360f
chore: try to fix ws token error (#530)
* chore: try to fix ws token error

* chore: fix compile

* chore: bump version number

* chore: update

* chore: update

* ci: fix test
2024-05-07 16:45:12 +08:00
Zack 8870607569
Merge pull request #528 from AppFlowy-IO/email-link-reuse
feat: reuse email link
2024-05-06 15:04:12 +08:00
Zack Fu Zi Xiang 572271f751
feat: reuse email link 2024-05-06 14:18:36 +08:00
Bartosz Sypytkowski 47e6f1e8b1
Update Yrs and AppFlowy-Collab (#518)
* chore: updated collab dependencies to v0.2

* chore: update collab to v0.2 and yrs to v0.18

* chore: pinned collab to specific revision

* chore: fix clippy errors

* chore: update commit id

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-06 11:30:02 +08:00
Nathan.fooo eba2e0d4db
ci: add test (#516)
* ci: add test

* ci: add test

* ci: add readme

* ci: update test
2024-05-02 21:30:23 +08:00