395486adc3
fix: fix various publish issues
2024-06-29 11:23:23 +08:00
71899ec792
chore: disabling indexing on workspace prunes collab embeddings
2024-06-28 09:09:18 +02:00
6c0f4985c3
Merge pull request #645 from AppFlowy-IO/merge-indexer-collaborate
...
Merge indexer collaborate
2024-06-28 07:48:32 +02:00
9884d93aa2
chore: rename function and add docs ( #663 )
2024-06-28 13:43:58 +08:00
2f37f621b2
fix: collab update violating primary key
2024-06-28 07:11:33 +02:00
9ea085d6db
chore: fix cargo formatting
2024-06-28 05:40:44 +02:00
95912e266c
fix: add types removed after rebase
2024-06-28 05:40:44 +02:00
b79fe41af3
chore: moving embeddings into collabparams
2024-06-28 05:39:56 +02:00
b1ebbecc5f
chore: moving appflowy indexer into appflowy cloud
2024-06-28 05:39:53 +02:00
b978033c77
fix: make search results visible for members
2024-06-26 13:03:11 +02:00
1a22813113
chore: stop indexing when stream is not exist ( #652 )
2024-06-26 14:24:23 +08:00
6592f00a20
chore: change query to use workspace directly
2024-06-25 08:07:32 +02:00
2ff2a77465
fix: do not throw errors if indexer found document before workspace was created
2024-06-25 07:30:48 +02:00
ef27a148b9
chore: rename workspace settings disable indexing to disable search indexing in database queries
2024-06-24 10:54:42 +02:00
537824e82b
chore: fix clippy linting errors and warnings ( #639 )
2024-06-23 23:18:38 +08:00
d61524d636
chore: client api log ( #644 )
...
* chore: update logs
* chore: support stream completion
2024-06-23 21:42:01 +08:00
72affd99e5
chore: update logs ( #643 )
2024-06-23 15:40:26 +08:00
e33ef45d05
feat: Integrate workspace setting ( #642 )
...
* chore: update workspace setting
* chore: update workspace setting with changes
* chore: fix test
2024-06-23 15:36:32 +08:00
c0937bfbeb
feat: support switch model ( #641 )
...
* feat: support switch model
2024-06-22 15:01:33 +08:00
0bf6d3bd60
feat: change doc name to publish name
2024-06-21 11:18:44 +08:00
0adbf132be
chore: merge with main
2024-06-20 21:15:25 +08:00
a3af38162e
chore: fix upload filem meta key by adding parent dir as prefix ( #635 )
...
* chore: fix upload filem meta key by adding parent dir as prefix
* chore: fix test
2024-06-20 21:12:28 +08:00
94af813b04
chore: cargo clippy
2024-06-20 18:12:49 +08:00
1d57c80fa6
feat: use custome async reader
2024-06-20 17:55:52 +08:00
ab5c7bb830
fix: try without chunk headers
2024-06-20 15:05:06 +08:00
f7fcb66c95
fix: wasm build
2024-06-20 13:15:51 +08:00
f2f3695cfb
chore: try use stream feature flag
2024-06-20 12:32:51 +08:00
b525e333f0
feat: batch unpublish
2024-06-20 12:05:12 +08:00
31f5c786a6
chore: merge with main
2024-06-20 11:20:16 +08:00
d4dd350da1
feat: batch publish item with metadata
2024-06-20 11:15:08 +08:00
6262816043
chore: remove unused deps in appflowy-ai-client
2024-06-19 13:11:07 +08:00
30f87457f3
feat: support uploading file with multiple part ( #625 )
...
* refactor: replace crate
* chore: remove s3-rust crate
* chore: test multiple upload
* chore: client api
* chore: client api
* chore: v1 version upload,download
* chore: fix test
* chore: fix test
* chore: remove workspace test
* chore: fix wasm build
* chore: update path
* chore: update path
* chore: rename
* chore: expose file entity
* chore: introduce client-api-entity
* chore: fix build
* chore: new url
* chore: fix test
* chore: merge main
* chore: fix clippy
2024-06-19 13:06:58 +08:00
6c09839728
feat: batch metadata
2024-06-19 01:30:51 +08:00
09828c5eea
feat: add impl for get collab info
2024-06-18 19:07:48 +08:00
18e9d0abae
feat: use view id
2024-06-18 18:20:05 +08:00
31b3275d8d
feat: improve interface
2024-06-18 17:07:47 +08:00
9ea4de06fd
Merge pull request #630 from AppFlowy-IO/track-ai-responses
...
chore: change open ai token tracking to daily basis
2024-06-18 10:04:04 +02:00
0bf33efe02
Merge pull request #629 from AppFlowy-IO/feat/publish-document
...
Feat/publish document
2024-06-18 14:31:17 +08:00
9ca904f943
chore: change open ai token tracking to daily basis
2024-06-18 06:53:39 +02:00
7530d78ab6
fix: get workspace namespace
2024-06-18 12:33:52 +08:00
236a22ac97
fix: get workspace namespace
2024-06-18 12:32:01 +08:00
99fc95f33a
chore: refine api
2024-06-17 22:55:04 +08:00
f0a32330b2
chore: fix clippy
2024-06-17 22:08:02 +08:00
5bc39729a7
chore: implement embedding api endpoint
2024-06-17 22:06:58 +08:00
d2cb0d4486
chore: remove unneeded api
2024-06-17 21:33:36 +08:00
ae29bbe9fe
fix: published doc alias
2024-06-17 01:07:40 +08:00
cb74f38ac8
fix: json metadata
2024-06-16 20:41:50 +08:00
05b284f7e7
feat: client code for namespace changes
2024-06-16 14:06:04 +08:00
233b757698
feat: add published endpoints
2024-06-15 21:47:11 +08:00
2ab59e79a3
feat: get published collab meta data
2024-06-15 21:20:59 +08:00
de413844dc
feat: put and get published collab data
2024-06-15 14:59:18 +08:00
94bd62869c
feat: delete publish collab
2024-06-15 11:51:05 +08:00
2c7cdefb83
Merge branch 'main' into feat/publish-document
2024-06-14 21:36:17 +08:00
18da7b873b
feat: publish namespace and metadata
2024-06-14 21:35:39 +08:00
6685b24239
Merge pull request #623 from AppFlowy-IO/indexer-missing-text-data
...
fix: index all of the document blocks
2024-06-14 13:30:01 +02:00
7ad105ee34
fix: index all of the document blocks
2024-06-14 11:23:19 +02:00
430e3e15c9
fix: chat stream ( #620 )
...
* chore: fix chat stream
2024-06-13 22:46:49 +08:00
9d3d28ad89
chore: move billing to client api http ( #619 )
2024-06-13 14:38:58 +08:00
6471831561
chore: move billing client ( #618 )
...
* chore: move billing client
* chore: cargo fmt
2024-06-13 13:19:40 +08:00
0109597330
Merge pull request #613 from AppFlowy-IO/normalize-paths
...
chore: normalize URL paths in appflowy collab server
2024-06-12 08:13:05 +02:00
ff4384fbd0
feat: translate api endpoint ( #612 )
...
* chore: support translate
* chore: support translate
* chore: update endpoint structs
2024-06-12 12:37:11 +08:00
3721d209f2
chore: normalize URL paths in appflowy collab server
2024-06-12 06:21:56 +02:00
d0467e7e2e
feat: Stream chat message ( #610 )
...
* chore: test stream
* chore: fix test
* chore: fix test
* chore: add log
* chore: fix parsing
* chore: fix parsing
* chore: fix parsing
* chore: create answer
* chore: create answer
2024-06-08 22:51:19 +08:00
b52369de7f
feat: add workspace settings with disable indexing option ( #606 )
...
* feat: add workspace settings with disable indexing option
* chore: added api workspace settings endpoint
* chore: add workspace settings read and write to client api
* chore: add tests for workspace settings client api
* fix: enforce authorization rules on workspace settings api
* chore: fix appflowy indexer test configuration
* chore: add dotenvy to appflowy indexer tests
* chore: override appflowy indexer env vars for tests
* chore: add appflowy indexer preindex env var
2024-06-06 09:26:21 +08:00
3f55cea9ca
chore: using json stream to deserialize data ( #605 )
...
* chore: update log
* chore: use json stream
* chore: use json stream
* chore: fix compile
* chore: fix compile
2024-06-04 22:42:27 +08:00
6bb2a20888
fix: nginx ai test ( #603 )
...
* chore: add config for ai/chat
* chore: update config
2024-06-04 20:11:19 +08:00
58e01f4e8d
fix: index documents with missing embeddings at service start ( #597 )
...
* feat: appflowy-indexer indexes documents with missing embeddings at start
* chore: add tests to check initial indexing of collabs
* chore: log user search requests and response
* fix: wrong appflowy openai api key env var name
* chore: fill openai keys for integration testing
* chore: silence flaky test
2024-06-04 16:50:06 +08:00
b36715dc24
chore: generate answer manually ( #594 )
...
* chore: generate answer manually
* chore: rename
* chore: return reply message id
* chore: save message
* chore: commit schema files
2024-06-03 08:06:23 +08:00
1cc5b58254
chore: update client api ( #593 )
2024-06-02 20:20:14 +08:00
edfcb5c1ea
chore: extend chat message with meta ( #592 )
2024-06-01 19:32:39 +08:00
1537c4d1f6
chore: update chat test ( #590 )
2024-05-30 17:15:13 +08:00
06272364b7
feat: get workspace member by user id ( #588 )
...
* feat: get workspace member by user id
* chore: remove unneccessary arg
2024-05-30 07:50:58 +08:00
9b4bfce616
chore: fix ai client test ( #589 )
2024-05-30 07:50:25 +08:00
c4702bbbdf
feat: Workspace token usage ( #584 )
...
* feat: register open ai token usage during indexing
* feat: register open ai token usage during search
* chore: fixed open ai token usage when searching for documents
2024-05-29 16:07:56 +08:00
a6bcbd583f
chore: share library for authentication ( #576 )
...
* chore: share library for authentication
* fix: return error from requesting app data instead of unwrap
* fix: return internal server error when jwt secret is missing
* chore: remove argon dep from main crate
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-29 16:00:21 +08:00
d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint ( #582 )
...
* feat: implement appflowy-indexer and search api endpoint
* chore: store embedding content type
* chore: more descriptive messages for open ai missing key
* chore: fix sqlx errors in tests
* chore: document watcher - change plain text rendering to use depth-first scan
* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
1a32339056
chore: fix typo
2024-05-27 17:08:47 +08:00
80d46a2e3c
chore: Clean redis update script ( #581 )
...
* chore: rename folder
* chore: add script to remove redis stream
* chore: add script to remove redis stream
* chore: fix ci
2024-05-27 16:48:13 +08:00
115d046094
chore: periodicall check redis stream capacity ( #580 )
2024-05-27 14:09:57 +08:00
3f2d5f0785
chore: optimize redis stream space usage ( #579 )
...
* chore: set maxlen for redis stream
* chore: update log
* chore: set expiration time
2024-05-27 13:22:14 +08:00
93b4a1516c
feat: add postgres listeners for collab service ( #575 )
2024-05-27 09:12:32 +08:00
559d924cd1
feat: stream chat message ( #577 )
...
* chore: save author id
* chore: stream response
* chore: stream chat message
2024-05-26 22:44:08 +08:00
ae3e075475
chore: Integrate with client-api, update chat message ( #574 )
...
* chore: update
* chore: get chat message with next back option
* chore: update next back
* chore: return answer
* chore: return answer
* chore: return answer
* chore: update client api
* chore: fix ci
2024-05-24 15:04:50 +08:00
4eb1e6bceb
chore: generate history using redis steam ( #570 )
...
* chore: combine test
* chore: add snapshot test
* chore: add test
2024-05-23 07:57:20 +08:00
05e7f1cda7
Integrate ai chat ( #569 )
...
* chore: fix compile
* chore: implement client api
* chore: implement client api
* chore: clippy
2024-05-22 11:18:07 +08:00
5f126375ed
chore: separate client api ( #567 )
2024-05-21 12:20:15 +08:00
27cb3d01d5
feat: add get user workspace ( #526 )
...
* feat: add get user workspace
* feat: support batch get collab
* fix: decode batch collab
* fix: modified the method of batch_get_collab to post
* fix: modified a private function for batch collab
* fix: warning
2024-05-21 10:08:09 +08:00
67d9fad7d7
chore: migrate collab storage to appflowy-collaborate ( #566 )
...
* chore: migrate collab storage to appflowy-collaborate
* fix: clippy error
* chore: remove handler
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-21 10:06:26 +08:00
ec7eb54bfc
chore: Self host improvement ( #561 )
...
* fix: remove multiple ways to specify database name
* feat: resent email for already invited user
* feat: mailer address from smtp username
* feat: allow user defined smtp port
2024-05-18 08:33:08 +08:00
2736fa60a7
chore: integrate redis stream ( #559 )
...
* chore: integrate redis stream
* chore: make CollabUpdateStreaming::send_update synchronous
---------
Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
2024-05-18 08:28:57 +08:00
2fae260e4f
chore: complete text endpoints ( #557 )
...
* chore: complete text endpoints
2024-05-16 22:48:44 +08:00
c79267d42a
feat: migrate collab access control to collaboration service ( #548 )
...
* feat: migrate collab access control to collaborate service
* feat: migrate workspace access control to separate crate
2024-05-15 15:24:07 +08:00
40369e6915
fix: remove unneeded time verification
2024-05-13 09:53:04 +08:00
c491f1a560
chore: fix ci ( #549 )
...
* chore: fix ci
2024-05-12 21:02:28 +08:00
d994b10115
chore: appflowy ai client ( #547 )
...
* chore: appflowy ai client
* chore: clippy
* chore: clippy
* chore: fix ci
* chore: disable index search
2024-05-12 09:23:32 +08:00
4c00ddd593
chore: Chat history ( #546 )
...
* chore: imple sql curd
* chore: update chat
* chore: select messages
* chore: update test
* chore: update schema
* chore: update
2024-05-11 20:41:21 +08:00
388d38428b
chore: revamp post realtime endpoint ( #536 )
...
* chore: revamp post realtime endpoint
* chore: fix clippy
* chore: fix fmt
2024-05-08 22:06:37 +08:00
70262a1ac4
chore: try to not block actor mailbox ( #534 )
...
* chore: add test
* chore: spawn task to handle message
* chore: update error message
2024-05-08 16:54:05 +08:00
359433f14c
fix: pool timeout when there are too many put blob requests ( #533 )
...
* fix: pool timeout when there are too many put blob requests
* chore: fix clippy
* fix: dont use transaction while putting data
---------
Co-authored-by: Zack Fu Zi Xiang <speed2exe@live.com.sg>
2024-05-08 12:20:06 +08:00
ef8e6f360f
chore: try to fix ws token error ( #530 )
...
* chore: try to fix ws token error
* chore: fix compile
* chore: bump version number
* chore: update
* chore: update
* ci: fix test
2024-05-07 16:45:12 +08:00
8870607569
Merge pull request #528 from AppFlowy-IO/email-link-reuse
...
feat: reuse email link
2024-05-06 15:04:12 +08:00
572271f751
feat: reuse email link
2024-05-06 14:18:36 +08:00
47e6f1e8b1
Update Yrs and AppFlowy-Collab ( #518 )
...
* chore: updated collab dependencies to v0.2
* chore: update collab to v0.2 and yrs to v0.18
* chore: pinned collab to specific revision
* chore: fix clippy errors
* chore: update commit id
---------
Co-authored-by: nathan <nathan@appflowy.io>
2024-05-06 11:30:02 +08:00
eba2e0d4db
ci: add test ( #516 )
...
* ci: add test
* ci: add test
* ci: add readme
* ci: update test
2024-05-02 21:30:23 +08:00
29928cb4a7
chore: add more detailed logging around errors in Transaction::try_encode_state_as_update_v1 ( #514 )
2024-05-01 20:14:27 +08:00
79bb510aaf
ci: run history test ( #513 )
...
* ci: run history test
* chore: fix ci
2024-05-01 16:28:07 +08:00
9adf3f883c
feat: improve email workspace invitations
2024-04-30 11:07:29 +08:00
c698f9720e
chore: add missing files
2024-04-29 23:37:18 +08:00
206c7a29ea
chore: merge with main
2024-04-29 23:35:03 +08:00
6e74449ab1
feat: accept workspace invite email
2024-04-29 19:40:20 +08:00
cbedbcb748
chore: patch for RUSTSEC-2024-0336 ( #503 )
2024-04-28 13:58:28 +08:00
e2fd049333
chore: awarenss with origin ( #498 )
2024-04-26 19:39:08 +08:00
7b4b9d0c10
chore: folder data check ( #496 )
...
* chore: folder data check
* chore: stop observe remote change when specific type of collaboration object override with incorrect data
* chore: commit sqlx file
2024-04-26 13:20:06 +08:00
54dfeb5527
chore: stop retry when current plugin is going to destory ( #495 )
2024-04-25 20:27:11 +08:00
fdaac9d4aa
chore: serde default for object_id
2024-04-24 14:01:29 +08:00
a0593b5502
chore: refactor return response with object id ( #494 )
...
* chore: refactor return response with object id
* chore: fix ci
* chore: fix ci
2024-04-24 12:07:54 +08:00
5f970a625a
chore: use rust 1.77 ( #493 )
2024-04-24 10:47:18 +08:00
1019b8c5b6
chore: update collab rev ( #490 )
2024-04-22 17:15:12 +08:00
ca70c42631
Merge pull request #488 from AppFlowy-IO/gotrue-error
...
fix: error message remove code
2024-04-22 12:40:56 +08:00
efbe9c4a93
chore: move collab rt crate ( #489 )
...
* chore: create appflowy collaborate crate
* chore: remove collab-rt
* chore: fmt
* chore: main
2024-04-22 12:14:41 +08:00
bd5b2e73be
Merge branch 'main' into gotrue-error
2024-04-22 12:06:16 +08:00
842e3d14e5
chore: remove collab state check ( #487 )
...
* chore: remove collab ping
* chore: fix tst
* chore: cacel previous actiont
2024-04-22 11:56:22 +08:00
ca8dcdfd55
fix: error message remove code
2024-04-22 11:28:30 +08:00
db23b64229
chore: broadcast check ( #485 )
...
* chore: check broadcast continuous
* chore: update log
* chore: update log
2024-04-21 19:31:24 +08:00
0de64f4f71
chore: enable multiple thread of collab-rt crate ( #484 )
2024-04-21 19:09:16 +08:00
1515ccdb80
chore: fix encode message ( #482 )
2024-04-21 14:23:31 +08:00
123484c864
chore: sync missing update from vector ( #481 )
2024-04-20 20:50:16 +08:00
9e1c06a5af
chore: update log ( #480 )
2024-04-20 10:53:35 +08:00
970fbaed57
feat: using transaction to write multiple records ( #477 )
...
* chore: impl batch write
* chore: update test
* chore: using save point to optimize write
* chore: update docs
* chore: fix test
* chore: increase write speed
* chore: use redis sorted set
* chore: fallback to write to disk directly when fail to queue
* chore: fix test
* chore: fix test
* chore: update log
* chore: add metrics
2024-04-19 15:22:57 +08:00
4168d72390
chore: using redis conn for each action ( #476 )
...
* chore: batch insert
* chore: opti redis conn
* chore: fix test
2024-04-17 11:41:50 +08:00
585bd83f1c
chore: update log
2024-04-16 21:10:16 +08:00
8ab7815740
chore: reduce pool lock ( #475 )
...
* chore: reduce pool lock
* chore: clippy
2024-04-16 20:26:26 +08:00
4d36f7e9e6
chore: fix potential sync issue ( #474 )
...
* chore: retry for handle message
* chore: retry when tring to lock the collab
2024-04-16 20:07:47 +08:00
0be4d2d5b5
ci: try to fix flaky test ( #473 )
...
* chore: update ping config
* chore: fix test
* chore: fix test
2024-04-16 18:20:36 +08:00
f3279e9b4e
feat: implement grpc for history server ( #470 )
...
* ci: docker compose for ci
* chore: add test
* chore: imple grpc
* chore: fix test
* chore: fix ci
2024-04-16 14:10:56 +08:00
5041f9f164
feat: support subscribe token ( #464 )
...
* feat: support subscribe token
* feat: support get collab
* feat: support browser rule for get collab
* fix: update collab version
2024-04-15 14:46:30 +08:00
3901356e8a
chore: bump collab version ( #471 )
2024-04-15 12:35:14 +08:00
28e0e74fd1
feat: Implement history(1) ( #466 )
...
* chore: update collab commit
* chore: collab history test
* chore: collab history test
* chore: impl redis stream
* chore: impl redis stream test
* chore: impl migration
* chore: implement history sql
* chore: add test
* chore: add test
* chore: fix test
* chore: update log and test
* chore: add xtask
* chore: clippy
* chore: impl api
* chore: add missing sqlx files
* chore: fix test
* chore: fix test
2024-04-15 09:18:19 +08:00
baeeb2c5ce
chore: do not wait insert to redis finish when calling get collab ( #468 )
2024-04-13 10:26:05 +08:00
ecbc935d4b
chore: using spawn blocking ( #467 )
2024-04-13 00:08:13 +08:00
9a5636caec
chore: get collab http ( #463 )
...
* chore: get collab http
* fix: use correct version
* fix: collab url
* feat: update collab access control middleware
2024-04-12 11:08:38 +08:00
85ac96a24b
chore: add comment for sign_in_with_magic_link
2024-04-10 11:07:14 +08:00
09469e86ca
feat: expose magic link api
2024-04-10 10:15:50 +08:00
e9097107e5
chore: Disable multi thread ( #458 )
...
* chore: disable multiple thread
* chore: clippy
2024-04-09 10:07:40 +08:00
bedae36f8e
chore: merge with main
2024-04-09 09:14:20 +08:00
84159e4c2c
chore: remove unused deps
2024-04-08 21:27:56 +08:00
c4c8911af2
chore: add test
2024-04-08 18:23:25 +08:00
131c9ed65f
chore: use join
2024-04-08 17:23:26 +08:00
b1c3d779ba
chore: reduce save collab db operations ( #455 )
...
* chore: reduce save collab db operations
* chore: clippy
* chore: add test
* chore: add test
* chore: add test
2024-04-08 14:50:51 +08:00
4c00236069
chore: enable logs in client api
2024-04-07 16:31:56 +08:00
Zack Fu Zi Xiang
Bartosz Sypytkowski
Nathan.fooo
Khor Shu Heng
nathan
Mathias Mogensen
Kilu.He
Lucas.Xu