Commit Graph

291 Commits

Author SHA1 Message Date
Nathan.fooo bbd21dfef6
chore: import mailer (#869)
* chore: import mailer

* chore: update template

* chore: config template

* fix: add missing config parameter

* chore: update template

* chore: show error with task id

* chore: show error with task id

---------

Co-authored-by: khorshuheng <solemnpriest@gmail.com>
2024-10-13 20:08:55 +08:00
Nathan.fooo 14cfaa0bbd
chore: insert metadata after import notion zip file (#871)
* chore: insert metadata after import notion zip file

* chore: update logs
2024-10-10 22:32:02 +08:00
Khor Shu Heng 8c14612f98
feat: refactor access control to enable swapping implementation (#859) 2024-10-10 13:04:47 +08:00
Nathan.fooo 98347b81ea
fix: import notion zip file as workspace (#868)
* chore: insert content length in header

* chore: custom header

* chore: workspace name

* chore: file name

* chore: handle file name that is not utf8 encode

* chore: clippy

* fix: end of file when unzip file

* chore: docs
2024-10-09 21:27:24 +08:00
Nathan.fooo 820db6564e
chore: create space view for imported notion zip file (#863) 2024-10-07 12:41:45 +08:00
Nathan.fooo 9c0dffacef
feat: implement import notion zip file api endpoint (#840)
* chore: implement api endpoint

* chore: worker

* chore: async zip

* chore: test bulk insert

* chore: insert collab

* chore: custom task

* chore: consume un acked message

* chore: fix compile

* chore: add test

* test: update

* chore: save import record

* chore: save import record

* chore: fix ci

* chore: remove unused deps

* chore: update docker file

* chore: build worker images

* chore: use small int

* chore: use small int

* chore: rm protoc deps in runtime

* chore: move collab cache to database crate

* chore: update test

* chore: rm health api endpoint

* chore: clippy

* chore: update ci

* chore: add test

* chore: upgrade collab

* chore: clippy

* chore: update test

* chore: use custom host

* chore: config nginx

* chore: install cert
2024-10-03 22:22:29 +08:00
Khor Shu Heng 11732324b5
feat: support fetching encoded collab in batch from memory (#837) 2024-10-02 10:22:40 +08:00
Zack Fu Zi Xiang 8523c8efcf
chore: update dep 2024-09-16 15:48:50 +08:00
Zack Fu Zi Xiang 5673faf604
chore: update deps 2024-09-16 15:15:18 +08:00
Zack Fu Zi Xiang ad68131223
chore: update dep 2024-09-16 12:06:52 +08:00
Zack Fu Zi Xiang 4345f8b2a5
chore: merge with main 2024-09-16 10:55:14 +08:00
Nathan.fooo 4c54481d70
chore: bump collab version (#822)
* chore: bump collab version

* chore: update deps count
2024-09-14 23:59:50 +08:00
Zack Fu Zi Xiang df66cfc6f4
chore: update dep 2024-09-13 14:51:15 +08:00
Zack Fu Zi Xiang def42240ae
fix: update dep 2024-09-12 22:58:31 +08:00
Zack Fu Zi Xiang f241c4a84f
chore: update dep and fix database row open 2024-09-12 21:14:24 +08:00
Zack Fu Zi Xiang 6406f42ff8
chore: update collab dep 2024-09-12 20:37:40 +08:00
Zack Fu Zi Xiang 0b5ad2162b
chore: use has document api from collab 2024-09-12 17:23:30 +08:00
Zack Fu Zi Xiang dca438b794
chore: update dep 2024-09-12 12:17:20 +08:00
Zack Fu Zi Xiang 3be80aac20
chore: update database collab 2024-09-12 12:05:20 +08:00
Zack Fu Zi Xiang 922418b122
chore: merge with main 2024-09-12 10:09:42 +08:00
Zack Fu Zi Xiang 306faad11e
feat: use database row body 2024-09-12 01:13:07 +08:00
Nathan.fooo 1ccff73e49
chore: bump appflowy collab (#814)
* chore: bump appflowy collab

* chore: fix build
2024-09-12 00:28:26 +08:00
Zack Fu Zi Xiang cff144a857
chore: add test for duplicating doc in database row 2024-09-11 16:38:24 +08:00
Nathan.fooo 7cd88b7502
fix: batch create collab api endpoint might cause tokio runtime issue (#810)
* fix: batch create collab api endpoint might cause tokio runtime issue

* chore: remove test

* chore: clippy
2024-09-11 11:32:42 +08:00
Nathan.fooo e742a9039a
chore: bump collab version (#807) 2024-09-10 11:18:20 +08:00
Nathan.fooo 3f59c650f4
chore: bump appflowy collab (#805)
* chore: bump appflowy collab

* chore: fix test

* chore: bump collab
2024-09-09 18:50:47 +08:00
Zack Fu Zi Xiang 206c2cadaf
chore: cargo deny check advisories 2024-09-05 12:06:57 +08:00
Zack 826546c5cb
feat: duplicate published doc (#700)
* chore: test collab sync

* feat: folder view for user workspace

* feat: add private indicator

* chore: use collab cache instead

* chore: initial impl

* chore: cargo sqlx

* fix: write back to collab cache

* fix: assign page id

* fix: text map

* chore: connect api and refactor

* chore: switch to using mem storage

* fix: collab type

* feat: use group manager to manage sync

* feat: try add send command instead

* chore: add client api code

* feat: try use sink and stream from group collab

* chore: disable sync first

* fix: insert page before stopping group

* feat: add extra for view

* feat: add metadata to doc

* fix: icon

* fix: page circular dep

* fix: page circular dep

* fix: live update

* feat: database initial impl

* feat: workspace database

* chore: link database

* fix: database validation

* fix: workspace database oid

* fix: workspace database oid

* fix: specify view layout

* feat: add txn when inserting collab and rework database views

* fix: parent view id for new database

* fix: database view for folder

* fix: database ids

* fix: database row id

* fix: main database layout and write database before folder

* fix: metadata for non database main view

* chore: database in doc wip

* chore: filter visible views

* chore: use structure value instead of json

* chore: database in doc wip

* fix: remove child item push

* fix: main database view meta

* chore: rework inline database in doc

* fix: make duplicate more error forgiving

* chore: use get instead of get key value

* chore: merge with main

* feat: set max depth for folder view

* chore: update dependency counter

* chore: remove unneeded arg

* chore: simplify collab new from source

* chore: remove unneeded param

* chore: rename and doc

* feat: rework inline database and use duplicated ref

* chore: simplify params

* chore: fmt

* feat: deduplicate database wip

* fix: compatible with newer appflowy version

* fix: database views

* feat: database in doc

* chore: cargo clippy

* chore: update dockerfile rust toolchain

* fix: doc inline db parent id

* fix: database id

* fix: document data modification

* chore: minor refactor and todo

* chore: remove unneeded nesting

* fix: enforce ordering for views to add

* chore: add doc and test case for folder view

* fix: remove the need for cloning published collab

* fix: some review

* chore: move folder conversion logic

* fix: remove collab folder deps on shared entity

* chore: cargo fmt

* fix: compile

* chore: remove group manager dependency

* fix: dep count

* fix: add messages sent by server

* fix: dep count

* chore: add test for doc ref and inline doc database

* chore: cargo clippy

* chore: add more test scenarios

* chore: fix tests

* chore: get database id

* chore: update collab

* chore: add more assert and database row id checks

* fix: suggestions from review

* chore: sqlx

* fix: accumulate collab before insert

* chore: add tokio spawn blocking for encoding

* fix: reduce limit for publish collabs

---------

Co-authored-by: Bartosz Sypytkowski <b.sypytkowski@gmail.com>
Co-authored-by: nathan <nathan@appflowy.io>
2024-09-03 09:12:29 +08:00
Nathan.fooo 1f9a03a83d
chore: enable lock timeout feature (#771) 2024-08-30 14:24:34 +08:00
nathan 8f7c35c491 chore: use main branch commit id 2024-08-29 16:14:35 +08:00
Bartosz Sypytkowski 2af1999375
chore: added locks with timeouts (#765)
* chore: added locks with timeouts

* chore: roll back collab locks in client api
2024-08-29 16:13:27 +08:00
Lucas.Xu e7bf221ff0
feat: update built-in README for new users (#757)
* feat: add getting_started, desktop_guide and mobile_guide json

* feat: update built-in readme data

* feat: support adding database as template

* feat: support creating nested documents

* chore: refactor code

* chore: refactor code

* chore: remove println

* chore: update collab version

* feat: update built-in readme and image ref

* chore: remove template icon

* feat: use database::create_with_view to create collab

* chore: add template tests

* chore: update collab version

* chore: remove debug code

* chore: add comment

* chore: fix lint & test

* fix: code review

* fix: rust lint

* chore: update comment

* test: add default workspace test

* test: add default user workspace test

* chore: use workspace database body

* chore: fix typo and clippy

* fix: insert_folder_data_success test

* fix: insert_folder_data_success test

* feat: update content in gettting_started

* chore: update to-dos json

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-08-28 19:40:23 +08:00
Bartosz Sypytkowski 5badffc97b
chore: update yrs and appflowy collab (#759)
* chore: update yrs and appflowy collab

* chore: increased allowed number of dependencies
2024-08-27 19:58:58 +08:00
Nathan.fooo 9ce5f2288a
chore: upgrade appflowy collab version (#751)
* chore: upgrade appflowy collab version
2024-08-26 21:20:39 +08:00
Khor Shu Heng 52f33e4d85
feat: endpoint for avatar upload (#736) 2024-08-23 16:36:09 +08:00
Nathan.fooo 1a053172c2
chore: write collab to disk after first sync step2 (#739)
* chore: write collab to disk after first sync step2

* chore: clippy

* chore: fix test & disable history plugin

* chore: upgrade appflowy collab that disbale document undo redo
2024-08-22 23:11:20 +08:00
Bartosz Sypytkowski ae3833ea91
chore: Remove last sync at (#735)
* chore: remove last sync at field

* chore: post rebase fixes

* chore: update test for missing update detection
2024-08-22 07:47:01 +08:00
nathan 1542fedcfe chore: upgrade appflowy coollab 2024-08-21 16:09:43 +08:00
Nathan.fooo 13355d6c21
chore: update collab version (#732) 2024-08-20 21:42:47 +08:00
nathan 2d7a4bde92 Merge branch 'main' into no-lock-collab 2024-08-19 10:38:07 +08:00
Nathan.fooo d342039cfd
chore: create user awareness when creating a new user (#728)
* chore: create user awareness when creating a new user

* chore: fix client api compile
2024-08-16 16:05:15 +08:00
Bartosz Sypytkowski 66838c47e3 chore: make collab plugins work over generic collab providers 2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski a8b80f33af chore: update appflowy collab dependencies 2024-08-13 19:59:48 +02:00
Bartosz Sypytkowski c27866fb25 chore: upgrade code to use asynchronous locks 2024-08-13 19:59:46 +02:00
Nathan.fooo 71d292ebcd
chore: add app version when querying ai configuratino (#724)
* chore: update api endpoint that accepts app version

* chore: update env

* chore: disable locai ai config test
2024-08-13 11:14:32 +08:00
Khor Shu Heng 21bbfa828e
chore: update sqlx to 0.8 (#710)
* chore: update sqlx to 0.8

* fix: handle potential encoding error during add args

* chore: more description for SqlxArgEncodingError
2024-08-05 23:44:11 +08:00
Khor Shu Heng ca6490c1ac
feat: deserialization for entities used in collab stream (#682) 2024-07-30 17:08:48 +08:00
Bartosz Sypytkowski ddf3973f5c chore: bump collab dependencies 2024-07-17 11:15:39 +02:00
Bartosz Sypytkowski f083f9d88b chore: bump yrs to 0.19.2 2024-07-17 11:12:56 +02:00
Nathan.fooo eebdbcad79
chore: add api endpoint for local ai config (#678)
* chore: add api endpoint for local ai config

* chore: fix ci

* chore: api endpoint for download local ai config

* chore: update ci

* chore: ensure client version

* chore: update test
2024-07-15 08:30:11 +08:00
Bartosz Sypytkowski 44406ccdae
chore: update yrs and appflowy-collab (#677)
* chore: update yrs and appflowy-collab

* chore: remove wasm compilation target

* chore: fixed number conversion in tests

* chore: remove wasm integration tests

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-07-10 10:10:07 +08:00
Bartosz Sypytkowski 42b3cca886 chore: remove appflowy indexer service 2024-06-28 05:40:44 +02:00
Khor Shu Heng bdae165849
feat: add post realtime message stream handler to independent collab ws (#647) 2024-06-25 13:30:05 +08:00
Khor Shu Heng 6e3f666ce4
feat: independent collab websocket server (#640) 2024-06-24 13:59:51 +08:00
Zack Fu Zi Xiang f2f3695cfb
chore: try use stream feature flag 2024-06-20 12:32:51 +08:00
Zack Fu Zi Xiang 31f5c786a6
chore: merge with main 2024-06-20 11:20:16 +08:00
Zack Fu Zi Xiang d4dd350da1
feat: batch publish item with metadata 2024-06-20 11:15:08 +08:00
Nathan.fooo 30f87457f3
feat: support uploading file with multiple part (#625)
* refactor: replace crate

* chore: remove s3-rust crate

* chore: test multiple upload

* chore: client api

* chore: client api

* chore: v1 version upload,download

* chore: fix test

* chore: fix test

* chore: remove workspace test

* chore: fix wasm build

* chore: update path

* chore: update path

* chore: rename

* chore: expose file entity

* chore: introduce client-api-entity

* chore: fix build

* chore: new url

* chore: fix test

* chore: merge main

* chore: fix clippy
2024-06-19 13:06:58 +08:00
Bartosz Sypytkowski 0e50650aa8 chore: use appflowy ai client for embeddings in search api 2024-06-18 10:51:11 +02:00
Zack 9d3d28ad89
chore: move billing to client api http (#619) 2024-06-13 14:38:58 +08:00
Zack 6471831561
chore: move billing client (#618)
* chore: move billing client

* chore: cargo fmt
2024-06-13 13:19:40 +08:00
Nathan.fooo d0467e7e2e
feat: Stream chat message (#610)
* chore: test stream

* chore: fix test

* chore: fix test

* chore: add log

* chore: fix parsing

* chore: fix parsing

* chore: fix parsing

* chore: create answer

* chore: create answer
2024-06-08 22:51:19 +08:00
Khor Shu Heng a6bcbd583f
chore: share library for authentication (#576)
* chore: share library for authentication

* fix: return error from requesting app data instead of unwrap

* fix: return internal server error when jwt secret is missing

* chore: remove argon dep from main crate

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-29 16:00:21 +08:00
Bartosz Sypytkowski d3e59fa801
feat: Appflowy-indexer service and /api/search endpoint (#582)
* feat: implement appflowy-indexer and search api endpoint

* chore: store embedding content type

* chore: more descriptive messages for open ai missing key

* chore: fix sqlx errors in tests

* chore: document watcher - change plain text rendering to use depth-first scan

* chore: added nested document blocks example
2024-05-28 21:09:29 +08:00
Nathan.fooo ae3e075475
chore: Integrate with client-api, update chat message (#574)
* chore: update

* chore: get chat message with next back option

* chore: update next back

* chore: return answer

* chore: return answer

* chore: return answer

* chore: update client api

* chore: fix ci
2024-05-24 15:04:50 +08:00
Khor Shu Heng fbdcbd6e08
chore: migrate collab actors to appflowy-collaborate (#556) 2024-05-17 12:22:43 +08:00
Nathan.fooo 2fae260e4f
chore: complete text endpoints (#557)
* chore: complete text endpoints
2024-05-16 22:48:44 +08:00
Khor Shu Heng c79267d42a
feat: migrate collab access control to collaboration service (#548)
* feat: migrate collab access control to collaborate service

* feat: migrate workspace access control to separate crate
2024-05-15 15:24:07 +08:00
Nathan.fooo d994b10115
chore: appflowy ai client (#547)
* chore: appflowy ai client

* chore: clippy

* chore: clippy

* chore: fix ci

* chore: disable index search
2024-05-12 09:23:32 +08:00
Nathan.fooo 4c00ddd593
chore: Chat history (#546)
* chore: imple sql curd

* chore: update chat

* chore: select messages

* chore: update test

* chore: update schema

* chore: update
2024-05-11 20:41:21 +08:00
Nathan.fooo ef96b42e43
chore: Collab patch (#541)
* chore: bump collab

* chore: use patch

* chore: update collab
2024-05-09 15:16:07 +08:00
Nathan.fooo 70262a1ac4
chore: try to not block actor mailbox (#534)
* chore: add test

* chore: spawn task to handle message

* chore: update error message
2024-05-08 16:54:05 +08:00
Bartosz Sypytkowski 47e6f1e8b1
Update Yrs and AppFlowy-Collab (#518)
* chore: updated collab dependencies to v0.2

* chore: update collab to v0.2 and yrs to v0.18

* chore: pinned collab to specific revision

* chore: fix clippy errors

* chore: update commit id

---------

Co-authored-by: nathan <nathan@appflowy.io>
2024-05-06 11:30:02 +08:00
nathan a9d49403ae chore: remove unused code 2024-05-05 10:14:41 +08:00
Nathan.fooo 79bb510aaf
ci: run history test (#513)
* ci: run history test

* chore: fix ci
2024-05-01 16:28:07 +08:00
Zack Fu Zi Xiang 206c7a29ea
chore: merge with main 2024-04-29 23:35:03 +08:00
Zack Fu Zi Xiang 6e74449ab1
feat: accept workspace invite email 2024-04-29 19:40:20 +08:00
Khor Shu Heng cbedbcb748
chore: patch for RUSTSEC-2024-0336 (#503) 2024-04-28 13:58:28 +08:00
Nathan.fooo e2fd049333
chore: awarenss with origin (#498) 2024-04-26 19:39:08 +08:00
Nathan.fooo 7b4b9d0c10
chore: folder data check (#496)
* chore: folder data check

* chore: stop observe remote change when specific type of collaboration object override with incorrect data

* chore: commit sqlx file
2024-04-26 13:20:06 +08:00
Nathan.fooo 54dfeb5527
chore: stop retry when current plugin is going to destory (#495) 2024-04-25 20:27:11 +08:00
nathan 93f3a63891 chore: disable multi thread feature 2024-04-24 13:43:17 +08:00
Nathan.fooo a0593b5502
chore: refactor return response with object id (#494)
* chore: refactor return response with object id

* chore: fix ci

* chore: fix ci
2024-04-24 12:07:54 +08:00
Nathan.fooo 1019b8c5b6
chore: update collab rev (#490) 2024-04-22 17:15:12 +08:00
Nathan.fooo efbe9c4a93
chore: move collab rt crate (#489)
* chore: create appflowy collaborate crate

* chore: remove collab-rt

* chore: fmt

* chore: main
2024-04-22 12:14:41 +08:00
Nathan.fooo 0de64f4f71
chore: enable multiple thread of collab-rt crate (#484) 2024-04-21 19:09:16 +08:00
Nathan.fooo 970fbaed57
feat: using transaction to write multiple records (#477)
* chore: impl batch write

* chore: update test

* chore: using save point to optimize write

* chore: update docs

* chore: fix test

* chore: increase write speed

* chore: use redis sorted set

* chore: fallback to write to disk directly when fail to queue

* chore: fix test

* chore: fix test

* chore: update log

* chore: add metrics
2024-04-19 15:22:57 +08:00
Nathan.fooo f3279e9b4e
feat: implement grpc for history server (#470)
* ci: docker compose for ci

* chore: add test

* chore: imple grpc

* chore: fix test

* chore: fix ci
2024-04-16 14:10:56 +08:00
Nathan.fooo 3901356e8a
chore: bump collab version (#471) 2024-04-15 12:35:14 +08:00
Nathan.fooo 28e0e74fd1
feat: Implement history(1) (#466)
* chore: update collab commit

* chore: collab history test

* chore: collab history test

* chore: impl redis stream

* chore: impl redis stream test

* chore: impl migration

* chore: implement history sql

* chore: add test

* chore: add test

* chore: fix test

* chore: update log and test

* chore: add xtask

* chore: clippy

* chore: impl api

* chore: add missing sqlx files

* chore: fix test

* chore: fix test
2024-04-15 09:18:19 +08:00
nathan 84159e4c2c chore: remove unused deps 2024-04-08 21:27:56 +08:00
Nathan.fooo b1a6338527
refactor: actix-ws (#453)
* chore: deduplicate ws message

* chore: remove retry when sending client ws message

* chore: prepare client/server actor test
2024-04-07 12:43:29 +08:00
Nathan.fooo 428c3feef2
chore: create default workspace database (#454)
* chore: create default workspace database

* chore: fix clppy
2024-04-06 21:04:12 +08:00
Nathan.fooo bdee9fa8dc
feat: add feature brotli (#452)
* feat: add feature brotli

* chore: update reqwest version

* chore: update actix-http

* chore: fix wasm build
2024-04-06 16:43:38 +08:00
Nathan.fooo 6b7af44370
chore: enable multiple thread (#451)
* chore: enable multiple thread

* chore: fix test

* chore: fix test
2024-04-06 15:13:15 +08:00
Nathan.fooo 01f1af98f5
chore: wrapper for collab (#448)
* chore: wrapper for collab

* chore: add tests

* chore: fix audit

* chore: init sync

* chore: disable wasm user test

* chore: disable encode state when start

* chore: fix test
2024-04-05 11:30:00 +08:00
Nathan.fooo feb993e5b9
chore: add tests (#442) 2024-04-03 22:16:03 +08:00
Nathan.fooo c77329ea11
chore: encode collab with validate check (#439)
* chore: bump collab

* chore: fix test

* chore: fix test
2024-04-03 09:07:35 +08:00
Nathan.fooo 12d72fa233
chore: client api init sync (#438)
* chore: implement init sync for sync plugin

* chore: bump collab

* chore: bump collab

* chore: fix test
2024-04-02 23:08:15 +08:00
nathan 0da1b2433b chore: enable test feature when running test 2024-04-02 15:37:34 +08:00