8c6a657f03
fix: trim awareness when collab group is dropped
2025-01-15 00:54:49 +08:00
a0bed04685
chore: add prometheus histogram metrics for collab redis update read latency
2024-12-31 14:18:42 +01:00
4550cae2b1
chore: cherry pick github pr 1054
2024-12-27 10:07:01 +01:00
c94938ee46
chore: fix clippy errors
2024-12-27 07:52:10 +01:00
1a5c1714db
Merge branch 'main' into stateless
2024-12-24 14:59:04 +08:00
1131818eb7
fix: support index document in the background, fix stack overflow when calling rayon::spawn ( #1099 )
...
* chore: batch index
* chore: format log
* chore: index workspace
* chore: fix stack overflow
* chore: background index
* chore: clippy
* chore: filter tasks
* chore: clippy
* chore: add metrics
* chore: fix test
2024-12-24 14:30:17 +08:00
837f4de8f3
chore: remove gc check
2024-12-23 14:57:52 +01:00
35430c6be2
chore: remove doing snapshots in collab group periodic saves
2024-12-23 13:02:23 +01:00
9c40c3128b
chore: clippy
2024-12-20 11:08:01 +08:00
011a5b59c9
chore: rename data to doc_state
2024-12-20 10:22:08 +08:00
971aa6d3e1
chore: map error
2024-12-20 10:13:16 +08:00
9d6b272656
chore: merge main into stateless branch
2024-12-19 06:52:20 +01:00
6fa6fa00cb
chore: refactor page view APIs to write to in-memory collab group ( #1083 )
2024-12-18 22:47:25 +08:00
6c2ce8fc3c
chore: fix snapshot s3 read and write
2024-12-17 18:22:20 +01:00
abf827f2a6
chore: query multiple collab embedding state ( #1081 )
...
* chore: query multiple collab embedding state
* chore: clippy
2024-12-17 23:23:43 +08:00
e85e60c0f2
chore: revert from editing collab
2024-12-17 05:43:04 +01:00
d120860312
chore: remove state vector from redis udpates
2024-12-17 04:29:41 +01:00
73872a2b1d
chore: post merge fixes
2024-12-16 08:48:09 +01:00
1b35326f0a
Merge branch 'main' into stateless
2024-12-16 04:47:26 +01:00
ec9c38254b
chore: open ai call directly ( #1074 )
...
* chore: use open ai embedding
* chore: update test
* chore: retry
* chore: metrics
* chore: clippy
* chore: env
* chore: delete test
2024-12-15 23:29:46 +08:00
2ab1e94b99
chore: create embed in background ( #1071 )
...
* refactor: create indexer scheduler
* refactor: replace current calls
* chore: use rayon thread pool
* chore: index unindexed collab using thread pool
* chore: index collab when write to disk
* chore: add test
* chore: add test
* chore: add test
* chore: fix client api deps
* chore: chat with document test
* chore: fix test
* chore: clippy
* chore: update test
2024-12-15 12:29:51 +08:00
ed07104aeb
chore: remove from editing collab param in get encode collab method
2024-12-14 09:42:15 +01:00
dfe780d30c
chore: fix linter errors
2024-12-14 09:22:42 +01:00
41e9302ff9
Merge branch 'main' into stateless
2024-12-12 16:00:45 +01:00
af38efe6d9
feat: sync document through http request ( #1064 )
...
* chore: query embedding
* chore: create embeddings
* chore: apply update to editing collab
* refactor: web-update
* chore: calculate missing update the sv is not none
* chore: add test
* chore: fix audit
* chore: commit sqlx
* chore: fix client api
* test: add
* chore: clippy
* chore: fix collab drop when save
2024-12-12 14:53:07 +08:00
254bc23a6e
feat: insert database row into selected database ( #1029 )
...
* feat: insert database row into selected database
* feat: inserting database row
* feat: add impl for cell
* feat: insert row selection and mulitselection
* feat: support datetime field type
* fix: other fields like rich text
* feat: add database field server impl
* feat: add client api and tests
* feat: use to json value impl from collab
* feat: use add database cell impl from collab
* feat: update to latest collab
* chore: upgrade collab and fix tests
* chore: review issues
* fix: code review feedback
* feat: filter only allow supported field types
* feat: support more field types
* feat: support created at and last modified
* feat: add timestamp cell for created at and modified at fields
* chore: linting and formatting
* fix: add created at and last modified
* fix: ci add service dependency of appflowy cloud on admin frontend
* chore: trigger ci
* feat: add logging for admin frontend client signin
* fix: server logs if error
* fix: create admin confirmation without email
* fix: ci add service dependency of appflowy cloud on admin frontend
* fix: server logs if error
* chore: update collab
2024-12-11 15:47:29 +08:00
813179fdb0
chore: Remove async awaits from RealtimeServerActor ( #1059 )
...
* chore: reduce number of async await methods in connection manager
* chore: remove async handlers from rt actor
2024-12-10 15:20:28 +08:00
29cb70a362
fix: synchronization issue due to incorrect collab origin ( #1054 )
2024-12-09 14:19:00 +08:00
b2f8a95ec4
chore: setup new collab in the db
2024-12-05 06:29:19 +01:00
5e7b5f87fa
chore: merge branch main into stateless
2024-12-03 09:10:01 +01:00
9ff6f1c744
S3 collab cache ( #1028 )
...
* chore: collab cache for S3
* chore: adjust disk cache api to accomodate s3
* chore: move postgres dependent ops to disk cache
* chore: replace blob inserts from pg to s3
* chore: delete blob and collab exist now use s3
* chore: fix clippy erorrs
* chore: post rebase fixes
* chore: fix clippy warnings
* chore: fix imports
* chore: make snapshots work over S3
* chore: remove dead code
* chore: use compressed snapshots
* chore: add zstd compression
* chore: introduce collab size threshold to keep smaller collabs in postgres
* chore: remove collabs from S3 if they were put to postgres
* chore: update tests
2024-12-03 13:08:55 +08:00
3e3bf693fd
chore: upload api endpoint for web upload ( #1024 )
...
* chore: upload api endpoint for web upload
* chore: use rust 1.78
* fix: test
2024-11-28 09:09:09 +08:00
d6317813d7
chore: allow dead code
2024-11-20 09:06:00 +01:00
b91a5fac8e
chore: post merge fixes
2024-11-20 08:56:16 +01:00
d0f9059f3f
Merge branch 'main' into stateless
2024-11-20 08:36:28 +01:00
655f13bc27
chore: search and chat ( #999 )
...
* chore: add test for search and chat
* chore: update test
* chore: update test
* chore: update ci
* chore: fix security audio
* chore: multiple core docker build
* chore: multiple core docker build
* chore: update ci
* chore: update model setting
* chore: test ci
* chore: use tiktoken to calcualte token length
* chore: remove env
* chore: use spawn_blocking with condition
* chore: docs
* chore: clippy
* chore: clippy
* chore: docker logs
* chore: pass message id
* chore: clippy
2024-11-16 14:52:12 +08:00
06b7ce0a29
chore: post merge fixes
2024-11-16 07:33:18 +01:00
401cc3ad25
Merge branch 'main' into stateless
2024-11-16 07:22:34 +01:00
91b0c50722
chore: remove logs ( #986 )
2024-11-13 13:59:23 +08:00
9778843746
chore: disable history service ( #985 )
...
* chore: disable history service
* chore: fix build
2024-11-13 10:46:15 +08:00
eb54947ab7
chore: add config option for redis stream group workers count
2024-11-08 04:39:44 +01:00
b9ca480143
chore: add retry limit to which collab snapshot can be made
2024-11-07 13:12:17 +01:00
bc49d73b40
chore: split redis stream readers to active and one shot
2024-11-07 11:43:19 +01:00
3fc49a8b21
chore: turn off collab preindexing
2024-11-06 10:10:55 +01:00
99203cc7f3
chore: fix flaky tests
2024-11-05 07:48:14 +01:00
25f0461389
chore: added metrics for new stateless operations
2024-11-05 07:48:14 +01:00
e86c9de316
chore: when saving collab snapshot, do not load it unless there are pending updates in redis
2024-11-05 07:48:14 +01:00
961c482995
chore: prevent hot loops in collab updates stream
2024-11-05 07:48:14 +01:00
2511bd720d
chore: fix clippy errors
2024-11-05 07:48:14 +01:00
ce793fa03e
chore: make collab group prune grace period configurable
2024-11-05 07:48:14 +01:00
khorshuheng
Bartosz Sypytkowski
nathan
Nathan.fooo
Khor Shu Heng
Zack