GO-4486 migrating filestore to fileobject #1990

deff7 · 2025-01-06T15:30:50Z

No description provided.

… other spaces

… into go-4486-research-migrating-filestore

… of github.com:anyproto/anytype-heart into go-4486-research-migrating-filestore

…o-4486-research-migrating-filestore-fileobject

go-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/fileobject/file.go # core/block/export/export.go # core/block/import/importer.go # core/files/fileobject/fileindex.go # core/files/fileobject/fileindex_test.go # core/files/fileobject/filemodels/filerequest.go # core/files/fileobject/service.go # core/files/fileoffloader/offloader.go # core/files/mock_files/mock_File.go # core/files/mock_files/mock_Image.go # space/internal/components/personalmigration/personalmigration.go

…l-details-structure' into go-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/import/importer_test.go # pkg/lib/bundle/relation.gen.go

…l-details-structure' into go-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/factory.go # core/files/fileobject/service_test.go # pkg/lib/bundle/relation.gen.go # pkg/lib/bundle/relations.json

go-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/files.go # core/file.go # core/files/fileobject/fileindex.go

…o-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/basic/details.go # core/block/editor/file/file.go # core/block/editor/state/state.go # core/block/import/common/objectid/oldfile.go # core/files/filesync/stats.go # core/files/filesync/upload.go

github-actions · 2025-01-06T15:45:01Z

Previous Coverage	50.7% of statements
New Coverage	50.8% of statements
Patch Coverage	48.0% of changed statements (234/487)

^{Coverage provided by https://github.com/seriousben/go-patch-cover-action}

…o-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/state/state.go # pkg/lib/bundle/relation.gen.go

…o-4486-research-migrating-filestore-fileobject # Conflicts: # core/publish/service_test.go # pkg/lib/bundle/relation.gen.go # pkg/lib/gateway/gateway.go

…-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/files.go # core/files/fileobject/fileindex_test.go

github-actions · 2025-02-20T11:18:59Z

	🔴 SMOKE-TEST FAILED
Tests	✔️ 16 tests run
Summary	🔴 15 failed; 🟢 1 passed; 🟡 0 skipped
Duration	🕐 21 minutes, 43 seconds
Testomat.io Report	📊 Run #e8429c55
Job	🗂️ Smoke Tests / smoke-test
Operating System	🖥️ `Linux` X64

✅ Passed Tests (1)

Owner changes the rights of a user from Viewer to Editor (1 minute, 45 seconds) Passed on retry: 2

🟥 Failures (15)

🔴 Revoking an invite link

################[ Steps ]################
Given the server "default" 1 is running (138406.87ms)
And the user 1 is using client 1 (0.66ms)
And the user creates a new account on "staging" (1418.50ms)
And the account is synced within 60 seconds (62022.57ms)
Given the user has shared his space and generated an invite link (0.00ms)
When the user revokes the invite link (0.00ms)
Then the invite link should be invalid (0.00ms)
And the account is deleted (0.00ms)
And the server 1 is stopped (0.00ms)

🔴 Revoking an invite link (Will be retried 🔄)

################[ Steps ]################
Given the server "default" 1 is running (3314.65ms)
And the user 1 is using client 1 (0.39ms)
And the user creates a new account on "staging" (1436.24ms)
And the account is synced within 60 seconds (62049.63ms)
Given the user has shared his space and generated an invite link (0.00ms)
When the user revokes the invite link (0.00ms)
Then the invite link should be invalid (0.00ms)
And the account is deleted (0.00ms)
And the server 1 is stopped (0.00ms)

🔴 User cancels their join request

################[ Steps ]################
Given the server "default" 1 is running (3334.84ms)
And the user 1 is using client 1 (0.36ms)
And the user creates a new account on "staging" (1408.28ms)
And the account is synced within 60 seconds (62036.58ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
And the user cancels their join request (0.00ms)
And the user 1 is using client 1 (0.00ms)
Then there is no request pending for joining the space (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 User cancels their join request (Will be retried 🔄)

################[ Steps ]################
Given the server "default" 1 is running (3350.11ms)
And the user 1 is using client 1 (0.34ms)
And the user creates a new account on "staging" (1403.92ms)
And the account is synced within 60 seconds (62107.08ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
And the user cancels their join request (0.00ms)
And the user 1 is using client 1 (0.00ms)
Then there is no request pending for joining the space (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 User deletes the space and rejoins later

################[ Steps ]################
Given the server "default" 1 is running (3352.62ms)
And the user 1 is using client 1 (0.29ms)
And the user creates a new account on "staging" (1421.73ms)
And the account is synced within 60 seconds (62050.62ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 approves the join request of user 2 with "Viewer" rights (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user 2 leaves the shared space (0.00ms)
And the user sends requests to join the space (0.00ms)
Then the request is automatically approved as "Viewer" again (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 User deletes the space and rejoins later (Will be retried 🔄)

################[ Steps ]################
Given the server "default" 1 is running (3340.31ms)
And the user 1 is using client 1 (0.27ms)
And the user creates a new account on "staging" (1421.61ms)
And the account is synced within 60 seconds (62064.40ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 approves the join request of user 2 with "Viewer" rights (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user 2 leaves the shared space (0.00ms)
And the user sends requests to join the space (0.00ms)
Then the request is automatically approved as "Viewer" again (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Owner changes the rights of a user from Viewer to Editor

################[ Steps ]################
Given the server "default" 1 is running (3424.80ms)
And the user 1 is using client 1 (0.23ms)
And the user creates a new account on "staging" (1435.98ms)
And the account is synced within 60 seconds (62082.28ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 approves the join request of user 2 with "Viewer" rights (0.00ms)
And the user 1 changes the rights of user 2 from "Viewer" to "Editor" (0.00ms)
And the user 2 is using client 2 (0.00ms)
Then the user can open the object 1 (0.00ms)
And the user can rename the object 1 (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Owner approves a join request with Editor permissions

################[ Steps ]################
Given the server "default" 1 is running (3548.65ms)
And the user 1 is using client 1 (0.23ms)
And the user creates a new account on "staging" (1456.77ms)
And the account is synced within 60 seconds (62024.91ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 approves the join request of user 2 with "Editor" rights (0.00ms)
And the user 2 is using client 2 (0.00ms)
Then the user can open the object 1 (0.00ms)
And the user can rename the object 1 (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Owner approves a join request with Editor permissions (Will be retried 🔄)

################[ Steps ]################
Given the server "default" 1 is running (3398.70ms)
And the user 1 is using client 1 (0.23ms)
And the user creates a new account on "staging" (1422.98ms)
And the account is synced within 60 seconds (62100.26ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 approves the join request of user 2 with "Editor" rights (0.00ms)
And the user 2 is using client 2 (0.00ms)
Then the user can open the object 1 (0.00ms)
And the user can rename the object 1 (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Owner declines a join request

################[ Steps ]################
Given the server "default" 1 is running (3519.97ms)
And the user 1 is using client 1 (0.22ms)
And the user creates a new account on "staging" (1483.00ms)
And the account is synced within 60 seconds (62023.10ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 declines the join request of user 2 (0.00ms)
And the user 2 is using client 2 (0.00ms)
Then the user can't open the object 1 (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Owner declines a join request (Will be retried 🔄)

################[ Steps ]################
Given the server "default" 1 is running (3402.90ms)
And the user 1 is using client 1 (0.20ms)
And the user creates a new account on "staging" (1446.64ms)
And the account is synced within 60 seconds (62084.02ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 declines the join request of user 2 (0.00ms)
And the user 2 is using client 2 (0.00ms)
Then the user can't open the object 1 (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Owner removes a participant from the space

################[ Steps ]################
Given the server "default" 1 is running (3441.24ms)
And the user 1 is using client 1 (0.24ms)
And the user creates a new account on "staging" (1452.29ms)
And the account is synced within 60 seconds (62094.45ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 approves the join request of user 2 with "Editor" rights (0.00ms)
When the user 1 removes the user 2 from the space (0.00ms)
And the user 2 is using client 2 (0.00ms)
Then the user can't open the object 1 (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Owner removes a participant from the space (Will be retried 🔄)

################[ Steps ]################
Given the server "default" 1 is running (3506.96ms)
And the user 1 is using client 1 (0.22ms)
And the user creates a new account on "staging" (1456.20ms)
And the account is synced within 60 seconds (62113.75ms)
Given the user creates an object 1 in the account (0.00ms)
And the user can open the object 1 (0.00ms)
And the user has shared his space and generated an invite link (0.00ms)
And the account is synced within 60 seconds (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user 2 is using client 2 (0.00ms)
And the user creates a new account on "staging" (0.00ms)
And the user sends requests to join the space (0.00ms)
When the user 1 approves the join request of user 2 with "Editor" rights (0.00ms)
When the user 1 removes the user 2 from the space (0.00ms)
And the user 2 is using client 2 (0.00ms)
Then the user can't open the object 1 (0.00ms)
And both accounts are deleted (0.00ms)
And both servers are stopped (0.00ms)

🔴 Sync on staging nodes

################[ Steps ]################
Given the server "default" 1 is running (3438.97ms)
And the user is using client 1 (0.27ms)
And the user creates a new account on "staging" (1432.73ms)
And the user creates an object 1 in the account (7.32ms)
And the user can open the object 1 (10006.07ms)
And the account is synced within 80 seconds (82093.83ms)
And the server 1 is stopped (0.00ms)
And data is deleted (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user is using client 2 (0.00ms)
When the user logs in to their account on "staging" (0.00ms)
Then the account should have an analyticsId, profile picture and name (0.00ms)
Then the user can open the object 1 (0.00ms)
And the account is deleted (0.00ms)
And the server 2 is stopped (0.00ms)

🔴 Sync on staging nodes (Will be retried 🔄)

################[ Steps ]################
Given the server "default" 1 is running (3419.85ms)
And the user is using client 1 (0.25ms)
And the user creates a new account on "staging" (1428.94ms)
And the user creates an object 1 in the account (8.02ms)
And the user can open the object 1 (10004.90ms)
And the account is synced within 80 seconds (82111.21ms)
And the server 1 is stopped (0.00ms)
And data is deleted (0.00ms)
And the server "default" 2 is running (0.00ms)
And the user is using client 2 (0.00ms)
When the user logs in to their account on "staging" (0.00ms)
Then the account should have an analyticsId, profile picture and name (0.00ms)
Then the user can open the object 1 (0.00ms)
And the account is deleted (0.00ms)
And the server 2 is stopped (0.00ms)

deff7 added 30 commits November 13, 2024 12:19

GO-4487: Fix space offload: do not offload files that are existing in…

61b9c57

… other spaces

GO-4486: Store file index inside object

83d3eed

GO-4486: Fix deduplication queries

0e5ef07

GO-4486: Fix indexing

9db84ef

GO-4389: Remove file store methods

62b33a5

GO-4486 Merge branch 'go-4389-do-not-create-entry-space-for-new-users'…

680be79

… into go-4486-research-migrating-filestore

GO-4389: Temporarily solution

34be360

GO-4389: Pass encryption keys directly

32f04bc

GO-4389: Remove useless methods from filestore

b175ddb

GO-4389: Move file keys methods to objectstore

8a7b42b

GO-4486 Merge branch 'go-4389-do-not-create-entry-space-for-new-users'…

26e7876

… of github.com:anyproto/anytype-heart into go-4486-research-migrating-filestore

GO-4389: Fix file keys methods

b47c3d5

GO-4486: Remove filestore completely

f165dc1

GO-4486: Fix some tests

e965dd5

GO-4486: Encapsulate to fileobject part 1

bfc5707

GO-4486: Encapsulate to fileobject part 2

a339450

GO-4486: Refactor usage of encryption keys

c9a4da8

GO-4486: Fix panic

22d3eeb

GO-4486 Merge branch 'main' of github.com:anyproto/anytype-heart into g…

ef58e75

…o-4486-research-migrating-filestore-fileobject

GO-4486: Fix some tests

e18e061

GO-4486: Refactor

a4fd2c1

GO-4486: Clean up

315ff10

GO-4486: Fix build after merging details

c9edd89

GO-4486: Refactoring

5187c6e

GO-4486: Fix tests

f32054f

GO-4486: Fix tests #2

2a829e0

GO-4486: Fix some tests

17d2d7c

GO-4486: Simplify indexing of freshly uploaded files

30ec800

GO-4486: Fix test

76d0fed

deff7 added 18 commits November 27, 2024 11:37

GO-4486: Fix test

079a73e

GO-4486: Fix icon and cover details

958dbb7

GO-4486: Fix coverId parsing

b67bfd0

GO-4486: Fix file name

014d7c5

GO-4486: Fix some tests

ede9d10

GO-4486: Refactor and fix some tests

a8a0cac

GO-4486: More fixes

b809192

GO-4486: Refactor project structure for some file packages

5854528

GO-4486: Fix test

31d48a7

GO-4486 Merge remote-tracking branch 'origin/go-4144-refactor-interna…

79d64ed

…l-details-structure' into go-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/import/importer_test.go # pkg/lib/bundle/relation.gen.go

GO-4486: Fix some tests

07c9a92

GO-4486: Fix some tests

63c8c13

GO-4486: Fix after merge

a7c6e13

GO-4486 Merge branch 'go-4144-refactor-internal-details-structure' into

7afd89e

go-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/files.go # core/file.go # core/files/fileobject/fileindex.go

GO-4486: Fix after build

29b37d2

GO-4486: Fix migration

faa83ba

deff7 added 6 commits February 6, 2025 12:31

GO-4486 Merge branch 'main' of github.com:anyproto/anytype-heart into g…

7379e52

…o-4486-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/state/state.go # pkg/lib/bundle/relation.gen.go

GO-4486: WIP try to fix tests

8f8b15c

GO-4486: Fix tests

6ecfa6c

GO-4486 Merge branch 'main' of github.com:anyproto/anytype-heart into g…

78c55a9

…o-4486-research-migrating-filestore-fileobject # Conflicts: # core/publish/service_test.go # pkg/lib/bundle/relation.gen.go # pkg/lib/gateway/gateway.go

Merge branch 'main' of github.com:anyproto/anytype-heart into go-4486…

f728a23

…-research-migrating-filestore-fileobject # Conflicts: # core/block/editor/files.go # core/files/fileobject/fileindex_test.go

GO-4486: Publish server: fix tests

163bb12

deff7 added 2 commits February 27, 2025 10:22

GO-4486: Traffic monitor

fd93457

GO-4486: Fix migration start condition

aa8b070

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

GO-4486 migrating filestore to fileobject #1990

GO-4486 migrating filestore to fileobject #1990

deff7 commented Jan 6, 2025

github-actions bot commented Jan 6, 2025 •

edited

Loading

github-actions bot commented Feb 20, 2025

✅ Passed Tests (1)

🟥 Failures (15)

🔴 Revoking an invite link

🔴 Revoking an invite link (Will be retried 🔄)

🔴 User cancels their join request

🔴 User cancels their join request (Will be retried 🔄)

🔴 User deletes the space and rejoins later

🔴 User deletes the space and rejoins later (Will be retried 🔄)

🔴 Owner changes the rights of a user from Viewer to Editor

🔴 Owner approves a join request with Editor permissions

🔴 Owner approves a join request with Editor permissions (Will be retried 🔄)

🔴 Owner declines a join request

🔴 Owner declines a join request (Will be retried 🔄)

🔴 Owner removes a participant from the space

🔴 Owner removes a participant from the space (Will be retried 🔄)

🔴 Sync on staging nodes

🔴 Sync on staging nodes (Will be retried 🔄)

GO-4486 migrating filestore to fileobject #1990

Are you sure you want to change the base?

GO-4486 migrating filestore to fileobject #1990

Conversation

deff7 commented Jan 6, 2025

github-actions bot commented Jan 6, 2025 • edited Loading

github-actions bot commented Feb 20, 2025

✅ Passed Tests (1)

🟥 Failures (15)

🔴 Revoking an invite link

🔴 Revoking an invite link (Will be retried 🔄)

🔴 User cancels their join request

🔴 User cancels their join request (Will be retried 🔄)

🔴 User deletes the space and rejoins later

🔴 User deletes the space and rejoins later (Will be retried 🔄)

🔴 Owner changes the rights of a user from Viewer to Editor

🔴 Owner approves a join request with Editor permissions

🔴 Owner approves a join request with Editor permissions (Will be retried 🔄)

🔴 Owner declines a join request

🔴 Owner declines a join request (Will be retried 🔄)

🔴 Owner removes a participant from the space

🔴 Owner removes a participant from the space (Will be retried 🔄)

🔴 Sync on staging nodes

🔴 Sync on staging nodes (Will be retried 🔄)

github-actions bot commented Jan 6, 2025 •

edited

Loading