Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Potential bug: lost export_ops->unexport() if export_ops->lookup_path() fails #1136

Open
zhitaoli-6 opened this issue May 20, 2024 · 2 comments
Labels
Analyzing Need Info Need more information from the reporter

Comments

@zhitaoli-6
Copy link
Contributor

zhitaoli-6 commented May 20, 2024

In our environment, I find that fsal_export->unexport() is never called, which fsal_export->release() is called.

The following log shows that lookup_path() fails and unexport() is skipped because of no root object. In fact, export()/unexport() are symmetrical functions so I expect that unexport() should be called in this case.

nfs-ganesha [main] logs
{"log":"2024-05-20T13:08:28.382935+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_lru.c:2261 :dirmap_lru_init :NFS READDIR :DEBUG :Skipping dirmap SFS/MDC\n","stream":"stdout","time":"2024-05-20T05:08:28.383104359Z"}
{"log":"2024-05-20T13:08:28.383234+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:318 :get_gsh_export :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T05:08:28.383307384Z"}
{"log":"2024-05-20T13:08:28.383300+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:577 :get_gsh_export_by_pseudo_locked :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T05:08:28.383329874Z"}
{"log":"2024-05-20T13:08:28.383332+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:436 :get_gsh_export_by_path_locked :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T05:08:28.383357746Z"}
{"log":"2024-05-20T13:08:28.383397+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:1452 :export_commit_common :CONFIG :INFO :Export 2 created at pseudo (/test-ns-1) with path (/test-ns-1) and tag ((null)) perms (options=033021e2/0009f1ff root_squash   , RWrw,    ,               ,               ,         , anon_uid=    -2, anon_gid=    -2, expire=       0, sys)\n","stream":"stdout","time":"2024-05-20T05:08:28.383443751Z"}
{"log":"2024-05-20T13:08:28.383446+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:1459 :export_commit_common :CONFIG :INFO :Export 2 has 0 defined clients\n","stream":"stdout","time":"2024-05-20T05:08:28.383474994Z"}
{"log":"2024-05-20T13:08:28.383569+0800 14[main] export_ops.c:284 :fsal_sfs_create_export :FSAL :INFO :export ns 3\n","stream":"stdout","time":"2024-05-20T05:08:28.383614978Z"}
{"log":"2024-05-20T13:08:28.386209+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_lru.c:2261 :dirmap_lru_init :NFS READDIR :DEBUG :Skipping dirmap SFS/MDC\n","stream":"stdout","time":"2024-05-20T05:08:28.386251275Z"}
{"log":"2024-05-20T13:08:28.386266+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:318 :get_gsh_export :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T05:08:28.386304231Z"}
{"log":"2024-05-20T13:08:28.386308+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:577 :get_gsh_export_by_pseudo_locked :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T05:08:28.386341319Z"}
{"log":"2024-05-20T13:08:28.386325+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:436 :get_gsh_export_by_path_locked :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T05:08:28.386370566Z"}
{"log":"2024-05-20T13:08:28.386374+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:1452 :export_commit_common :CONFIG :INFO :Export 3 created at pseudo (/test-ns-2) with path (/test-ns-2) and tag ((null)) perms (options=033021e2/0009f1ff root_squash   , RWrw,    ,               ,               ,         , anon_uid=    -2, anon_gid=    -2, expire=       0, sys)\n","stream":"stdout","time":"2024-05-20T05:08:28.386396374Z"}
{"log":"2024-05-20T13:08:28.386471+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:1459 :export_commit_common :CONFIG :INFO :Export 3 has 0 defined clients\n","stream":"stdout","time":"2024-05-20T05:08:28.386505099Z"}
{"log":"2024-05-20T13:08:28.386520+0800 14[main] export_ops.c:284 :fsal_sfs_create_export :FSAL :INFO :export ns 1\n","stream":"stdout","time":"2024-05-20T05:08:28.386555489Z"}
{"log":"2024-05-20T14:17:20.955210+0800 14[main] export_ops.c:299 :fsal_sfs_create_export :FSAL :WARN :export ns 1 failure, error -1002\n","stream":"stdout","time":"2024-05-20T06:17:20.955296075Z"}
{"log":"2024-05-20T14:17:20.955343+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_main.c:206 :mdcache_fsal_create_export :FSAL :MAJ :Failed to call create_export on underlying FSAL SFS\n","stream":"stdout","time":"2024-05-20T06:17:20.955396397Z"}
{"log":"2024-05-20T14:17:20.955403+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:619 :fsal_cfg_commit :CONFIG :CRIT :Could not create export for (/test-ns-0) to (/test-ns-0)\n","stream":"stdout","time":"2024-05-20T06:17:20.95544196Z"}
{"log":"2024-05-20T14:17:20.955596+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:318 :get_gsh_export :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T06:17:20.95565008Z"}
{"log":"2024-05-20T14:17:20.955630+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:1312 :export_commit_common :CONFIG :CRIT :fsal_export is NULL\n","stream":"stdout","time":"2024-05-20T06:17:20.955655218Z"}
{"log":"2024-05-20T14:17:20.955674+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2678 :free_export_resources :EXPORT :DEBUG :Free resources for export 0x7fa286067440 id 1 path /test-ns-0\n","stream":"stdout","time":"2024-05-20T06:17:20.955700877Z"}
{"log":"2024-05-20T14:17:20.955732+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2694 :free_export_resources :EXPORT :DEBUG :Export root (nil)\n","stream":"stdout","time":"2024-05-20T06:17:20.955763271Z"}
{"log":"2024-05-20T14:17:20.955791+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:3024 :release_export :MDCACHE :INFO :Export root for export id 1 status No such file or directory\n","stream":"stdout","time":"2024-05-20T06:17:20.9558288Z"}
{"log":"2024-05-20T14:17:20.955845+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2698 :free_export_resources :EXPORT :DEBUG :release_export complete\n","stream":"stdout","time":"2024-05-20T06:17:20.955872373Z"}
{"log":"2024-05-20T14:17:20.955883+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2740 :free_export_resources :EXPORT :DEBUG :Goodbye export 0x7fa286067440 path No Export pseudo No Export\n","stream":"stdout","time":"2024-05-20T06:17:20.955910823Z"}
{"log":"2024-05-20T14:17:20.955942+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:318 :get_gsh_export :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T06:17:20.955970488Z"}
{"log":"2024-05-20T14:17:20.955988+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/export_mgr.c:577 :get_gsh_export_by_pseudo_locked :EXPORT :DEBUG :Found NO EXPORT\n","stream":"stdout","time":"2024-05-20T06:17:20.956013705Z"}
{"log":"2024-05-20T14:17:20.956029+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2375 :build_default_root :EXPORT :DEBUG :Allocating Pseudo root export\n","stream":"stdout","time":"2024-05-20T06:17:20.956057224Z"}
{"log":"2024-05-20T14:17:20.956092+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/FSAL_PSEUDO/export.c:241 :pseudofs_create_export :FSAL :DEBUG :Created exp 0x7fa28219b800 - /\n","stream":"stdout","time":"2024-05-20T06:17:20.956120794Z"}
{"log":"2024-05-20T14:17:20.956156+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_lru.c:2261 :dirmap_lru_init :NFS READDIR :DEBUG :Skipping dirmap PSEUDO/MDC\n","stream":"stdout","time":"2024-05-20T06:17:20.956193432Z"}
{"log":"2024-05-20T14:17:20.956203+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2434 :build_default_root :CONFIG :INFO :Export 0 (/) successfully created\n","stream":"stdout","time":"2024-05-20T06:17:20.956227374Z"}
{"log":"2024-05-20T14:17:20.956261+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2580 :ReadExports :EXPORT :INFO :Export     2 pseudo (/test-ns-1) with path (/test-ns-1) and tag ((null)) perms (options=033021e2/0009f1ff root_squash   , RWrw,    ,               ,               ,         , anon_uid=    -2, anon_gid=    -2, expire=       0, sys)\n","stream":"stdout","time":"2024-05-20T06:17:20.956318182Z"}
{"log":"2024-05-20T14:17:20.956332+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2580 :ReadExports :EXPORT :INFO :Export     3 pseudo (/test-ns-2) with path (/test-ns-2) and tag ((null)) perms (options=033021e2/0009f1ff root_squash   , RWrw,    ,               ,               ,         , anon_uid=    -2, anon_gid=    -2, expire=       0, sys)\n","stream":"stdout","time":"2024-05-20T06:17:20.956371252Z"}
{"log":"2024-05-20T14:17:20.956365+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2580 :ReadExports :EXPORT :INFO :Export     0 pseudo (/) with path (/) and tag ((null)) perms (options=0221f080/0771f3e7 no_root_squash, --r-, -4-, ---, TCP, ----,               ,         ,                ,                ,                , none, sys, krb5, krb5i, krb5p)\n","stream":"stdout","time":"2024-05-20T06:17:20.95638679Z"}
{"log":"2024-05-20T14:17:20.956419+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/config_parsing/config_parsing.c:241 :config_errs_to_log :CONFIG :CRIT :Config File (/opt/iomesh/sfs/sessions/session2/ganesha/ganesha.conf:146): 1 validation errors in block FSAL\n","stream":"stdout","time":"2024-05-20T06:17:20.956477141Z"}
{"log":"2024-05-20T14:17:20.956443+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/config_parsing/config_parsing.c:241 :config_errs_to_log :CONFIG :CRIT :Config File (/opt/iomesh/sfs/sessions/session2/ganesha/ganesha.conf:146): Errors processing block (FSAL)\n","stream":"stdout","time":"2024-05-20T06:17:20.956494526Z"}
{"log":"2024-05-20T14:17:20.956460+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/config_parsing/config_parsing.c:241 :config_errs_to_log :CONFIG :CRIT :Config File (/opt/iomesh/sfs/sessions/session2/ganesha/ganesha.conf:136): 1 validation errors in block EXPORT\n","stream":"stdout","time":"2024-05-20T06:17:20.956500032Z"}
{"log":"2024-05-20T14:17:20.956472+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/config_parsing/config_parsing.c:241 :config_errs_to_log :CONFIG :CRIT :Config File (/opt/iomesh/sfs/sessions/session2/ganesha/ganesha.conf:136): Errors processing block (EXPORT)\n","stream":"stdout","time":"2024-05-20T06:17:20.956516761Z"}
{"log":"2024-05-20T14:17:20.956507+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/dbus/dbus_server.c:272 :gsh_dbus_pkginit :DBUS :DEBUG :init\n","stream":"stdout","time":"2024-05-20T06:17:20.956555673Z"}
{"log":"2024-05-20T14:17:20.957980+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/dbus/dbus_server.c:281 :gsh_dbus_pkginit :DBUS :CRIT :dbus_bus_get failed (Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory)\n","stream":"stdout","time":"2024-05-20T06:17:20.958050836Z"}
{"log":"2024-05-20T14:17:20.958026+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/dbus/dbus_server.c:640 :gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection\n","stream":"stdout","time":"2024-05-20T06:17:20.958059164Z"}
{"log":"2024-05-20T14:17:20.958061+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/dbus/dbus_server.c:640 :gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection\n","stream":"stdout","time":"2024-05-20T06:17:20.95810136Z"}
{"log":"2024-05-20T14:17:20.958113+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/dbus/dbus_server.c:640 :gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection\n","stream":"stdout","time":"2024-05-20T06:17:20.958147979Z"}
{"log":"2024-05-20T14:17:20.958151+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:725 :nfs_Init :NFS STARTUP :DEBUG :Now building NFSv4 ACL cache\n","stream":"stdout","time":"2024-05-20T06:17:20.958186796Z"}
{"log":"2024-05-20T14:17:20.958177+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/nfs4_acls.c:265 :nfs4_acls_init :NFS4 ACL :DEBUG :Initialize NFSv4 ACLs\n","stream":"stdout","time":"2024-05-20T06:17:20.958217817Z"}
{"log":"2024-05-20T14:17:20.958203+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/nfs4_acls.c:266 :nfs4_acls_init :NFS4 ACL :DEBUG :sizeof(fsal_ace_t)=20, sizeof(fsal_acl_t)=80\n","stream":"stdout","time":"2024-05-20T06:17:20.958229874Z"}
{"log":"2024-05-20T14:17:20.958415+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:728 :nfs_Init :NFS STARTUP :INFO :NFSv4 ACL cache successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:20.958469292Z"}
{"log":"2024-05-20T14:17:20.958448+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2930 :init_export_root :EXPORT :DEBUG :About to lookup_path for ExportId=2 Path=/test-ns-1\n","stream":"stdout","time":"2024-05-20T06:17:20.95847647Z"}
{"log":"2024-05-20T14:17:20.958489+0800 14[main] export_ops.c:54 :fsal_sfs_lookup_path :FSAL :INFO :lookup mount path: /test-ns-1 for ns 2\n","stream":"stdout","time":"2024-05-20T06:17:20.958521544Z"}
{"log":"2024-05-20T14:17:30.881748+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:1608 :mdcache_lookup_path :MDCACHE :DEBUG :lookup_path /test-ns-1 failed with Undefined server error\n","stream":"stdout","time":"2024-05-20T06:17:30.881846878Z"}
{"log":"2024-05-20T14:17:30.881821+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2943 :init_export_root :EXPORT :CRIT :Lookup failed on path, ExportId=2 Path=/test-ns-1 FSAL_ERROR=(Undefined server error,0)\n","stream":"stdout","time":"2024-05-20T06:17:30.881885792Z"}
{"log":"2024-05-20T14:17:30.881908+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2930 :init_export_root :EXPORT :DEBUG :About to lookup_path for ExportId=3 Path=/test-ns-2\n","stream":"stdout","time":"2024-05-20T06:17:30.88196103Z"}
{"log":"2024-05-20T14:17:30.881943+0800 14[main] export_ops.c:54 :fsal_sfs_lookup_path :FSAL :INFO :lookup mount path: /test-ns-2 for ns 3\n","stream":"stdout","time":"2024-05-20T06:17:30.881988318Z"}
{"log":"2024-05-20T14:17:30.882213+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:1608 :mdcache_lookup_path :MDCACHE :DEBUG :lookup_path /test-ns-2 failed with Undefined server error\n","stream":"stdout","time":"2024-05-20T06:17:30.882249055Z"}
{"log":"2024-05-20T14:17:30.882249+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2943 :init_export_root :EXPORT :CRIT :Lookup failed on path, ExportId=3 Path=/test-ns-2 FSAL_ERROR=(Undefined server error,0)\n","stream":"stdout","time":"2024-05-20T06:17:30.882309359Z"}
{"log":"2024-05-20T14:17:30.882315+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2930 :init_export_root :EXPORT :DEBUG :About to lookup_path for ExportId=0 Path=/\n","stream":"stdout","time":"2024-05-20T06:17:30.882346739Z"}
{"log":"2024-05-20T14:17:30.882432+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_hash.h:311 :cih_get_by_key_latch :HT CACHE :DEBUG :fdcache MISS\n","stream":"stdout","time":"2024-05-20T06:17:30.882494699Z"}
{"log":"2024-05-20T14:17:30.882515+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_hash.h:311 :cih_get_by_key_latch :HT CACHE :DEBUG :fdcache MISS\n","stream":"stdout","time":"2024-05-20T06:17:30.882550175Z"}
{"log":"2024-05-20T14:17:30.882559+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:781 :mdcache_new_entry :NFS READDIR :DEBUG :Adding a DIRECTORY, entry=0x7fa282194300 setting MDCACHE_TRUST_CONTENT clearing MDCACHE_DIR_POPULATED\n","stream":"stdout","time":"2024-05-20T06:17:30.882600747Z"}
{"log":"2024-05-20T14:17:30.882586+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:862 :mdcache_new_entry :MDCACHE :DEBUG :New entry 0x7fa282194300 added\n","stream":"stdout","time":"2024-05-20T06:17:30.88262149Z"}
{"log":"2024-05-20T14:17:30.882649+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2987 :init_export_root :EXPORT :DEBUG :Added root obj 0x7fa282194338 FSAL MDCACHE for path / on export_id=0\n","stream":"stdout","time":"2024-05-20T06:17:30.882693388Z"}
{"log":"2024-05-20T14:17:30.882693+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2678 :free_export_resources :EXPORT :DEBUG :Free resources for export 0x7fa286034640 id 3 path /test-ns-2\n","stream":"stdout","time":"2024-05-20T06:17:30.882772121Z"}
{"log":"2024-05-20T14:17:30.882776+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2694 :free_export_resources :EXPORT :DEBUG :Export root (nil)\n","stream":"stdout","time":"2024-05-20T06:17:30.882815879Z"}
{"log":"2024-05-20T14:17:30.882803+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:3012 :release_export :EXPORT :DEBUG :Unexport /test-ns-2, Pseudo /test-ns-2\n","stream":"stdout","time":"2024-05-20T06:17:30.882877198Z"}
{"log":"2024-05-20T14:17:30.882882+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:3024 :release_export :MDCACHE :INFO :Export root for export id 3 status No such file or directory\n","stream":"stdout","time":"2024-05-20T06:17:30.882919131Z"}
{"log":"2024-05-20T14:17:30.882904+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2698 :free_export_resources :EXPORT :DEBUG :release_export complete\n","stream":"stdout","time":"2024-05-20T06:17:30.882936256Z"}
{"log":"2024-05-20T14:17:30.882965+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_export.c:310 :mdcache_exp_release :FSAL :INFO :Releasing SFS export 3 for /test-ns-2\n","stream":"stdout","time":"2024-05-20T06:17:30.883012449Z"}
{"log":"2024-05-20T14:17:30.883026+0800 14[main] export_ops.c:28 :fsal_sfs_fs_release :FSAL :INFO :release ns 3\n","stream":"stdout","time":"2024-05-20T06:17:30.883075482Z"}
{"log":"2024-05-20T14:17:30.883174+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2740 :free_export_resources :EXPORT :DEBUG :Goodbye export 0x7fa286034640 path /test-ns-2 pseudo /test-ns-2\n","stream":"stdout","time":"2024-05-20T06:17:30.883215043Z"}
{"log":"2024-05-20T14:17:30.883252+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2678 :free_export_resources :EXPORT :DEBUG :Free resources for export 0x7fa286034040 id 2 path /test-ns-1\n","stream":"stdout","time":"2024-05-20T06:17:30.883291741Z"}
{"log":"2024-05-20T14:17:30.883271+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2694 :free_export_resources :EXPORT :DEBUG :Export root (nil)\n","stream":"stdout","time":"2024-05-20T06:17:30.883299794Z"}
{"log":"2024-05-20T14:17:30.883298+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:3012 :release_export :EXPORT :DEBUG :Unexport /test-ns-1, Pseudo /test-ns-1\n","stream":"stdout","time":"2024-05-20T06:17:30.883350379Z"}
{"log":"2024-05-20T14:17:30.883371+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:3024 :release_export :MDCACHE :INFO :Export root for export id 2 status No such file or directory\n","stream":"stdout","time":"2024-05-20T06:17:30.883408229Z"}
{"log":"2024-05-20T14:17:30.883419+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2698 :free_export_resources :EXPORT :DEBUG :release_export complete\n","stream":"stdout","time":"2024-05-20T06:17:30.883449719Z"}
{"log":"2024-05-20T14:17:30.883483+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_export.c:310 :mdcache_exp_release :FSAL :INFO :Releasing SFS export 2 for /test-ns-1\n","stream":"stdout","time":"2024-05-20T06:17:30.883529157Z"}
{"log":"2024-05-20T14:17:30.883543+0800 14[main] export_ops.c:28 :fsal_sfs_fs_release :FSAL :INFO :release ns 2\n","stream":"stdout","time":"2024-05-20T06:17:30.883576631Z"}
{"log":"2024-05-20T14:17:30.883612+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/include/fsal_api.h:3005 :fsal_put :FSAL :INFO :FSAL SFS now unused\n","stream":"stdout","time":"2024-05-20T06:17:30.883663839Z"}
{"log":"2024-05-20T14:17:30.883648+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/support/exports.c:2740 :free_export_resources :EXPORT :DEBUG :Goodbye export 0x7fa286034040 path /test-ns-1 pseudo /test-ns-1\n","stream":"stdout","time":"2024-05-20T06:17:30.883715553Z"}
{"log":"2024-05-20T14:17:30.883770+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:753 :nfs_Init :NFS STARTUP :INFO :krb5 keytab path successfully set to /etc/krb5.keytab\n","stream":"stdout","time":"2024-05-20T06:17:30.883811668Z"}
{"log":"2024-05-20T14:17:30.884748+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:778 :nfs_Init :NFS STARTUP :INFO :gss principal \"nfs\" successfully set\n","stream":"stdout","time":"2024-05-20T06:17:30.884833612Z"}
{"log":"2024-05-20T14:17:30.884877+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:796 :nfs_Init :NFS STARTUP :DEBUG :Now building NFSv4 clientid cache\n","stream":"stdout","time":"2024-05-20T06:17:30.884942455Z"}
{"log":"2024-05-20T14:17:30.885151+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:802 :nfs_Init :NFS STARTUP :INFO :NFSv4 clientid cache successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.885197327Z"}
{"log":"2024-05-20T14:17:30.885344+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:807 :nfs_Init :NFS STARTUP :INFO :duplicate request hash table cache successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.885399359Z"}
{"log":"2024-05-20T14:17:30.885417+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:811 :nfs_Init :NFS STARTUP :DEBUG :Now building NFSv4 State Id cache\n","stream":"stdout","time":"2024-05-20T06:17:30.885453698Z"}
{"log":"2024-05-20T14:17:30.885590+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:816 :nfs_Init :NFS STARTUP :INFO :NFSv4 State Id cache successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.885650611Z"}
{"log":"2024-05-20T14:17:30.885633+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:820 :nfs_Init :NFS STARTUP :DEBUG :Now building NFSv4 Owner cache\n","stream":"stdout","time":"2024-05-20T06:17:30.885709987Z"}
{"log":"2024-05-20T14:17:30.885788+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:825 :nfs_Init :NFS STARTUP :INFO :NFSv4 Open Owner cache successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.885848825Z"}
{"log":"2024-05-20T14:17:30.885896+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:859 :nfs_Init :NFS STARTUP :DEBUG :Now building NFSv4 Session Id cache\n","stream":"stdout","time":"2024-05-20T06:17:30.885938247Z"}
{"log":"2024-05-20T14:17:30.886012+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:864 :nfs_Init :NFS STARTUP :INFO :NFSv4 Session Id cache successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.886059214Z"}
{"log":"2024-05-20T14:17:30.886105+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:873 :nfs_Init :NFS STARTUP :INFO :NFSv4 specific parameter initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.886156714Z"}
{"log":"2024-05-20T14:17:30.886176+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:886 :nfs_Init :NFS STARTUP :DEBUG :Now building pseudo fs\n","stream":"stdout","time":"2024-05-20T06:17:30.886211734Z"}
{"log":"2024-05-20T14:17:30.886278+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/Protocols/NFS/nfs4_pseudo.c:341 :pseudo_mount_export :EXPORT :DEBUG :Attempt pseudofs mount for Export     0 pseudo (/) with path (/) and tag ((null)) perms (options=0221f080/0771f3e7 no_root_squash, --r-, -4-, ---, TCP, ----,               ,         ,                ,                ,                , none, sys, krb5, krb5i, krb5p)\n","stream":"stdout","time":"2024-05-20T06:17:30.886325429Z"}
{"log":"2024-05-20T14:17:30.886347+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:890 :nfs_Init :NFS STARTUP :INFO :NFSv4 pseudo file system successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.886381704Z"}
{"log":"2024-05-20T14:17:30.886452+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/FSAL/access_check.c:961 :fsal_save_ganesha_credentials :FSAL :INFO :Ganesha uid=0 gid=0 ngroups=1 (0)\n","stream":"stdout","time":"2024-05-20T06:17:30.88650726Z"}
{"log":"2024-05-20T14:17:30.886477+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1327 :nfs_Init_svc :DISP :DEBUG :NFS INIT: Core options = 3\n","stream":"stdout","time":"2024-05-20T06:17:30.886558325Z"}
{"log":"2024-05-20T14:17:30.886596+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1330 :nfs_Init_svc :DISP :INFO :NFS INIT: using TIRPC\n","stream":"stdout","time":"2024-05-20T06:17:30.886637945Z"}
{"log":"2024-05-20T14:17:30.887042+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1399 :nfs_Init_svc :DISP :INFO :NFS INIT: Using IPv6\n","stream":"stdout","time":"2024-05-20T06:17:30.887102581Z"}
{"log":"2024-05-20T14:17:30.887238+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1214 :Allocate_sockets :DISP :DEBUG :Socket numbers are: NFS tcp=50 udp=-1\n","stream":"stdout","time":"2024-05-20T06:17:30.88730041Z"}
{"log":"2024-05-20T14:17:30.887327+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1214 :Allocate_sockets :DISP :DEBUG :Socket numbers are: MNT tcp=51 udp=-1\n","stream":"stdout","time":"2024-05-20T06:17:30.887399529Z"}
{"log":"2024-05-20T14:17:30.887447+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1214 :Allocate_sockets :DISP :DEBUG :Socket numbers are: RQUOTA tcp=52 udp=-1\n","stream":"stdout","time":"2024-05-20T06:17:30.887497171Z"}
{"log":"2024-05-20T14:17:30.887548+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:622 :Bind_sockets_V6 :DISP :INFO :Binding to address :::0\n","stream":"stdout","time":"2024-05-20T06:17:30.887585564Z"}
{"log":"2024-05-20T14:17:30.887627+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:724 :Bind_sockets_V6 :DISP :INFO :Binding TCP socket to address :::2049 for NFS\n","stream":"stdout","time":"2024-05-20T06:17:30.887662798Z"}
{"log":"2024-05-20T14:17:30.887714+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:724 :Bind_sockets_V6 :DISP :INFO :Binding TCP socket to address :::2050 for MNT\n","stream":"stdout","time":"2024-05-20T06:17:30.887762485Z"}
{"log":"2024-05-20T14:17:30.887790+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:724 :Bind_sockets_V6 :DISP :INFO :Binding TCP socket to address :::2051 for RQUOTA\n","stream":"stdout","time":"2024-05-20T06:17:30.887824906Z"}
{"log":"2024-05-20T14:17:30.887852+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:932 :Bind_sockets :DISP :INFO :Bind sockets successful, v6disabled = 0, vsock = 0, rdma = 0\n","stream":"stdout","time":"2024-05-20T06:17:30.887891911Z"}
{"log":"2024-05-20T14:17:30.897213+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1443 :nfs_Init_svc :DISP :INFO :Successfully imported principal nfs into GSSAPI\n","stream":"stdout","time":"2024-05-20T06:17:30.897277121Z"}
{"log":"2024-05-20T14:17:30.901297+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1450 :nfs_Init_svc :DISP :CRIT :Cannot acquire credentials for principal nfs\n","stream":"stdout","time":"2024-05-20T06:17:30.901387894Z"}
{"log":"2024-05-20T14:17:30.901364+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1284 :__Register_program :DISP :INFO :Registering NFS V3/TCP\n","stream":"stdout","time":"2024-05-20T06:17:30.901460317Z"}
{"log":"2024-05-20T14:17:30.901910+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1295 :__Register_program :DISP :INFO :Registering NFS V3/TCPv6\n","stream":"stdout","time":"2024-05-20T06:17:30.901980425Z"}
{"log":"2024-05-20T14:17:30.903047+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1284 :__Register_program :DISP :INFO :Registering MNT V1/TCP\n","stream":"stdout","time":"2024-05-20T06:17:30.903114442Z"}
{"log":"2024-05-20T14:17:30.903427+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1295 :__Register_program :DISP :INFO :Registering MNT V1/TCPv6\n","stream":"stdout","time":"2024-05-20T06:17:30.903473015Z"}
{"log":"2024-05-20T14:17:30.903808+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1284 :__Register_program :DISP :INFO :Registering MNT V3/TCP\n","stream":"stdout","time":"2024-05-20T06:17:30.903853966Z"}
{"log":"2024-05-20T14:17:30.904125+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1295 :__Register_program :DISP :INFO :Registering MNT V3/TCPv6\n","stream":"stdout","time":"2024-05-20T06:17:30.904205349Z"}
{"log":"2024-05-20T14:17:30.904488+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1284 :__Register_program :DISP :INFO :Registering NFS V4/TCP\n","stream":"stdout","time":"2024-05-20T06:17:30.904538131Z"}
{"log":"2024-05-20T14:17:30.904808+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1295 :__Register_program :DISP :INFO :Registering NFS V4/TCPv6\n","stream":"stdout","time":"2024-05-20T06:17:30.904860004Z"}
{"log":"2024-05-20T14:17:30.905128+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1284 :__Register_program :DISP :INFO :Registering RQUOTA V1/TCP\n","stream":"stdout","time":"2024-05-20T06:17:30.9052133Z"}
{"log":"2024-05-20T14:17:30.905531+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1295 :__Register_program :DISP :INFO :Registering RQUOTA V1/TCPv6\n","stream":"stdout","time":"2024-05-20T06:17:30.905581251Z"}
{"log":"2024-05-20T14:17:30.905890+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1284 :__Register_program :DISP :INFO :Registering RQUOTA V2/TCP\n","stream":"stdout","time":"2024-05-20T06:17:30.90594399Z"}
{"log":"2024-05-20T14:17:30.906257+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_dispatcher_thread.c:1295 :__Register_program :DISP :INFO :Registering RQUOTA V2/TCPv6\n","stream":"stdout","time":"2024-05-20T06:17:30.906308552Z"}
{"log":"2024-05-20T14:17:30.906606+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:898 :nfs_Init :NFS STARTUP :INFO :RPC resources successfully initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.90667599Z"}
{"log":"2024-05-20T14:17:30.906724+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/dbus/dbus_server.c:640 :gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection\n","stream":"stdout","time":"2024-05-20T06:17:30.906789058Z"}
{"log":"2024-05-20T14:17:30.906834+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_admin_thread.c:712 :nfs_Init_admin_thread :NFS CB :EVENT :Admin thread initialized\n","stream":"stdout","time":"2024-05-20T06:17:30.906877537Z"}
{"log":"2024-05-20T14:17:30.906974+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_callback.c:92 :nfs_rpc_cb_init_ccache :NFS STARTUP :EVENT :Callback creds directory (/sfs/c/target/var/run/ganesha) already exists\n","stream":"stdout","time":"2024-05-20T06:17:30.907033668Z"}
{"log":"2024-05-20T14:17:30.907266+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/RPCAL/gss_credcache.c:472 :get_full_hostname :NFS CB :F_DBG :Full hostname for 'localhost' is 'localhost'\n","stream":"stdout","time":"2024-05-20T06:17:30.907330602Z"}
{"log":"2024-05-20T14:17:30.930378+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/RPCAL/gss_credcache.c:458 :get_full_hostname :NFS CB :WARN :Name or service not known while getting full hostname for 'sfs-702a49e9-f49f-4477-ad44-c57087eebd46-1'\n","stream":"stdout","time":"2024-05-20T06:17:30.930566681Z"}
{"log":"2024-05-20T14:17:30.930508+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/RPCAL/gss_credcache.c:914 :gssd_refresh_krb5_machine_credential :NFS CB :CRIT :ERROR: gssd_refresh_krb5_machine_credential: no usable keytab entry found in keytab /etc/krb5.keytab for connection with host localhost\n","stream":"stdout","time":"2024-05-20T06:17:30.930598525Z"}
{"log":"2024-05-20T14:17:30.930589+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_rpc_callback.c:108 :nfs_rpc_cb_init_ccache :NFS STARTUP :WARN :gssd_refresh_krb5_machine_credential failed (-2:0)\n","stream":"stdout","time":"2024-05-20T06:17:30.930663887Z"}
{"log":"2024-05-20T14:17:30.930744+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:551 :nfs_Start_threads :THREAD :DEBUG :Starting threads\n","stream":"stdout","time":"2024-05-20T06:17:30.930814771Z"}
{"log":"2024-05-20T14:17:30.930827+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:558 :nfs_Start_threads :THREAD :EVENT :Starting delayed executor.\n","stream":"stdout","time":"2024-05-20T06:17:30.930880912Z"}
{"log":"2024-05-20T14:17:30.931097+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:568 :nfs_Start_threads :THREAD :DEBUG :sigmgr thread started\n","stream":"stdout","time":"2024-05-20T06:17:30.931194775Z"}
{"log":"2024-05-20T14:17:30.931348+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:616 :nfs_Start_threads :THREAD :EVENT :gsh_dbusthread was started successfully\n","stream":"stdout","time":"2024-05-20T06:17:30.93143826Z"}
{"log":"2024-05-20T14:17:30.931527+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:626 :nfs_Start_threads :THREAD :EVENT :admin thread was started successfully\n","stream":"stdout","time":"2024-05-20T06:17:30.93159302Z"}
{"log":"2024-05-20T14:17:30.931709+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:635 :nfs_Start_threads :THREAD :EVENT :reaper thread was started successfully\n","stream":"stdout","time":"2024-05-20T06:17:30.931796215Z"}
{"log":"2024-05-20T14:17:30.931804+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:644 :nfs_Start_threads :THREAD :EVENT :General fridge was started successfully\n","stream":"stdout","time":"2024-05-20T06:17:30.931947394Z"}
{"log":"2024-05-20T14:17:30.932013+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:1033 :nfs_start :NFS STARTUP :EVENT :-------------------------------------------------\n","stream":"stdout","time":"2024-05-20T06:17:30.932093414Z"}
{"log":"2024-05-20T14:17:30.932153+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:1035 :nfs_start :NFS STARTUP :EVENT :             NFS SERVER INITIALIZED\n","stream":"stdout","time":"2024-05-20T06:17:30.932207357Z"}
{"log":"2024-05-20T14:17:30.932236+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:1036 :nfs_start :NFS STARTUP :EVENT :-------------------------------------------------\n","stream":"stdout","time":"2024-05-20T06:17:30.932293498Z"}
{"log":"2024-05-20T14:17:30.932391+0800 14[main] /sfs/c/ganesha/third-party/nfs-ganesha/src/MainNFSD/nfs_init.c:1043 :nfs_start :THREAD :DEBUG :Wait for admin thread to exit\n","stream":"stdout","time":"2024-05-20T06:17:30.932428486Z"}
@ffilz
Copy link
Member

ffilz commented May 20, 2024

That log looks all out of order or something. Is that from syslog? Could you re-run with log to file?

Also, enable FULL_DEBUG for EXPORT log component so we can look at refcounts and stuff.

@ffilz ffilz added Analyzing Need Info Need more information from the reporter labels May 20, 2024
@zhitaoli-6
Copy link
Contributor Author

zhitaoli-6 commented May 21, 2024

It is not easy to let this issue reappears.

I have updated the logs above. In ReadExports() from main thread, lookup_path() failure results in skipped unexport() in release_export().

exports.c:3024 :release_export :MDCACHE :INFO :Export root for export id 3 status No such file or directory\
void release_export(struct gsh_export *export, bool config)
{
	struct fsal_obj_handle *obj = NULL;
	fsal_status_t fsal_status;

	if (!config) {
		LogDebug(COMPONENT_EXPORT,
			 "Unexport %s, Pseudo %s",
			 CTX_FULLPATH(op_ctx), CTX_PSEUDOPATH(op_ctx));
	}

	/* Get a reference to the root entry */
	fsal_status = nfs_export_get_root_entry(export, &obj);

	if (FSAL_IS_ERROR(fsal_status)) {
		/* No more root entry, bail out, this export is
		 * probably about to be destroyed.
		 */
		LogInfo(COMPONENT_MDCACHE,
			"Export root for export id %d status %s",
			export->export_id, msg_fsal_err(fsal_status.major));
		return;
	}
        ...
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Analyzing Need Info Need more information from the reporter
Projects
None yet
Development

No branches or pull requests

2 participants