seaweedfs: Trying to fix "Mount is not supported on freebsd amd64"

Describe the bug

When running the weed mount command on a FreeBSD:amd64 box, the Mount is not supported on freebsd amd64 error appears. This is the same error reported in issue #4156.

I have successfully fixed this problem and the weed mount command mounts the filesystem and files can be written, however, after a few MBytes, weed mount crash. weed mount and dd(1) get stuck after a while and terminate.

I have very limited knowledge about Golang, but I have no problem helping to solve this problem. SeaweedFS suits my needs, but I need FUSE to mount it like any other FS (I know I can use webdav or s3 and use the fuse module, but I prefer to use weed mount).

System Setup

  • Start the master, volume and filer:

    # mkdir -p /tmp/data
    # ~/go/bin/weed server -filer -dir="/tmp/data" -volume.max=1 -volume.fileSizeLimitMB=5000
    I0318 18:50:36.014736 master.go:282 current: 192.168.2.151:9333 peers:
    I0318 18:50:36.015014 file_util.go:27 Folder /tmp/data Permission: -rwxr-xr-x
    I0318 18:50:36.015076 file_util.go:27 Folder /tmp/data Permission: -rwxr-xr-x
    I0318 18:50:36.015300 master.go:282 current: 192.168.2.151:9333 peers:192.168.2.151:9333
    I0318 18:50:36.015586 master_server.go:132 Volume Size Limit is 30000 MB
    I0318 18:50:36.016021 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:36.016060 master.go:163 Start Seaweed Master 30GB 3.85  at 192.168.2.151:9333
    I0318 18:50:36.016506 raft_server.go:119 Starting RaftServer with 192.168.2.151:9333
    I0318 18:50:36.017279 raft_server.go:168 current cluster leader: 
    I0318 18:50:37.816684 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:39.618314 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:41.458896 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:43.270740 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:45.061350 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:46.859279 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:48.663297 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:50.464555 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:52.282413 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:54.074068 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:55.883721 volume_grpc_client_to_master.go:43 checkWithMaster 192.168.2.151:9333: get master 192.168.2.151:9333 configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:19333: connect: connection refused"
    I0318 18:50:55.960564 master_server.go:209 [192.168.2.151:9333]  - is the leader.
    I0318 18:50:55.960960 master.go:214 Start Seaweed Master 30GB 3.85  grpc server at 192.168.2.151:19333
    I0318 18:50:57.463490 masterclient.go:168 No existing leader found!
    I0318 18:50:57.463709 raft_server.go:190 Initializing new cluster
    I0318 18:50:57.463777 master_server.go:181 leader change event:  => 192.168.2.151:9333
    I0318 18:50:57.463798 master_server.go:184 [192.168.2.151:9333] 192.168.2.151:9333 becomes leader.
    I0318 18:50:57.686031 disk_location.go:246 Store started on dir: /tmp/data with 0 volumes max 1
    I0318 18:50:57.686284 disk_location.go:249 Store started on dir: /tmp/data with 0 ec shards
    I0318 18:50:57.686391 volume_grpc_client_to_master.go:52 Volume server start with seed master nodes: [192.168.2.151:9333]
    I0318 18:50:57.686497 volume.go:381 Start Seaweed volume server 30GB 3.85  at 192.168.2.151:8080
    I0318 18:50:57.686916 volume_grpc_client_to_master.go:109 Heartbeat to: 192.168.2.151:9333
    I0318 18:50:57.687278 node.go:250 topo adds child DefaultDataCenter
    I0318 18:50:57.687311 node.go:250 topo:DefaultDataCenter adds child DefaultRack
    I0318 18:50:57.687326 node.go:250 topo:DefaultDataCenter:DefaultRack adds child 192.168.2.151:8080
    I0318 18:50:57.687341 node.go:250 topo:DefaultDataCenter:DefaultRack:192.168.2.151:8080 adds child 
    I0318 18:50:57.687354 master_grpc_server.go:141 added volume server 0: 192.168.2.151:8080 [7ddee3a8-c75f-4255-9915-c14b1f08c7ca]
    I0318 18:50:57.687611 master_grpc_server.go:51 found new uuid:192.168.2.151:8080 [7ddee3a8-c75f-4255-9915-c14b1f08c7ca] , map[192.168.2.151:8080:[7ddee3a8-c75f-4255-9915-c14b1f08c7ca]]
    I0318 18:50:58.071599 master_grpc_server.go:372 + client .filer@192.168.2.151:8888
    W0318 18:50:58.071706 filer_server.go:173 skipping default store dir in /tmp/data/filerldb2
    I0318 18:50:58.074081 filer.go:158 existing filer.store.id = -1980131820
    I0318 18:50:58.074112 configuration.go:28 configured filer store to redis2
    I0318 18:50:58.074693 master_client.go:20 the cluster has 1 filer
    I0318 18:50:58.074741 filer.go:112 192.168.2.151:8888 aggregate from peers [192.168.2.151:8888]
    I0318 18:50:58.078251 meta_aggregator.go:76 loopSubscribeToOneFiler read 192.168.2.151:8888 start from 2025-03-18 18:49:58.074726871 -0400 -04 1742338198074726871
    I0318 18:50:58.078851 meta_aggregator.go:92 subscribing remote 192.168.2.151:8888 meta change: connecting to peer filer 192.168.2.151:8888: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 192.168.2.151:18888: connect: connection refused"
    I0318 18:50:58.079999 filer.go:318 Start Seaweed Filer 30GB 3.85  at 192.168.2.151:8888
    I0318 18:50:58.171914 master_grpc_server.go:372 + client .master@192.168.2.151:9333
    I0318 18:50:58.172100 masterclient.go:265 + filer@192.168.2.151:8888 noticed .master 192.168.2.151:9333
    I0318 18:50:58.172144 masterclient.go:265 + master@192.168.2.151:9333 noticed .master 192.168.2.151:9333
    I0318 18:50:59.817241 meta_aggregator.go:76 loopSubscribeToOneFiler read 192.168.2.151:8888 start from 2025-03-18 18:49:58.074726871 -0400 -04 1742338198074726871
    I0318 18:50:59.818259 meta_aggregator.go:178 subscribing remote 192.168.2.151:8888 meta change: 2025-03-18 18:49:58.074726871 -0400 -04, clientId:499984526
    I0318 18:50:59.818928 filer_grpc_server_sub_meta.go:332 + local listener filer:192.168.2.151:8888@192.168.2.151:57167 clientId -499984526 clientEpoch 1
    I0318 18:50:59.818958 filer_grpc_server_sub_meta.go:143  + filer:192.168.2.151:8888@192.168.2.151:57167 local subscribe / from 2025-03-18 22:49:58.074726871 +0000 UTC clientId:-499984526
    I0318 18:50:59.818991 filer_grpc_server_sub_meta.go:156 read on disk filer:192.168.2.151:8888@192.168.2.151:57167 local subscribe / from 2025-03-18 22:49:58.074726871 +0000 UTC
    I0318 18:50:59.820496 filer_grpc_server_sub_meta.go:175 read in memory filer:192.168.2.151:8888@192.168.2.151:57167 local subscribe / from 2025-03-18 22:49:58.074726871 +0000 UTC
    I0318 18:53:22.583725 filer_grpc_server_sub_meta.go:332 +  listener mount@127.0.0.1:37885 clientId -1290906374 clientEpoch 2
    I0318 18:53:22.583760 filer_grpc_server_sub_meta.go:45  mount@127.0.0.1:37885 starts to subscribe / from 2025-03-18 22:53:22.582977536 +0000 UTC
    I0318 18:54:41.367096 filer_grpc_server_sub_meta.go:332 +  listener mount@127.0.0.1:26712 clientId 1048334968 clientEpoch 2
    I0318 18:54:41.367120 filer_grpc_server_sub_meta.go:45  mount@127.0.0.1:26712 starts to subscribe / from 2025-03-18 22:54:41.366356275 +0000 UTC
    I0318 18:54:41.367133 filer_grpc_server_sub_meta.go:39 disconnect mount@127.0.0.1:37885 subscriber / clientId:-1290906374
    I0318 18:54:41.367152 filer_grpc_server_sub_meta.go:348 -  listener mount@127.0.0.1:37885 clientId -1290906374 clientEpoch 2
    I0318 18:55:53.848131 master_grpc_server_volume.go:141 volume grow &{Option:{"replication":{},"ttl":{"Count":0,"Unit":0}} Count:0 Force:false Reason:grpc assign}
    I0318 18:55:53.848883 store.go:169 In dir /tmp/data adds volume:1 collection: replicaPlacement:000 ttl:
    I0318 18:55:53.849022 volume_loading.go:139 checking volume data integrity for volume 1
    I0318 18:55:53.849042 volume_loading.go:157 loading memory index /tmp/data/1.idx to memory
    I0318 18:55:53.849538 store.go:173 add volume 1
    I0318 18:55:53.849563 volume_grpc_client_to_master.go:189 volume server 192.168.2.151:8080 adds volume 1
    I0318 18:55:53.849625 volume_growth.go:269 Created Volume 1 on topo:DefaultDataCenter:DefaultRack:192.168.2.151:8080
    I0318 18:55:53.849646 volume_layout.go:417 Volume 1 becomes writable
    I0318 18:55:53.849655 volume_growth.go:282 Registered Volume 1 on topo:DefaultDataCenter:DefaultRack:192.168.2.151:8080
    I0318 18:55:53.849670 node.go:79 topo failed to pick 1 from  0 node candidates
    I0318 18:55:53.849677 volume_growth.go:118 create 7 volume, created 1: Not enough data nodes found!
    W0318 18:57:50.783049 master_grpc_server.go:103 SendHeartbeat.Recv server 192.168.2.151:8080 : rpc error: code = Canceled desc = context canceled
    I0318 18:57:50.783127 master_grpc_server.go:387 - client .filer@192.168.2.151:8888
    I0318 18:57:50.783135 topology_event_handling.go:86 Removing Volume 1 from the dead volume server 192.168.2.151:8080
    volume server has been killed
    I0318 18:57:50.783199 volume_server.go:143 Stopping volume server...
    I0318 18:57:50.783147 masterclient.go:243 .master masterClient failed to receive from 192.168.2.151:9333: rpc error: code = Unavailable desc = error reading from server: EOF
    I0318 18:57:50.783224 volume.go:292 stop send heartbeat and wait 10 seconds until shutdown ...
    I0318 18:57:50.783189 volume_layout.go:456 Volume 1 has 0 replica, less than required 1
    I0318 18:57:50.783204 master_grpc_server.go:321 => client .master@192.168.2.151:9333: cluster_node_update:{node_type:"filer"  address:"192.168.2.151:8888"}
    I0318 18:57:50.783276 master_grpc_server.go:387 - client .master@192.168.2.151:9333
    I0318 18:57:50.783157 volume_grpc_client_to_master.go:71 heartbeat to 192.168.2.151:9333 error: rpc error: code = Unavailable desc = error reading from server: EOF
    I0318 18:57:50.783252 volume_layout.go:405 Volume 1 becomes unwritable
    I0318 18:57:50.783285 masterclient.go:243 .filer masterClient failed to receive from 192.168.2.151:9333: rpc error: code = Unavailable desc = error reading from server: EOF
    I0318 18:57:50.783332 node.go:264 topo:DefaultDataCenter:DefaultRack removes 192.168.2.151:8080
    I0318 18:57:50.783373 master_grpc_server.go:90 unregister disconnected volume server 192.168.2.151:8080
    I0318 18:57:50.783385 master_grpc_server.go:60 remove volume server 192.168.2.151:8080, online volume server: map[]
    I0318 18:58:00.791859 volume.go:316 graceful stop cluster http server ... 
    I0318 18:58:00.791985 volume.go:321 graceful stop gRPC ...
    I0318 18:58:00.792304 volume_server.go:153 Shutting down volume server...
    I0318 18:58:00.792356 volume_server.go:155 Shut down successfully!
    

    Mount the file system:

    # mkdir -p /tmp/mnt
    # ~/go/bin/weed mount -filer=localhost:8888 -dir=/tmp/mnt -disableXAttr -debug
    mount point owner uid=15000 gid=0 mode=drwxr-xr-x
    I0318 18:54:41.333436 needle_map_leveldb.go:122 generateLevelDbFile /tmp/5cc557ae/c0_2_0.ldb, watermark 0, num of entries:0
    I0318 18:54:41.335746 needle_map_leveldb.go:66 Loading /tmp/5cc557ae/c0_2_0.ldb... , watermark: 0
    I0318 18:54:41.337060 needle_map_leveldb.go:122 generateLevelDbFile /tmp/5cc557ae/c0_2_1.ldb, watermark 0, num of entries:0
    I0318 18:54:41.338736 needle_map_leveldb.go:66 Loading /tmp/5cc557ae/c0_2_1.ldb... , watermark: 0
    I0318 18:54:41.341612 needle_map_leveldb.go:122 generateLevelDbFile /tmp/5cc557ae/c1_3_0.ldb, watermark 0, num of entries:0
    I0318 18:54:41.344303 needle_map_leveldb.go:66 Loading /tmp/5cc557ae/c1_3_0.ldb... , watermark: 0
    I0318 18:54:41.347560 needle_map_leveldb.go:122 generateLevelDbFile /tmp/5cc557ae/c1_3_1.ldb, watermark 0, num of entries:0
    I0318 18:54:41.349098 needle_map_leveldb.go:66 Loading /tmp/5cc557ae/c1_3_1.ldb... , watermark: 0
    I0318 18:54:41.350419 needle_map_leveldb.go:122 generateLevelDbFile /tmp/5cc557ae/c1_3_2.ldb, watermark 0, num of entries:0
    I0318 18:54:41.351977 needle_map_leveldb.go:66 Loading /tmp/5cc557ae/c1_3_2.ldb... , watermark: 0
    I0318 18:54:41.353417 needle_map_leveldb.go:122 generateLevelDbFile /tmp/5cc557ae/c2_2_0.ldb, watermark 0, num of entries:0
    I0318 18:54:41.355375 needle_map_leveldb.go:66 Loading /tmp/5cc557ae/c2_2_0.ldb... , watermark: 0
    I0318 18:54:41.356847 needle_map_leveldb.go:122 generateLevelDbFile /tmp/5cc557ae/c2_2_1.ldb, watermark 0, num of entries:0
    I0318 18:54:41.358671 needle_map_leveldb.go:66 Loading /tmp/5cc557ae/c2_2_1.ldb... , watermark: 0
    I0318 18:54:41.358734 leveldb_store.go:47 filer store dir: /tmp/5cc557ae/meta
    I0318 18:54:41.358749 file_util.go:27 Folder /tmp/5cc557ae/meta Permission: -rwxr-xr-x
    2025/03/18 18:54:41 rx 1: INIT n0 {7.29 Ra 65536 ASYNC_READ,POSIX_LOCKS,EXPORT_SUPPORT,BIG_WRITES,WRITEBACK_CACHE,NO_OPEN_SUPPORT,NO_OPENDIR_SUPPORT} p58516
    2025/03/18 18:54:41 tx 1:     OK, {7.28 Ra 65536 ASYNC_READ,BIG_WRITES,NO_OPEN_SUPPORT,POSIX_ACL 96/128 Wr 1048576 Tg 0 MaxPages 256 MaxStack 1}
    I0318 18:54:41.366390 mount_std.go:282 mounted localhost:8888/ to /tmp/mnt
    I0318 18:54:41.366418 mount_std.go:283 This is SeaweedFS version 30GB 3.85  freebsd amd64
    2025/03/18 18:55:37 rx 2: GETATTR n1 {Fh 0 } p51905
    2025/03/18 18:55:37 tx 2:     OK, {tA=119s {M020000040755 SZ=0 L=1 15000:0 B0*0 i0:1 A 1742338537.000000 M 1742338537.000000 C 1742338537.000000}}
    2025/03/18 18:55:37 rx 3: ACCESS n1 {u=0 g=0 r} p63842
    2025/03/18 18:55:37 tx 3:     78=function not implemented
    2025/03/18 18:55:37 rx 4: OPENDIR n1 {O_RDONLY} p63842
    2025/03/18 18:55:37 tx 4:     OK, {Fh 786592387 }
    2025/03/18 18:55:37 rx 5: READDIR n1 {Fh 786592387 [0 +4096)  L 0 RDONLY} p63842
    2025/03/18 18:55:37 tx 5:     OK,  128b data "\xff\xff\xff\xff\x00\x00\x00\x00"...
    2025/03/18 18:55:37 rx 6: READDIR n1 {Fh 786592387 [4 +4096)  L 0 RDONLY} p63842
    2025/03/18 18:55:37 tx 6:     OK
    2025/03/18 18:55:40 rx 7: OPENDIR n1 {O_RDONLY} p51905
    2025/03/18 18:55:40 tx 7:     OK, {Fh 191624396 }
    2025/03/18 18:55:40 rx 8: READDIR n1 {Fh 191624396 [0 +4096)  L 0 RDONLY} p51905
    2025/03/18 18:55:40 tx 8:     OK,  128b data "\xff\xff\xff\xff\x00\x00\x00\x00"...
    2025/03/18 18:55:40 rx 9: READDIR n1 {Fh 191624396 [4 +4096)  L 0 RDONLY} p51905
    2025/03/18 18:55:40 tx 9:     OK
    2025/03/18 18:55:40 rx 10: LOOKUP n1  "data" p51905
    2025/03/18 18:55:40 tx 10:     OK, {n5524361069462547824 g1 tE=1s tA=1s {M020000040777 SZ=0 L=1 0:0 B0*0 i0:5524361069462547824 A 1742332681.000000 M 1742332681.000000 C 1742332681.000000}}
    2025/03/18 18:55:40 rx 11: OPENDIR n5524361069462547824 {O_RDONLY} p64055
    2025/03/18 18:55:40 tx 11:     OK, {Fh 737302941 }
    2025/03/18 18:55:40 rx 12: READDIR n5524361069462547824 {Fh 737302941 [0 +4096)  L 0 RDONLY} p64055
    2025/03/18 18:55:40 tx 12:     OK,  104b data "\xff\xff\xff\xff\x00\x00\x00\x00"...
    2025/03/18 18:55:40 rx 13: READDIR n5524361069462547824 {Fh 737302941 [3 +4096)  L 0 RDONLY} p64055
    2025/03/18 18:55:40 tx 13:     OK
    2025/03/18 18:55:40 rx 14: RELEASEDIR n5524361069462547824 {Fh 737302941   L64055} p64055
    2025/03/18 18:55:40 tx 14:     OK
    2025/03/18 18:55:53 rx 15: LOOKUP n1  "randomfile" p65045
    2025/03/18 18:55:53 tx 15:     2=no such file or directory
    2025/03/18 18:55:53 rx 16: CREATE n1 {0100644 [RDWR,CREAT] (022)} "randomfile" p65045
    2025/03/18 18:55:53 tx 16:     78=function not implemented
    2025/03/18 18:55:53 rx 17: MKNOD n1 {0100644 (00), 0} "randomfile" p65045
    2025/03/18 18:55:53 tx 17:     OK, {n9283596112166136156 g1 tE=1s tA=1s {M0100644 SZ=0 L=1 0:0 B0*0 i0:9283596112166136156 A 1742338553.000000 M 1742338553.000000 C 1742338553.000000}}
    2025/03/18 18:55:53 rx 18: OPEN n9283596112166136156 {RDWR} p65045
    2025/03/18 18:55:53 tx 18:     OK, {Fh 18446744073619755473 CACHE}
    2025/03/18 18:55:53 rx 19: WRITE n9283596112166136156 {Fh 18446744073619755473 [0 +65536)  L 0 RDWR}"<\x9cTM\x0e\\\xd4k"... 65536b p65045
    2025/03/18 18:55:53 tx 19:     OK, {65536b }
    2025/03/18 18:55:53 rx 20: WRITE n9283596112166136156 {Fh 18446744073619755473 [65536 +65536)  L 0 RDWR}"\xf9wJ\x1b#\xbd\xf2\x8b"... 65536b p65045
    2025/03/18 18:55:53 tx 20:     OK, {65536b }
    2025/03/18 18:55:53 rx 21: WRITE n9283596112166136156 {Fh 18446744073619755473 [131072 +65536)  L 0 RDWR}"\xde+].\x93p\xa6T"... 65536b p65045
    2025/03/18 18:55:53 tx 21:     OK, {65536b }
    2025/03/18 18:55:53 rx 22: WRITE n9283596112166136156 {Fh 18446744073619755473 [196608 +65536)  L 0 RDWR}"\x82\xa9\x15\x15\xe8s>\x89"... 65536b p65045
    2025/03/18 18:55:53 tx 22:     OK, {65536b }
    2025/03/18 18:55:53 rx 23: WRITE n9283596112166136156 {Fh 18446744073619755473 [262144 +65536)  L 0 RDWR}"C5\xaf5\xf0\xa0\xcfA"... 65536b p65045
    2025/03/18 18:55:53 tx 23:     OK, {65536b }
    2025/03/18 18:55:53 rx 24: WRITE n9283596112166136156 {Fh 18446744073619755473 [327680 +65536)  L 0 RDWR}"\x13\xd3kN5~\xfeC"... 65536b p65045
    2025/03/18 18:55:53 tx 24:     OK, {65536b }
    2025/03/18 18:55:53 rx 25: WRITE n9283596112166136156 {Fh 18446744073619755473 [393216 +65536)  L 0 RDWR}"w\xb5\xa3\x8ds\xa9x'"... 65536b p65045
    2025/03/18 18:55:53 tx 25:     OK, {65536b }
    2025/03/18 18:55:53 rx 26: WRITE n9283596112166136156 {Fh 18446744073619755473 [458752 +65536)  L 0 RDWR}"Ws\xc9j1q\x9e\xa3"... 65536b p65045
    2025/03/18 18:55:53 tx 26:     OK, {65536b }
    2025/03/18 18:55:53 rx 27: WRITE n9283596112166136156 {Fh 18446744073619755473 [524288 +65536)  L 0 RDWR}"\xc0\xd1\x0e^\x7fG\x7f\x9e"... 65536b p65045
    2025/03/18 18:55:53 tx 27:     OK, {65536b }
    2025/03/18 18:55:53 rx 28: WRITE n9283596112166136156 {Fh 18446744073619755473 [589824 +65536)  L 0 RDWR}"B\x90|\xbb\n\x1f\x8bm"... 65536b p65045
    2025/03/18 18:55:53 tx 28:     OK, {65536b }
    2025/03/18 18:55:53 rx 29: WRITE n9283596112166136156 {Fh 18446744073619755473 [655360 +65536)  L 0 RDWR}"\x89\x9fJQsU\x95\xd4"... 65536b p65045
    2025/03/18 18:55:53 tx 29:     OK, {65536b }
    2025/03/18 18:55:53 rx 30: WRITE n9283596112166136156 {Fh 18446744073619755473 [720896 +65536)  L 0 RDWR}"\xa3=\xc2\x0f\x0e\x98_;"... 65536b p65045
    2025/03/18 18:55:53 tx 30:     OK, {65536b }
    2025/03/18 18:55:53 rx 31: WRITE n9283596112166136156 {Fh 18446744073619755473 [786432 +65536)  L 0 RDWR}"\x99\xb7\xef,̔\x17\x9d"... 65536b p65045
    2025/03/18 18:55:53 tx 31:     OK, {65536b }
    2025/03/18 18:55:53 rx 32: WRITE n9283596112166136156 {Fh 18446744073619755473 [851968 +65536)  L 0 RDWR}"\xb0\x1a\xdb#\a\xcb\x03\xbd"... 65536b p65045
    2025/03/18 18:55:53 tx 32:     OK, {65536b }
    2025/03/18 18:55:53 rx 33: WRITE n9283596112166136156 {Fh 18446744073619755473 [917504 +65536)  L 0 RDWR}"\xdaU\xa2O\x88\xdf\xe4n"... 65536b p65045
    2025/03/18 18:55:53 tx 33:     OK, {65536b }
    2025/03/18 18:55:53 rx 34: WRITE n9283596112166136156 {Fh 18446744073619755473 [983040 +65536)  L 0 RDWR}";'o\xed$\xcau\xe2"... 65536b p65045
    2025/03/18 18:55:53 tx 34:     OK, {65536b }
    2025/03/18 18:55:53 rx 35: FLUSH n9283596112166136156 {Fh 18446744073619755473} p65045
    2025/03/18 18:55:54 tx 35:     OK
    2025/03/18 18:55:54 rx 36: RELEASE n9283596112166136156 {Fh 18446744073619755473 RDWR  L65045} p65045
    2025/03/18 18:55:54 tx 36:     OK
    2025/03/18 18:55:54 rx 37: LOOKUP n1  "randomfile" p65274
    2025/03/18 18:55:54 tx 37:     OK, {n9283596112166136156 g1 tE=1s tA=1s {M0100644 SZ=1048576 L=1 0:0 B2048*0 i0:9283596112166136156 A 1742338554.000000 M 1742338554.000000 C 1742338554.000000}}
    2025/03/18 18:55:54 rx 38: OPEN n9283596112166136156 {RDWR} p65274
    2025/03/18 18:55:54 tx 38:     OK, {Fh 1406651878 CACHE}
    2025/03/18 18:55:54 rx 39: SETATTR n9283596112166136156 {size 0, fh 1406651878} p65274
    2025/03/18 18:55:54 tx 39:     OK, {tA=1s {M0100644 SZ=0 L=1 0:0 B0*0 i0:9283596112166136156 A 1742338554.000000 M 1742338554.000000 C 1742338554.000000}}
    2025/03/18 18:55:54 rx 40: WRITE n9283596112166136156 {Fh 1406651878 [0 +65536)  L 0 RDWR}"\xbb`p\xc0.\xe5\x83\xc2"... 65536b p65274
    2025/03/18 18:55:54 tx 40:     OK, {65536b }
    2025/03/18 18:55:54 rx 41: WRITE n9283596112166136156 {Fh 1406651878 [65536 +65536)  L 0 RDWR}"\x1c܄HG\x96y/"... 65536b p65274
    2025/03/18 18:55:54 tx 41:     OK, {65536b }
    2025/03/18 18:55:54 rx 42: WRITE n9283596112166136156 {Fh 1406651878 [131072 +65536)  L 0 RDWR}"\xfba\x93;\xa2\x05#\xff"... 65536b p65274
    2025/03/18 18:55:54 tx 42:     OK, {65536b }
    2025/03/18 18:55:54 rx 43: WRITE n9283596112166136156 {Fh 1406651878 [196608 +65536)  L 0 RDWR}"~\x037\xbf\xb86\v\xec"... 65536b p65274
    2025/03/18 18:55:54 tx 43:     OK, {65536b }
    2025/03/18 18:55:54 rx 44: WRITE n9283596112166136156 {Fh 1406651878 [262144 +65536)  L 0 RDWR}"\xd1f\xe0\xf4 \xe5\x8f "... 65536b p65274
    2025/03/18 18:55:54 tx 44:     OK, {65536b }
    2025/03/18 18:55:54 rx 45: WRITE n9283596112166136156 {Fh 1406651878 [327680 +65536)  L 0 RDWR}"\x1e\xb0\x8d~B$\x9f<"... 65536b p65274
    2025/03/18 18:55:54 tx 45:     OK, {65536b }
    2025/03/18 18:55:54 rx 46: WRITE n9283596112166136156 {Fh 1406651878 [393216 +65536)  L 0 RDWR}"\x11VS\xc5\xf1\xd6|\xd3"... 65536b p65274
    2025/03/18 18:55:54 tx 46:     OK, {65536b }
    2025/03/18 18:55:54 rx 47: WRITE n9283596112166136156 {Fh 1406651878 [458752 +65536)  L 0 RDWR}"<j\x89\xd4\xc9\xe6\"C"... 65536b p65274
    2025/03/18 18:55:54 tx 47:     OK, {65536b }
    2025/03/18 18:55:54 rx 48: WRITE n9283596112166136156 {Fh 1406651878 [524288 +65536)  L 0 RDWR}"\x17\x18\xb9\xc7\xe0:\x85\xb1"... 65536b p65274
    2025/03/18 18:55:54 tx 48:     OK, {65536b }
    2025/03/18 18:55:54 rx 49: WRITE n9283596112166136156 {Fh 1406651878 [589824 +65536)  L 0 RDWR}"\x8am\xf91\xe8\xca\xda\x06"... 65536b p65274
    2025/03/18 18:55:54 tx 49:     OK, {65536b }
    2025/03/18 18:55:54 rx 50: WRITE n9283596112166136156 {Fh 1406651878 [655360 +65536)  L 0 RDWR}"\xbbE\x92\x8f\xb9\xc5\xee\xe5"... 65536b p65274
    2025/03/18 18:55:54 tx 50:     OK, {65536b }
    2025/03/18 18:55:54 rx 51: WRITE n9283596112166136156 {Fh 1406651878 [720896 +65536)  L 0 RDWR}"\xaeE\"\xc4\a#\x0f}"... 65536b p65274
    2025/03/18 18:55:54 tx 51:     OK, {65536b }
    2025/03/18 18:55:54 rx 52: WRITE n9283596112166136156 {Fh 1406651878 [786432 +65536)  L 0 RDWR}"1C\xf6ʨ+\xa5\xae"... 65536b p65274
    2025/03/18 18:55:54 tx 52:     OK, {65536b }
    2025/03/18 18:55:54 rx 53: WRITE n9283596112166136156 {Fh 1406651878 [851968 +65536)  L 0 RDWR}"л\x00\a\x1b,\xccL"... 65536b p65274
    2025/03/18 18:55:54 tx 53:     OK, {65536b }
    2025/03/18 18:55:54 rx 54: WRITE n9283596112166136156 {Fh 1406651878 [917504 +65536)  L 0 RDWR}"n\x04^i\xb9\xfc\x18\xd5"... 65536b p65274
    2025/03/18 18:55:54 tx 54:     OK, {65536b }
    2025/03/18 18:55:54 rx 55: WRITE n9283596112166136156 {Fh 1406651878 [983040 +65536)  L 0 RDWR}"\x8b\xb0\x1a\xd8\\\x88\x1f\b"... 65536b p65274
    2025/03/18 18:55:54 tx 55:     OK, {65536b }
    2025/03/18 18:55:54 rx 56: FLUSH n9283596112166136156 {Fh 1406651878} p65274
    2025/03/18 18:55:54 tx 56:     OK
    2025/03/18 18:55:54 rx 57: RELEASE n9283596112166136156 {Fh 1406651878 RDWR  L65274} p65274
    2025/03/18 18:55:54 tx 57:     OK
    2025/03/18 18:55:55 rx 58: LOOKUP n1  "randomfile" p65543
    2025/03/18 18:55:55 tx 58:     OK, {n9283596112166136156 g1 tE=1s tA=1s {M0100644 SZ=1048576 L=1 0:0 B2048*0 i0:9283596112166136156 A 1742338554.000000 M 1742338554.000000 C 1742338554.000000}}
    2025/03/18 18:55:55 rx 59: OPEN n9283596112166136156 {RDWR} p65543
    2025/03/18 18:55:55 tx 59:     OK, {Fh 18446744073525604149 CACHE}
    2025/03/18 18:55:55 rx 60: SETATTR n9283596112166136156 {size 0, fh 18446744073525604149} p65543
    2025/03/18 18:55:55 tx 60:     OK, {tA=1s {M0100644 SZ=0 L=1 0:0 B0*0 i0:9283596112166136156 A 1742338555.000000 M 1742338555.000000 C 1742338555.000000}}
    2025/03/18 18:55:55 rx 61: WRITE n9283596112166136156 {Fh 18446744073525604149 [0 +65536)  L 0 RDWR}"\x88\xc9h(\x99\x85\xaa\x81"... 65536b p65543
    2025/03/18 18:55:55 tx 61:     OK, {65536b }
    2025/03/18 18:55:55 rx 62: WRITE n9283596112166136156 {Fh 18446744073525604149 [65536 +65536)  L 0 RDWR}"\xd5\x13\xdc\x04\x1bsg\xe2"... 65536b p65543
    2025/03/18 18:55:55 tx 62:     OK, {65536b }
    2025/03/18 18:55:55 rx 63: WRITE n9283596112166136156 {Fh 18446744073525604149 [131072 +65536)  L 0 RDWR}"\xc8v\x1b\x9b#\x99\x87\x02"... 65536b p65543
    2025/03/18 18:55:55 tx 63:     OK, {65536b }
    2025/03/18 18:55:55 rx 64: WRITE n9283596112166136156 {Fh 18446744073525604149 [196608 +65536)  L 0 RDWR}"\xfdR\x05\xc5\xc1\xb9\b\xbe"... 65536b p65543
    2025/03/18 18:55:55 tx 64:     OK, {65536b }
    2025/03/18 18:55:55 rx 65: WRITE n9283596112166136156 {Fh 18446744073525604149 [262144 +65536)  L 0 RDWR}"]\xb4X\x8c\x97,M\v"... 65536b p65543
    2025/03/18 18:55:55 tx 65:     OK, {65536b }
    2025/03/18 18:55:55 rx 66: WRITE n9283596112166136156 {Fh 18446744073525604149 [327680 +65536)  L 0 RDWR}"A\xbe\xb0\x18\xb4zA\xc6"... 65536b p65543
    2025/03/18 18:55:55 tx 66:     OK, {65536b }
    2025/03/18 18:55:55 rx 67: WRITE n9283596112166136156 {Fh 18446744073525604149 [393216 +65536)  L 0 RDWR}"Q\x96\xf3'O6\xe5\xa2"... 65536b p65543
    2025/03/18 18:55:55 tx 67:     OK, {65536b }
    2025/03/18 18:55:55 rx 68: WRITE n9283596112166136156 {Fh 18446744073525604149 [458752 +65536)  L 0 RDWR}"\xf7pҮ\x9c\xb9y\x1a"... 65536b p65543
    2025/03/18 18:55:55 tx 68:     OK, {65536b }
    2025/03/18 18:55:55 rx 69: WRITE n9283596112166136156 {Fh 18446744073525604149 [524288 +65536)  L 0 RDWR}"\xa7\xfb\xa3PK\x03\xb7\xca"... 65536b p65543
    2025/03/18 18:55:55 tx 69:     OK, {65536b }
    2025/03/18 18:55:55 rx 70: WRITE n9283596112166136156 {Fh 18446744073525604149 [589824 +65536)  L 0 RDWR}"\x1e\xfa\xceh'\fl\r"... 65536b p65543
    2025/03/18 18:55:55 tx 70:     OK, {65536b }
    2025/03/18 18:55:55 rx 71: WRITE n9283596112166136156 {Fh 18446744073525604149 [655360 +65536)  L 0 RDWR}"\x97\xe5(\xa3\x18\x90\xa9\x01"... 65536b p65543
    2025/03/18 18:55:55 tx 71:     OK, {65536b }
    2025/03/18 18:55:55 rx 72: WRITE n9283596112166136156 {Fh 18446744073525604149 [720896 +65536)  L 0 RDWR}"\xea\xbeJy\x0e5\x8fq"... 65536b p65543
    2025/03/18 18:55:55 tx 72:     OK, {65536b }
    2025/03/18 18:55:55 rx 73: WRITE n9283596112166136156 {Fh 18446744073525604149 [786432 +65536)  L 0 RDWR}"\xf8\x8c'\xe4\xf4z/E"... 65536b p65543
    2025/03/18 18:55:55 tx 73:     OK, {65536b }
    2025/03/18 18:55:55 rx 74: WRITE n9283596112166136156 {Fh 18446744073525604149 [851968 +65536)  L 0 RDWR}"\xab\x18\xa9\x05I\xd9\x11\a"... 65536b p65543
    2025/03/18 18:55:55 tx 74:     OK, {65536b }
    2025/03/18 18:55:55 rx 75: WRITE n9283596112166136156 {Fh 18446744073525604149 [917504 +65536)  L 0 RDWR}"\xbc\xb1\x03\x8e\x8a.\xc9\x17"... 65536b p65543
    2025/03/18 18:55:55 tx 75:     OK, {65536b }
    2025/03/18 18:55:55 rx 76: WRITE n9283596112166136156 {Fh 18446744073525604149 [983040 +65536)  L 0 RDWR}"\x11\xf7V\xfb;N\xf7t"... 65536b p65543
    2025/03/18 18:55:55 tx 76:     OK, {65536b }
    2025/03/18 18:55:55 rx 77: FLUSH n9283596112166136156 {Fh 18446744073525604149} p65543
    2025/03/18 18:55:55 tx 77:     OK
    2025/03/18 18:55:55 rx 78: RELEASE n9283596112166136156 {Fh 18446744073525604149 RDWR  L65543} p65543
    2025/03/18 18:55:55 tx 78:     OK
    2025/03/18 18:55:55 rx 79: LOOKUP n1  "randomfile" p65653
    2025/03/18 18:55:55 tx 79:     OK, {n9283596112166136156 g1 tE=1s tA=1s {M0100644 SZ=1048576 L=1 0:0 B2048*0 i0:9283596112166136156 A 1742338555.000000 M 1742338555.000000 C 1742338555.000000}}
    2025/03/18 18:55:55 rx 80: OPEN n9283596112166136156 {RDWR} p65653
    2025/03/18 18:55:55 tx 80:     OK, {Fh 2075241622 CACHE}
    2025/03/18 18:55:55 rx 81: SETATTR n9283596112166136156 {size 0, fh 2075241622} p65653
    2025/03/18 18:55:55 tx 81:     OK, {tA=1s {M0100644 SZ=0 L=1 0:0 B0*0 i0:9283596112166136156 A 1742338555.000000 M 1742338555.000000 C 1742338555.000000}}
    2025/03/18 18:55:55 rx 82: WRITE n9283596112166136156 {Fh 2075241622 [0 +65536)  L 0 RDWR}"\xac\xa3\"\n\x93G\xa8\xb9"... 65536b p65653
    2025/03/18 18:55:55 tx 82:     OK, {65536b }
    2025/03/18 18:55:55 rx 83: WRITE n9283596112166136156 {Fh 2075241622 [65536 +65536)  L 0 RDWR}"\x14\"\x10\t\xddk,3"... 65536b p65653
    2025/03/18 18:55:55 tx 83:     OK, {65536b }
    2025/03/18 18:55:55 rx 84: WRITE n9283596112166136156 {Fh 2075241622 [131072 +65536)  L 0 RDWR}")\xc4z\x90\xc5s\xcc\x12"... 65536b p65653
    2025/03/18 18:55:55 tx 84:     OK, {65536b }
    2025/03/18 18:55:55 rx 85: WRITE n9283596112166136156 {Fh 2075241622 [196608 +65536)  L 0 RDWR}"\x04\x1b\xa4C\x02\xe0\x04\x92"... 65536b p65653
    2025/03/18 18:55:55 tx 85:     OK, {65536b }
    2025/03/18 18:55:55 rx 86: WRITE n9283596112166136156 {Fh 2075241622 [262144 +65536)  L 0 RDWR}"\xe14\xaas\xa7\x84\xc9\x13"... 65536b p65653
    2025/03/18 18:55:55 tx 86:     OK, {65536b }
    2025/03/18 18:55:55 rx 87: WRITE n9283596112166136156 {Fh 2075241622 [327680 +65536)  L 0 RDWR}"Ia\xf7\xd9ם\xa0\x15"... 65536b p65653
    2025/03/18 18:55:55 tx 87:     OK, {65536b }
    2025/03/18 18:55:55 rx 88: WRITE n9283596112166136156 {Fh 2075241622 [393216 +65536)  L 0 RDWR}"\xe2\xad\n;\x9eg\xa6/"... 65536b p65653
    2025/03/18 18:55:55 tx 88:     OK, {65536b }
    2025/03/18 18:55:55 rx 89: WRITE n9283596112166136156 {Fh 2075241622 [458752 +65536)  L 0 RDWR}"\xf9\xc2\xf8}\xa1B6\x85"... 65536b p65653
    2025/03/18 18:55:55 tx 89:     OK, {65536b }
    2025/03/18 18:55:55 rx 90: WRITE n9283596112166136156 {Fh 2075241622 [524288 +65536)  L 0 RDWR}"\x00O>\x19E\xbc\x84}"... 65536b p65653
    2025/03/18 18:55:55 tx 90:     OK, {65536b }
    2025/03/18 18:55:55 rx 91: WRITE n9283596112166136156 {Fh 2075241622 [589824 +65536)  L 0 RDWR}"\xf7!^\"\xfdB\u0085"... 65536b p65653
    2025/03/18 18:55:55 tx 91:     OK, {65536b }
    2025/03/18 18:55:55 rx 92: WRITE n9283596112166136156 {Fh 2075241622 [655360 +65536)  L 0 RDWR}"]\r\xf1\x92\\\xbf\xd6M"... 65536b p65653
    2025/03/18 18:55:55 tx 92:     OK, {65536b }
    2025/03/18 18:55:55 rx 93: WRITE n9283596112166136156 {Fh 2075241622 [720896 +65536)  L 0 RDWR}"\xf6\x94\xe4?3dF@"... 65536b p65653
    2025/03/18 18:55:55 tx 93:     OK, {65536b }
    2025/03/18 18:55:55 rx 94: WRITE n9283596112166136156 {Fh 2075241622 [786432 +65536)  L 0 RDWR}"\xf7 \x97K\xd6\r\xc9_"... 65536b p65653
    2025/03/18 18:55:55 tx 94:     OK, {65536b }
    2025/03/18 18:55:55 rx 95: WRITE n9283596112166136156 {Fh 2075241622 [851968 +65536)  L 0 RDWR}"\x98\\\xf1\xb3.9\xd0j"... 65536b p65653
    2025/03/18 18:55:55 tx 95:     OK, {65536b }
    2025/03/18 18:55:55 rx 96: WRITE n9283596112166136156 {Fh 2075241622 [917504 +65536)  L 0 RDWR}"\xc0X\x96\x12\x96ޮo"... 65536b p65653
    2025/03/18 18:55:55 tx 96:     OK, {65536b }
    2025/03/18 18:55:55 rx 97: WRITE n9283596112166136156 {Fh 2075241622 [983040 +65536)  L 0 RDWR}"+\x84\x1f`\x19\x8f.\xf5"... 65536b p65653
    2025/03/18 18:55:55 tx 97:     OK, {65536b }
    2025/03/18 18:55:55 rx 98: FLUSH n9283596112166136156 {Fh 2075241622} p65653
    2025/03/18 18:55:55 tx 98:     OK
    2025/03/18 18:55:55 rx 99: RELEASE n9283596112166136156 {Fh 2075241622 RDWR  L65653} p65653
    2025/03/18 18:55:55 tx 99:     OK
    2025/03/18 18:55:56 rx 100: LOOKUP n1  "randomfile" p66233
    2025/03/18 18:55:56 tx 100:     OK, {n9283596112166136156 g1 tE=1s tA=1s {M0100644 SZ=1048576 L=1 0:0 B2048*0 i0:9283596112166136156 A 1742338555.000000 M 1742338555.000000 C 1742338555.000000}}
    2025/03/18 18:55:56 rx 101: OPEN n9283596112166136156 {RDWR} p66233
    2025/03/18 18:55:56 tx 101:     OK, {Fh 707652244 CACHE}
    2025/03/18 18:55:56 rx 102: SETATTR n9283596112166136156 {size 0, fh 707652244} p66233
    2025/03/18 18:55:56 tx 102:     OK, {tA=1s {M0100644 SZ=0 L=1 0:0 B0*0 i0:9283596112166136156 A 1742338556.000000 M 1742338556.000000 C 1742338556.000000}}
    2025/03/18 18:55:56 rx 103: WRITE n9283596112166136156 {Fh 707652244 [0 +65536)  L 0 RDWR}"Lp-\x04r5t\x82"... 65536b p66233
    2025/03/18 18:55:56 tx 103:     OK, {65536b }
    2025/03/18 18:55:56 rx 104: WRITE n9283596112166136156 {Fh 707652244 [65536 +65536)  L 0 RDWR}"\x00惂\x8d\x86\xe5\x8d"... 65536b p66233
    2025/03/18 18:55:56 tx 104:     OK, {65536b }
    2025/03/18 18:55:56 rx 105: WRITE n9283596112166136156 {Fh 707652244 [131072 +65536)  L 0 RDWR}"\xd6!F\x8d\xbb걧"... 65536b p66233
    2025/03/18 18:55:56 tx 105:     OK, {65536b }
    2025/03/18 18:55:56 rx 106: WRITE n9283596112166136156 {Fh 707652244 [196608 +65536)  L 0 RDWR}"ǫw\x96\x13\xd5V\xda"... 65536b p66233
    2025/03/18 18:55:56 tx 106:     OK, {65536b }
    2025/03/18 18:55:56 rx 107: WRITE n9283596112166136156 {Fh 707652244 [262144 +65536)  L 0 RDWR}"\x9d\x7f\x9d\x90\xf5`\xe1,"... 65536b p66233
    2025/03/18 18:55:56 tx 107:     OK, {65536b }
    2025/03/18 18:55:56 rx 108: WRITE n9283596112166136156 {Fh 707652244 [327680 +65536)  L 0 RDWR}"KdOw\x91\x8b\xcdS"... 65536b p66233
    2025/03/18 18:55:56 tx 108:     OK, {65536b }
    2025/03/18 18:55:56 rx 109: WRITE n9283596112166136156 {Fh 707652244 [393216 +65536)  L 0 RDWR}">\xa6Z\x8b\xa3s\xe8M"... 65536b p66233
    2025/03/18 18:55:56 tx 109:     OK, {65536b }
    2025/03/18 18:55:56 rx 110: WRITE n9283596112166136156 {Fh 707652244 [458752 +65536)  L 0 RDWR}"\x13\xd3\x13\xa6r0\xb7\x17"... 65536b p66233
    2025/03/18 18:55:56 tx 110:     OK, {65536b }
    2025/03/18 18:55:56 rx 111: WRITE n9283596112166136156 {Fh 707652244 [524288 +65536)  L 0 RDWR}"\x83\x9b\v\xb3ͧP\xd0"... 65536b p66233
    2025/03/18 18:55:56 tx 111:     OK, {65536b }
    2025/03/18 18:55:56 rx 112: WRITE n9283596112166136156 {Fh 707652244 [589824 +65536)  L 0 RDWR}"\xc2\xe8n\xbb\xf7\xab\xa8\xbe"... 65536b p66233
    2025/03/18 18:55:56 tx 112:     OK, {65536b }
    2025/03/18 18:55:56 rx 113: WRITE n9283596112166136156 {Fh 707652244 [655360 +65536)  L 0 RDWR}"\xeeӡɃ\x87\xa4J"... 65536b p66233
    2025/03/18 18:55:56 tx 113:     OK, {65536b }
    2025/03/18 18:55:56 rx 114: WRITE n9283596112166136156 {Fh 707652244 [720896 +65536)  L 0 RDWR}"\xf9\xb3\tE\xd5\xfb\xb9\x0f"... 65536b p66233
    2025/03/18 18:55:56 tx 114:     OK, {65536b }
    2025/03/18 18:55:56 rx 115: WRITE n9283596112166136156 {Fh 707652244 [786432 +65536)  L 0 RDWR}"\xa2\x85\x1d\xc0\xae\xad\x17 "... 65536b p66233
    2025/03/18 18:55:56 tx 115:     OK, {65536b }
    2025/03/18 18:55:56 rx 116: WRITE n9283596112166136156 {Fh 707652244 [851968 +65536)  L 0 RDWR}"\x97\xc7\xd0\xc4\xf1\x80s`"... 65536b p66233
    2025/03/18 18:55:56 tx 116:     OK, {65536b }
    2025/03/18 18:55:56 rx 117: WRITE n9283596112166136156 {Fh 707652244 [917504 +65536)  L 0 RDWR}"9\t\xd3冂\xad\xa4"... 65536b p66233
    2025/03/18 18:55:56 tx 117:     OK, {65536b }
    2025/03/18 18:55:56 rx 118: WRITE n9283596112166136156 {Fh 707652244 [983040 +65536)  L 0 RDWR}"\xb6)F\xf9\xa3\x91\x83\xd7"... 65536b p66233
    2025/03/18 18:55:56 tx 118:     OK, {65536b }
    2025/03/18 18:55:56 rx 119: FLUSH n9283596112166136156 {Fh 707652244} p66233
    2025/03/18 18:55:56 tx 119:     OK
    2025/03/18 18:55:56 writer: Write/Writev failed, err: 9=bad file descriptor. opcode: FLUSH
    2025/03/18 18:56:56 Failed to read from fuse conn: 9=bad file descriptor
    2025/03/18 18:56:56 rx 120: RELEASE n9283596112166136156 {Fh 707652244 RDWR  L66233} p66233
    2025/03/18 18:56:56 tx 120:     OK
    2025/03/18 18:56:56 writer: Write/Writev failed, err: 9=bad file descriptor. opcode: RELEASE
    

    Write multiple times:

    # dd if=/dev/random of=/tmp/mnt/randomfile bs=1m count=1
    1+0 records in
    1+0 records out
    1048576 bytes transferred in 0.223834 secs (4684615 bytes/sec)
    # dd if=/dev/random of=/tmp/mnt/randomfile bs=1m count=1
    1+0 records in
    1+0 records out
    1048576 bytes transferred in 0.013389 secs (78314095 bytes/sec)
    # dd if=/dev/random of=/tmp/mnt/randomfile bs=1m count=1
    1+0 records in
    1+0 records out
    1048576 bytes transferred in 0.012266 secs (85483451 bytes/sec)
    # dd if=/dev/random of=/tmp/mnt/randomfile bs=1m count=1
    1+0 records in
    1+0 records out
    1048576 bytes transferred in 0.011304 secs (92758349 bytes/sec)
    # dd if=/dev/random of=/tmp/mnt/randomfile bs=1m count=1
    # *STUCK HERE*
    
  • 14.2-RELEASE-p2

  • version 30GB 3.85 freebsd amd64

  • filer.toml:

    # A sample TOML config file for SeaweedFS filer store
    # Used with "weed filer" or "weed server -filer"
    # Put this file to one of the location, with descending priority
    #    ./filer.toml
    #    $HOME/.seaweedfs/filer.toml
    #    /etc/seaweedfs/filer.toml
    
    ####################################################
    # Customizable filer server options
    ####################################################
    [filer.options]
    # with http DELETE, by default the filer would check whether a folder is empty.
    # recursive_delete will delete all sub folders and files, similar to "rm -Rf"
    recursive_delete = false
    #max_file_name_length = 255
    
    ####################################################
    # The following are filer store options
    ####################################################
    
    [leveldb2]
    # local on disk, mostly for simple single-machine setup, fairly scalable
    # faster than previous leveldb, recommended.
    enabled = false
    dir = "./filerldb2"                    # directory to store level db files
    
    [leveldb3]
    # similar to leveldb2.
    # each bucket has its own meta store.
    enabled = false
    dir = "./filerldb3"                    # directory to store level db files
    
    [rocksdb]
    # local on disk, similar to leveldb
    # since it is using a C wrapper, you need to install rocksdb and build it by yourself
    enabled = false
    dir = "./filerrdb"                    # directory to store rocksdb files
    
    [sqlite]
    # local on disk, similar to leveldb
    enabled = false
    dbFile = "./filer.db"                # sqlite db file
    
    [mysql]  # or memsql, tidb
    # CREATE TABLE IF NOT EXISTS `filemeta` (
    #   `dirhash`   BIGINT NOT NULL       COMMENT 'first 64 bits of MD5 hash value of directory field',
    #   `name`      VARCHAR(766) NOT NULL COMMENT 'directory or file name',
    #   `directory` TEXT NOT NULL         COMMENT 'full path to parent directory',
    #   `meta`      LONGBLOB,
    #   PRIMARY KEY (`dirhash`, `name`)
    # ) DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_bin;
    
    enabled = false
    # dsn will take priority over "hostname, port, username, password, database".
    # [username[:password]@][protocol[(address)]]/dbname[?param1=value1&...&paramN=valueN]
    dsn = "root@tcp(localhost:3306)/seaweedfs?collation=utf8mb4_bin"
    hostname = "localhost"
    port = 3306
    username = "root"
    password = ""
    database = ""              # create or use an existing database
    connection_max_idle = 2
    connection_max_open = 100
    connection_max_lifetime_seconds = 0
    interpolateParams = false
    # if insert/upsert failing, you can disable upsert or update query syntax to match your RDBMS syntax:
    enableUpsert = true
    upsertQuery = """INSERT INTO `%s` (`dirhash`,`name`,`directory`,`meta`) VALUES (?,?,?,?) AS `new` ON DUPLICATE KEY UPDATE `meta` = `new`.`meta`"""
    
    [mysql2]  # or memsql, tidb
    enabled = false
    createTable = """
      CREATE TABLE IF NOT EXISTS `%s` (
        `dirhash`   BIGINT NOT NULL,
        `name`      VARCHAR(766) NOT NULL,
        `directory` TEXT NOT NULL,
        `meta`      LONGBLOB,
        PRIMARY KEY (`dirhash`, `name`)
      ) DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_bin;
    """
    hostname = "localhost"
    port = 3306
    username = "root"
    password = ""
    database = ""              # create or use an existing database
    connection_max_idle = 2
    connection_max_open = 100
    connection_max_lifetime_seconds = 0
    interpolateParams = false
    # if insert/upsert failing, you can disable upsert or update query syntax to match your RDBMS syntax:
    enableUpsert = true
    upsertQuery = """INSERT INTO `%s` (`dirhash`,`name`,`directory`,`meta`) VALUES (?,?,?,?) AS `new` ON DUPLICATE KEY UPDATE `meta` = `new`.`meta`"""
    
    [postgres] # or cockroachdb, YugabyteDB
    # CREATE TABLE IF NOT EXISTS filemeta (
    #   dirhash     BIGINT,
    #   name        VARCHAR(65535),
    #   directory   VARCHAR(65535),
    #   meta        bytea,
    #   PRIMARY KEY (dirhash, name)
    # );
    enabled = false
    hostname = "localhost"
    port = 5432
    username = "postgres"
    password = ""
    database = "postgres"          # create or use an existing database
    schema = ""
    sslmode = "disable"
    connection_max_idle = 100
    connection_max_open = 100
    connection_max_lifetime_seconds = 0
    # if insert/upsert failing, you can disable upsert or update query syntax to match your RDBMS syntax:
    enableUpsert = true
    upsertQuery = """UPSERT INTO "%[1]s" (dirhash,name,directory,meta) VALUES($1,$2,$3,$4)"""
    
    [postgres2]
    enabled = false
    createTable = """
      CREATE TABLE IF NOT EXISTS "%s" (
        dirhash   BIGINT,
        name      VARCHAR(65535),
        directory VARCHAR(65535),
        meta      bytea,
        PRIMARY KEY (dirhash, name)
      );
    """
    hostname = "localhost"
    port = 5432
    username = "postgres"
    password = ""
    database = "postgres"          # create or use an existing database
    schema = ""
    sslmode = "disable"
    connection_max_idle = 100
    connection_max_open = 100
    connection_max_lifetime_seconds = 0
    # if insert/upsert failing, you can disable upsert or update query syntax to match your RDBMS syntax:
    enableUpsert = true
    upsertQuery = """UPSERT INTO "%[1]s" (dirhash,name,directory,meta) VALUES($1,$2,$3,$4)"""
    
    [cassandra]
    # CREATE TABLE filemeta (
    #    directory varchar,
    #    name varchar,
    #    meta blob,
    #    PRIMARY KEY (directory, name)
    # ) WITH CLUSTERING ORDER BY (name ASC);
    enabled = false
    keyspace = "seaweedfs"
    hosts = [
        "localhost:9042",
    ]
    username = ""
    password = ""
    # This changes the data layout. Only add new directories. Removing/Updating will cause data loss.
    superLargeDirectories = []
    # Name of the datacenter local to this filer, used as host selection fallback.
    localDC = ""
    # Gocql connection timeout, default: 600ms
    connection_timeout_millisecond = 600
    
    [hbase]
    enabled = false
    zkquorum = ""
    table = "seaweedfs"
    
    [redis2]
    enabled = true
    address = "localhost:6379"
    password = ""
    database = 0
    # This changes the data layout. Only add new directories. Removing/Updating will cause data loss.
    superLargeDirectories = []
    
    [redis2_sentinel]
    enabled = false
    addresses = ["172.22.12.7:26379","172.22.12.8:26379","172.22.12.9:26379"]
    masterName = "master"
    username = ""
    password = ""
    database = 0
    
    [redis_cluster2]
    enabled = false
    addresses = [
        "localhost:30001",
        "localhost:30002",
        "localhost:30003",
        "localhost:30004",
        "localhost:30005",
        "localhost:30006",
    ]
    password = ""
    # allows reads from slave servers or the master, but all writes still go to the master
    readOnly = false
    # automatically use the closest Redis server for reads
    routeByLatency = false
    # This changes the data layout. Only add new directories. Removing/Updating will cause data loss.
    superLargeDirectories = []
    
    [redis_lua]
    enabled = false
    address = "localhost:6379"
    password = ""
    database = 0
    # This changes the data layout. Only add new directories. Removing/Updating will cause data loss.
    superLargeDirectories = []
    
    [redis_lua_sentinel]
    enabled = false
    addresses = ["172.22.12.7:26379","172.22.12.8:26379","172.22.12.9:26379"]
    masterName = "master"
    username = ""
    password = ""
    database = 0
    
    [redis_lua_cluster]
    enabled = false
    addresses = [
        "localhost:30001",
        "localhost:30002",
        "localhost:30003",
        "localhost:30004",
        "localhost:30005",
        "localhost:30006",
    ]
    password = ""
    # allows reads from slave servers or the master, but all writes still go to the master
    readOnly = false
    # automatically use the closest Redis server for reads
    routeByLatency = false
    # This changes the data layout. Only add new directories. Removing/Updating will cause data loss.
    superLargeDirectories = []
    
    [redis3] # beta
    enabled = false
    address = "localhost:6379"
    password = ""
    database = 0
    
    [redis3_sentinel]
    enabled = false
    addresses = ["172.22.12.7:26379","172.22.12.8:26379","172.22.12.9:26379"]
    masterName = "master"
    username = ""
    password = ""
    database = 0
    
    [redis_cluster3] # beta
    enabled = false
    addresses = [
        "localhost:30001",
        "localhost:30002",
        "localhost:30003",
        "localhost:30004",
        "localhost:30005",
        "localhost:30006",
    ]
    password = ""
    # allows reads from slave servers or the master, but all writes still go to the master
    readOnly = false
    # automatically use the closest Redis server for reads
    routeByLatency = false
    
    [etcd]
    enabled = false
    servers = "localhost:2379"
    username = ""
    password = ""
    key_prefix = "seaweedfs."
    timeout = "3s"
    # Set the CA certificate path
    tls_ca_file=""
    # Set the client certificate path
    tls_client_crt_file=""
    # Set the client private key path
    tls_client_key_file=""
    
    [mongodb]
    enabled = false
    uri = "mongodb://localhost:27017"
    username = ""
    password = ""
    ssl = false
    ssl_ca_file = ""
    ssl_cert_file = ""
    ssl_key_file = ""
    insecure_skip_verify = false
    option_pool_size = 0
    database = "seaweedfs"
    
    [elastic7]
    enabled = false
    servers = [
        "http://localhost1:9200",
        "http://localhost2:9200",
        "http://localhost3:9200",
    ]
    username = ""
    password = ""
    sniff_enabled = false
    healthcheck_enabled = false
    # increase the value is recommend, be sure the value in Elastic is greater or equal here
    index.max_result_window = 10000
    
    
    [arangodb] # in development dont use it
    enabled = false
    db_name = "seaweedfs"
    servers=["http://localhost:8529"] # list of servers to connect to
    # only basic auth supported for now
    username=""
    password=""
    # skip tls cert validation
    insecure_skip_verify = true
    
    [ydb] # https://ydb.tech/
    enabled = false
    dsn = "grpc://localhost:2136?database=/local"
    prefix = "seaweedfs"
    useBucketPrefix = true # Fast Bucket Deletion
    poolSizeLimit = 50
    dialTimeOut = 10
    
    # Authenticate produced with one of next environment variables:
    # YDB_SERVICE_ACCOUNT_KEY_FILE_CREDENTIALS=<path/to/sa_key_file> — used service account key file by path
    # YDB_ANONYMOUS_CREDENTIALS="1" — used for authenticate with anonymous access. Anonymous access needs for connect to testing YDB installation
    # YDB_METADATA_CREDENTIALS="1" — used metadata service for authenticate to YDB from yandex cloud virtual machine or from yandex function
    # YDB_ACCESS_TOKEN_CREDENTIALS=<access_token> — used for authenticate to YDB with short-life access token. For example, access token may be IAM token
    
    ##########################
    ##########################
    # To add path-specific filer store:
    #
    # 1. Add a name following the store type separated by a dot ".". E.g., cassandra.tmp
    # 2. Add a location configuration. E.g., location = "/tmp/"
    # 3. Copy and customize all other configurations.
    #     Make sure they are not the same if using the same store type!
    # 4. Set enabled to true
    #
    # The following is just using redis as an example
    ##########################
    [redis2.tmp]
    enabled = false
    location = "/tmp/"
    address = "localhost:6379"
    password = ""
    database = 1
    
    [tikv]
    enabled = false
    # If you have many pd address, use ',' split then:
    #   pdaddrs = "pdhost1:2379, pdhost2:2379, pdhost3:2379"
    pdaddrs = "localhost:2379"
    # Concurrency for TiKV delete range
    deleterange_concurrency = 1
    # Enable 1PC
    enable_1pc = false
    # Set the CA certificate path
    ca_path=""
    # Set the certificate path
    cert_path=""
    # Set the private key path
    key_path=""
    # The name list used to verify the cn name
    verify_cn=""
    

Expected behavior

The client can make as many write and read requests as it wants on the mounted file system and should not crash.

Additional context

  • Changes I applied:

    diff --git a/weed/command/mount_freebsd.go b/weed/command/mount_freebsd.go
    new file mode 100644
    index 0000000..05d6a1b
    --- /dev/null
    +++ b/weed/command/mount_freebsd.go
    @@ -0,0 +1,5 @@
    +package command
    +
    +func checkMountPointAvailable(dir string) bool {
    +	return true
    +}
    diff --git a/weed/command/mount_notsupported.go b/weed/command/mount_notsupported.go
    index 894c8e3..1e5c9f5 100644
    --- a/weed/command/mount_notsupported.go
    +++ b/weed/command/mount_notsupported.go
    @@ -1,5 +1,5 @@
    -//go:build !linux && !darwin
    -// +build !linux,!darwin
    +//go:build !linux && !darwin && !freebsd
    +// +build !linux,!darwin,!freebsd
     
     package command
     
    diff --git a/weed/command/mount_std.go b/weed/command/mount_std.go
    index f00daba..7345dcc 100644
    --- a/weed/command/mount_std.go
    +++ b/weed/command/mount_std.go
    @@ -1,5 +1,5 @@
    -//go:build linux || darwin
    -// +build linux darwin
    +//go:build linux || darwin || freebsd
    +// +build linux darwin freebsd
     
     package command
     
    diff --git a/weed/mount/weedfs_attr_freebsd.go b/weed/mount/weedfs_attr_freebsd.go
    new file mode 100644
    index 0000000..e7767d4
    --- /dev/null
    +++ b/weed/mount/weedfs_attr_freebsd.go
    @@ -0,0 +1,8 @@
    +package mount
    +
    +import (
    +	"github.com/hanwen/go-fuse/v2/fuse"
    +)
    +
    +func setBlksize(out *fuse.Attr, size uint32) {
    +}
    diff --git a/weed/mount/weedfs_xattr.go b/weed/mount/weedfs_xattr.go
    index e1d6d43..78acaaf 100644
    --- a/weed/mount/weedfs_xattr.go
    +++ b/weed/mount/weedfs_xattr.go
    @@ -1,3 +1,6 @@
    +//go:build !freebsd
    +// +build !freebsd
    +
     package mount
     
     import (
    diff --git a/weed/mount/weedfs_xattr_freebsd.go b/weed/mount/weedfs_xattr_freebsd.go
    new file mode 100644
    index 0000000..01cb748
    --- /dev/null
    +++ b/weed/mount/weedfs_xattr_freebsd.go
    @@ -0,0 +1,27 @@
    +package mount
    +
    +import (
    +	"syscall"
    +
    +	"github.com/hanwen/go-fuse/v2/fuse"
    +)
    +
    +func (wfs *WFS) GetXAttr(cancel <-chan struct{}, header *fuse.InHeader, attr string, dest []byte) (size uint32, code fuse.Status) {
    +
    +	return 0, fuse.Status(syscall.ENOTSUP)
    +}
    +
    +func (wfs *WFS) SetXAttr(cancel <-chan struct{}, input *fuse.SetXAttrIn, attr string, data []byte) fuse.Status {
    +
    +	return fuse.Status(syscall.ENOTSUP)
    +}
    +
    +func (wfs *WFS) ListXAttr(cancel <-chan struct{}, header *fuse.InHeader, dest []byte) (n uint32, code fuse.Status) {
    +
    +	return 0, fuse.Status(syscall.ENOTSUP)
    +}
    +
    +func (wfs *WFS) RemoveXAttr(cancel <-chan struct{}, header *fuse.InHeader, attr string) fuse.Status {
    +
    +	return fuse.Status(syscall.ENOTSUP)
    +}
    
  • Command I used to install SeaweedFS: cd weed; go123 install

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 22 (6 by maintainers)

Commits related to this issue

Most upvoted comments

I figured out the underlying cause and it’s within the go-fuse dependency. I’ve submitted a fix, which is actually outside of GitHub. But the relevant issue is here: https://github.com/hanwen/go-fuse/issues/570#issue-3064133503

I’m able to reproduce this on FreeBSD, as well, identical to what @DtxdF is reproducing.

On my end, I went ahead and implemented extended attributes and tried with and without them. I also tried with (like Linux) and without (like macOS) a functioning set-block-size. I also tried with and without the Fuse FOPEN_DIRECT_IO flag. Same results for all of these.

Another observation is that I can reproduce this with a variety of opcodes in addition to what was already shared in this thread. Basically any kind of read or write: WRITE, GETATTR, etc. From just issuing ls, it’ll happen eventually.

I need to spend more time debugging, but what I’ve determined so far is that the error is occurring (not necessarily the cause) in the go-fuse server’s main event loop. You can see the exact line here. I’m going to try to make time to attach a debugger and see what I can do.

I just tested 3.91 on FreeBSD 14.2/amd64 and it mounts fine. 🎉

That’s up to you. It adds an additional chore for updating it to the eventual release. But tens of people will be happy to have a working out-of-the-box experience on FreeBSD. 😂

That was it! 🎉

diff --git go.mod go.mod
index 8377994d4..dc996b283 100644
--- go.mod
+++ go.mod
@@ -376,3 +376,4 @@ require (
 )

 // replace github.com/seaweedfs/raft => /Users/chrislu/go/src/github.com/seaweedfs/raft
+replace github.com/hanwen/go-fuse/v2 => github.com/gplusplus314/go-fuse/v2 v2.0.0-20250514193950-67824cea0882

This is the log (but now the sha256 command completes correctly!):

2025/05/15 17:00:11 Unimplemented opcode BMAP
I0515 17:00:15.450986 needle_map_leveldb.go:122 generateLevelDbFile /tmp/2f593984/c1_3_0.ldb, watermark 0, num of entries:0
I0515 17:00:15.452508 needle_map_leveldb.go:66 Loading /tmp/2f593984/c1_3_0.ldb... , watermark: 0

@gplusplus314 Amazing! Good job!