Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fs: TestFsstress is flaky #475

Open
navytux opened this issue Jun 12, 2023 · 6 comments
Open

fs: TestFsstress is flaky #475

navytux opened this issue Jun 12, 2023 · 6 comments

Comments

@navytux
Copy link
Contributor

navytux commented Jun 12, 2023

From #351 (comment) :

I've got another TestFsstress failure at go-fuse v2.3.0-11-g255ab74. That version, in particular, includes 255ab74.

12:45:45.970930 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
warning: Inode.Path: n2 is orphaned, replacing segment with ".go-fuse.4666279343545617719/deleted"
12:45:46.166676 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
12:45:46.284954 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
12:45:46.342772 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
12:45:46.369796 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
12:45:46.456967 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
12:45:47.327570 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
12:45:47.327707 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
12:45:47.328502 writer: Write/Writev failed, err: 2=no such file or directory. opcode: RELEASE
warning: Inode.Path: n567 is orphaned, replacing segment with ".go-fuse.1073832560954626622/deleted"
warning: Inode.Path: n5490 is orphaned, replacing segment with ".go-fuse.15929077051455086100/deleted"
warning: Inode.Path: n6051 is orphaned, replacing segment with ".go-fuse.7098621326877533631/deleted"
warning: Inode.Path: n8610 is orphaned, replacing segment with ".go-fuse.9355199625240218809/deleted"
warning: Inode.Path: n15007 is orphaned, replacing segment with ".go-fuse.5951481454756182047/deleted"
warning: Inode.Path: n24746 is orphaned, replacing segment with ".go-fuse.13974702919866109658/deleted"
warning: Inode.Path: n25761 is orphaned, replacing segment with ".go-fuse.5511963782115108399/deleted"
warning: Inode.Path: n25951 is orphaned, replacing segment with ".go-fuse.423790033232240529/deleted"
warning: Inode.Path: n28572 is orphaned, replacing segment with ".go-fuse.10958862957643350033/deleted"
warning: Inode.Path: n28958 is orphaned, replacing segment with ".go-fuse.1931156569618523497/deleted"
--- FAIL: TestFsstress (1.34s)
    simple_test.go:630: Operation statistics:
    simple_test.go:633:      creat:   100 ok,   3022 fail,  0 hung
    simple_test.go:633:       link:   888 ok,   2772 fail,  0 hung
    simple_test.go:633:      mkdir:   944 ok,   2260 fail,  0 hung
    simple_test.go:633:     mkfifo:   723 ok,   2494 fail,  0 hung
    simple_test.go:633: mknod_fifo:  1023 ok,   2186 fail,  0 hung
    simple_test.go:633:  mknod_reg:   807 ok,   2349 fail,  0 hung
    simple_test.go:633: mknod_sock:   192 ok,   2970 fail,  0 hung
    simple_test.go:633:    readdir:   188 ok,      0 fail,  0 hung
    simple_test.go:633:     remove:  1571 ok,    827 fail,  0 hung
    simple_test.go:633:     rename:  2869 ok,    433 fail,  0 hung
    simple_test.go:633:      rmdir:   854 ok,   2265 fail,  0 hung
    simple_test.go:633:    symlink:   102 ok,   2990 fail,  0 hung
    simple_test.go:633:     unlink:  1536 ok,   1584 fail,  0 hung
    simple_test.go:51: /usr/bin/fusermount3: failed to unmount /tmp/TestFsstress2010734463/001/mnt: Device or resource busy
         (code exit status 1)
        
    testing.go:1206: TempDir RemoveAll cleanup: unlinkat /tmp/TestFsstress2010734463/001/mnt: device or resource busy
FAIL
FAIL    github.com/hanwen/go-fuse/fs    2.811s
@navytux navytux mentioned this issue Jun 12, 2023
Open
@hanwen
Copy link
Owner

hanwen commented Jun 12, 2023

should be fixed by 255ab74

@hanwen hanwen closed this as completed Jun 12, 2023
@navytux
Copy link
Contributor Author

navytux commented Jun 12, 2023

@hanwen, you probably misread what I wrote in the header:

I've got another TestFsstress failure at go-fuse v2.3.0-11-g255ab74. That version, in particular, includes 255ab74.

this means that I've got TestFSStress failure on go-fuse which included the patch you referenced.

Please reopen.

@navytux
Copy link
Contributor Author

navytux commented Jun 14, 2023

I got it failing once again, but, unfortunately, not reliably:

(neo) (z-dev) (g.env) kirr@deca:~/src/neo/src/github.com/hanwen/go-fuse/fs$ go test -run TestFsstress -count 1000 -failfast
warning: Inode.Path: n4527 is orphaned, replacing segment with ".go-fuse.3012759173256105457/deleted"
warning: Inode.Path: n22144 is orphaned, replacing segment with ".go-fuse.9756330391156323377/deleted"
warning: Inode.Path: n25230 is orphaned, replacing segment with ".go-fuse.17197383487763495221/deleted"
...
warning: Inode.Path: n22539 is orphaned, replacing segment with ".go-fuse.4305536118502151838/deleted"
warning: Inode.Path: n30 is orphaned, replacing segment with ".go-fuse.14179140337420484980/deleted"
warning: Inode.Path: n21397 is orphaned, replacing segment with ".go-fuse.7714991980952576349/deleted"
--- FAIL: TestFsstress (1.31s)
    simple_test.go:628: Operation statistics:
    simple_test.go:631:      creat:    40 ok,   2975 fail,  0 hung
    simple_test.go:631:       link:   292 ok,   2629 fail,  0 hung
    simple_test.go:631:      mkdir:  1438 ok,   1608 fail,  0 hung
    simple_test.go:631:     mkfifo:   326 ok,   2684 fail,  0 hung
    simple_test.go:631: mknod_fifo:  1157 ok,   1889 fail,  0 hung
    simple_test.go:631:  mknod_reg:   446 ok,   2569 fail,  0 hung
    simple_test.go:631: mknod_sock:  1235 ok,   1810 fail,  0 hung
    simple_test.go:631:    readdir:   169 ok,      0 fail,  0 hung
    simple_test.go:631:     remove:  1700 ok,    622 fail,  0 hung
    simple_test.go:631:     rename:  2448 ok,    598 fail,  0 hung
    simple_test.go:631:      rmdir:  1215 ok,   2530 fail,  0 hung
    simple_test.go:631:    symlink:    50 ok,   3016 fail,  0 hung
    simple_test.go:631:     unlink:  1581 ok,   1418 fail,  0 hung
    simple_test.go:51: /usr/bin/fusermount3: failed to unmount /tmp/TestFsstress698869219/001/mnt: Device or resource busy
         (code exit status 1)
        
    testing.go:1206: TempDir RemoveAll cleanup: unlinkat /tmp/TestFsstress698869219/001/mnt: device or resource busy
FAIL
exit status 1
FAIL    github.com/hanwen/go-fuse/fs    35.283s

go-fuse v2.3.0-11-g255ab74

@hanwen, please reopen.

@navytux
Copy link
Contributor Author

navytux commented Jun 22, 2023 •
edited
Loading

Still could get it to fail:

(neo) (z-dev) (g.env) kirr@deca:~/src/neo/src/github.com/hanwen/go-fuse/fs$ go test -run TestFsstress -count 1000 -failfast
warning: Inode.Path: n236 is orphaned, replacing segment with ".go-fuse.7384340859007351255/deleted"
warning: Inode.Path: n11787 is orphaned, replacing segment with ".go-fuse.2253797399372035776/deleted"
warning: Inode.Path: n21305 is orphaned, replacing segment with ".go-fuse.15793977081127356460/deleted"
warning: Inode.Path: n21746 is orphaned, replacing segment with ".go-fuse.6029892929214493211/deleted"
...
warning: Inode.Path: n17708 is orphaned, replacing segment with ".go-fuse.3968296718397408200/deleted"
warning: Inode.Path: n2003 is orphaned, replacing segment with ".go-fuse.13041463111349396888/deleted"
warning: Inode.Path: n2581 is orphaned, replacing segment with ".go-fuse.10562597967895856870/deleted"
--- FAIL: TestFsstress (1.30s)
    simple_test.go:629: Operation statistics:
    simple_test.go:632:      creat:     9 ok,   3016 fail,  0 hung
    simple_test.go:632:       link:   300 ok,   2996 fail,  0 hung
    simple_test.go:632:      mkdir:   555 ok,   2459 fail,  0 hung
    simple_test.go:632:     mkfifo:   531 ok,   2474 fail,  0 hung
    simple_test.go:632: mknod_fifo:   296 ok,   2711 fail,  0 hung
    simple_test.go:632:  mknod_reg:   918 ok,   2149 fail,  0 hung
    simple_test.go:632: mknod_sock:   510 ok,   2504 fail,  0 hung
    simple_test.go:632:    readdir:   180 ok,      0 fail,  0 hung
    simple_test.go:632:     remove:  1188 ok,    919 fail,  0 hung
    simple_test.go:632:     rename:  2338 ok,    654 fail,  0 hung
    simple_test.go:632:      rmdir:   541 ok,   2507 fail,  0 hung
    simple_test.go:632:    symlink:   828 ok,   2231 fail,  0 hung
    simple_test.go:632:     unlink:  1889 ok,   1164 fail,  0 hung
    simple_test.go:51: /usr/bin/fusermount3: failed to unmount /tmp/TestFsstress1329352465/001/mnt: Device or resource busy
         (code exit status 1)
        
    testing.go:1206: TempDir RemoveAll cleanup: unlinkat /tmp/TestFsstress1329352465/001/mnt: device or resource busy
FAIL
exit status 1
FAIL    github.com/hanwen/go-fuse/fs    76.530s

go-fuse: v2.3.0-19-g0b3e1fd (fs: return children in insertion order)

@hanwen, please reopen.

@navytux
Copy link
Contributor Author

navytux commented Oct 29, 2024

Still could get to fail TestFsstress: #351 (comment) .

@hanwen hanwen reopened this Oct 29, 2024
@navytux
Copy link
Contributor Author

navytux commented Oct 30, 2024

/cc @rfjakob

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hanwen @navytux