Fix coreutils

[qianxichen233]

As most of the single process tests suites are able to run, we can now start working on compiling and running coreutils. This issue serves as a progress tracker for coreutils. Below is the current state of coreutils programs:

• Tested the base use case and are working (but havn’t with many options/flags set):
• base32,
• base64,
• dir,
• echo,
• env,
• head,
• ls,
• mkdir,
• pwd,
• rmdir,
• tail,
• touch,
• wc
• cat,
• Tested but not working for some reason (e.g. mmap):
• cp,
• du,
• md5sum,
• mv,
• rm
• Havn't tested at all:
• '[',
• b2sum,
• basename,
• basenc,
• chcon,
• chgrp,
• chmod,
• chown,
• chroot,
• cksum,
• comm,
• csplit,
• cut,
• date,
• dcgen,
• dd,
• df,
• dircolors,
• expand,
• expr,
• factor,
• false,
• fmt,
• fold,
• getlimits,
• ginstall,
• groups,
• id,
• join,
• kill,
• link,
• ln,
• logname,
• make-prime-list,
• mkfifo,
• mknod,
• mktemp,
• nice,
• nl,
• nproc,
• numfmt,
• od,
• paste,
• pathchk,
• pinky,
• pr,
• printenv,
• printf,
• ptx,
• readlink,
• realpath,
• runcon,
• seq,
• sha1sum,
• sha224sum,
• sha256sum,
• sha384sum,
• sha512sum,
• shred,
• shuf,
• sleep,
• sort,
• split,
• stat,
• stty,
• sum,
• sync,
• tac,
• tee,
• test,
• timeout,
• tr,
• true,
• truncate,
• tsort,
• tty,
• uname,
• unexpand,
• uniq,
• unlink,
• uptime,
• users,
• vdir,
• who,
• whoami,
• yes
• We may not want to support:
• nohup,

[yzhang71]

• Working on testing:
• [, Working
• b2sum, Working
• basename, Working
• basenc, Issue: asyncify_start_unwind export not found Command: basenc --base64 file.txt
• chcon, Working
• chgrp, Issue: asyncify_start_unwind export not found Command: chgrp newgroup file.txt
• chmod, Working
• chown, Issue: asyncify_start_unwind export not found Command: chown user:group file.txt
• chroot, Issue: asyncify_start_unwind export not found Command: chroot /new/root /bin/bash
• cksum, Working
• comm, Issue: asyncify_start_unwind export not found Command: comm file1.txt file2.txt
• csplit, Issue: asyncify_start_unwind export not found Command: csplit file.txt 5
• cut, Working
• date, Working
• dcgen, Working
• dd, Issue: asyncify_start_unwind export not found Command: dd if=/dev/zero of=file.img bs=1M count=10
• df, Issue: asyncify_start_unwind export not found Command: df -h
• dircolors, Working
• expand, Working
• expr, Working
• factor, Working
• false, Working
• fmt, Working
• fold, Working
• getlimits, Issue: !__frexp Command: getlimits
• ginstall, Working
• groups, Working
• id, Working
• join, Issue: asyncify_start_unwind export not found Command: join file.txt file.txt
• kill, Working
• link, Issue: asyncify_start_unwind export not found Command: link file1.txt file2.txt
• ln, Working
• logname, Issue: asyncify_start_unwind export not found Command: logname
• make-prime-list, Working
• mkfifo, Working
• mknod, Working
• mktemp, Working
• nice, Issue: asyncify_start_unwind export not found Command: nice -n 10 cat
• nl, Working
• nohup, Issue: asyncify_start_unwind export not found Command: nohup whoami &
• nproc, Working
• numfmt, Issue: !__frexpl Command: numfmt --to=si 1000
• od, Working
• paste,
• pathchk,
• pinky,
• pr,
• printenv,
• printf,
• ptx,
• readlink,
• realpath,
• runcon,
• seq,
• sha1sum,
• sha224sum,
• sha256sum,
• sha384sum,
• sha512sum,
• shred,
• shuf,
• sleep,
• sort,
• split,
• stat,
• stty,
• sum,
• sync,
• tac,
• tee,
• test,
• timeout,
• tr,
• true,
• truncate,
• tsort,
• tty,
• uname,
• unexpand,
• uniq,
• unlink,
• uptime,
• users,
• vdir,
• who,
• whoami,
• yes

[qianxichen233]

any asyncify_start_unwind export not found error is because the wasm hasn't been applied to wasm-opt asyncify. It should go away after doing so. @yzhang71

[robinyuan1002]

• Working on testing:
• [, Working
• b2sum, Working.
• basename, Working
• basenc, Working
• chcon, Working
• chgrp, Issue: seems we don't support this Command: chgrp newgroup file.txt
• chmod, Working
• chown, Issue: seems we don't support this Command: chown user:group file.txt.
• chroot, Issue: seems we don't support this Command: chroot /new/root /bin/bash
• cksum, Working
• comm, Working
• csplit, Working
• cut, Working
• date, Working
• dcgen, Working
• dd, Issue: Caused by: 1: error while executing at wasm backtrace: 0: 0xdefd1 - !<wasm function 174> 1: 0x173904 - !<wasm function 595> 2: 0x11c680 - !<wasm function 333> 3: 0x126bd6 - !<wasm function 357> 4: 0x5ef6f - !<wasm function 139> 5: 0xae4fa - !<wasm function 148> 6: 0xdcaf4 - !<wasm function 162> 7: 0x5dbec - !<wasm function 136> 8: 0x54d20 - !<wasm function 120> 9: 0x54966 - !<wasm function 119> 10: 0x1142c - !<wasm function 26> 11: 0x69a7 - !<wasm function 19> 12: 0x2079 - !<wasm function 15> 13: 0x1966 - !<wasm function 14> 14: 0x1e8349 - !<wasm function 859> Command: dd if=/dev/zero of=file.img bs=1M count=10
• df, Issue:df: cannot read table of mounted file systems: No such file or directory Command: df -h
• dircolors, Working
• expand, Working
• expr, Working
• factor, Working
• false, Working
• fmt, Working
• fold, Working
• getlimits, Issue: !__frexp Command: getlimits
• ginstall, Working
• groups, Working
• id, Working
• join, Working
• kill, Working
• link, Issue: ???link: cannot create link 'file2.txt' to 'file1.txt': File exists(but the file did exist) Command: link file1.txt file2.txt
• ln, Working
• logname, we don't need this
• make-prime-list, Working
• mkfifo, Working
• mknod, Working
• mktemp, Working
• nice, Issue: thread 'main' panicked at /home/lind-wasm/wasmtime/crates/lind-multi-process/src/lib.rs:965:50:
  exec-ed module error: failed to parse /bin/cat: input bytes aren't valid utf-8 note: run with RUST_BACKTRACE=1 environment variable to display a backtrace Command: nice -n 10 cat file.txt
• nl, Working
• nohup, Issue: never end Command: nohup whoami &
• nproc, Working
• numfmt, Issue: !__frexpl Command: numfmt --to=si 1000
• od, Working
• paste, Working
• pathchk, Working
• pinky, Working
• pr, Working
• printenv, Working
• printf, Working
• ptx, issue:???????????????????????? Command: ptx file1.txt
• readlink, issue: error while executing at wasm backtrace: 0: 0x160d3 - !abort 1: 0x404f9 - !__libc_message_impl 2: 0x28ac0 - !malloc_printerr 3: 0x2b7ce - !__libc_realloc 4: 0x15bc0 - !rpl_realloc 5: 0x1c87 - !areadlink_with_size 6: 0x169c - !main 7: 0xbea - !__main_void 8: 0xa7a - !_start 9: 0x5e624 - !_start.command_export Command: readlink symlink
• realpath, issue: / Command: realpath file1.txt
• runcon, issue: runcon: runcon may be used only on a SELinux kernel
• seq, Working
• sha1sum, Working
• sha224sum, Working
• sha256sum, Working
• sha384sum, Working
• sha512sum, Working
• shred, issue: never end Command: shred file1.txt
• shuf, issue: never end Command: shuf file1.txt
• sleep, issue: 1: error while executing at wasm backtrace: 0: 0xf80f - !abort 1: 0x39a48 - !__libc_message_impl 2: 0x4bacd - !__libc_assert_fail 3: 0xcdf7 - !____strtod_l_internal 4: 0xc242 - !strtod 5: 0x1926 - !cl_strtod 6: 0xbe85 - !xstrtod 7: 0x13b9 - !main 8: 0xbe3 - !__main_void 9: 0xa73 - !_start 10: 0x57ae5 - !_start.command_export Command: sleep 5
• sort, Working
• split, Working
• stat, Working
• stty, issue: stty: 'standard input' Command: stty -a
• sum, Working
• sync, Working
• tac, Working
• tee, issue: bash: ./tee: cannot execute binary file: Exec format error Command: "Hello" | ./tee file1.txt
• test, issue: file didn't exist but give out put "File exist" Command: test -f file.txt && echo "File exists"
• timeout, issue: 1: error while executing at wasm backtrace: 0: 0x39051 - !abort 1: 0x69a86 - !__libc_message_impl 2: 0x7b99f - !__libc_assert_fail 3: 0x360ac - !____strtod_l_internal 4: 0x354f7 - !strtod 5: 0x35b4 - !cl_strtod 6: 0xde0a - !xstrtod 7: 0x1f9f - !parse_duration 8: 0x1771 - !main 9: 0xce6 - !__main_void 10: 0xb76 - !_start 11: 0x88c83 - !_start.command_export Command: timeout 5s yes
• tr, issue: ??? Command: tr 'a-z' 'A-Z'
• true, Working
• truncate, issue: truncate: Invalid number: '0': Numerical result out of range Command: truncate -s 0 file1.txt
• tsort, issue: never end Command: tsort file1.txt
• tty, issue*: not a ttyroot Command: tty
• uname, issue*: 1: error while executing at wasm backtrace: 0: 0x604 - !signature_mismatch:uname 1: 0x131b - !main 2: 0xb91 - !__main_void 3: 0xa21 - !_start 4: 0x53c9f - !_start.command_export Command: uname -a
• unexpand, Working
• uniq, issue*: never end Command: uniq file1.txt
• unlink, Working
• uptime, issue*: never end Command: uptime
• users, we don't need this
• vdir, issue*: 1: error while executing at wasm backtrace: 0: 0x7cd06 - !abort 1: 0xb6464 - !__libc_message_impl 2: 0x9d8fe - !malloc_printerr 3: 0xa060c - !__libc_realloc 4: 0x4e442 - !rpl_realloc 5: 0x6d4eb - !vasnprintf 6: 0x4e4f4 - !rpl_snprintf 7: 0x139dd - !format_user_or_group_width 8: 0xd8a7 - !format_user_width 9: 0x8270 - !gobble_file 10: 0xa0bb - !print_dir 11: 0x1f25 - !main 12: 0x10be - !__main_void 13: 0xf4e - !_start 14: 0xe9642 - !_start.command_export Command: vdir
• who, we don't need this
• whoami, we don't need this
• yes, Working