docs: update all documentation with current test coverage and POSIX gap analysis

- Update test counts across all docs: 120 smoke tests, 33 battery, 69 host
- Update syscall count: 141 syscalls, 124/141 tested (87.9% coverage)
- Add syscall test coverage section listing 17 untested syscalls
- Add comprehensive POSIX gaps section for 100% compliance
- Categories: process/credentials, filesystem, signals, POSIX timers,
  IPC, memory, network, threads
- Mark madvise and execveat as implemented in FULL_POSIX_AUDIT.md

diff --git a/BUILD_GUIDE.md b/BUILD_GUIDE.md
index 0764b21fafc4b3c299f5476b97e24a766bdfc60b..6dca4bec28cac719fe3882e397ad1cf30383ea0e 100644 (file)
--- a/BUILD_GUIDE.md
+++ b/BUILD_GUIDE.md
@@ -107,7 +107,7 @@ Syscall return convention note:
 
 ### Userland programs
 The following ELF binaries are bundled in the initrd:
-- `/sbin/fulltest` — comprehensive smoke test suite (102 checks)
+- `/sbin/fulltest` — comprehensive smoke test suite (120 checks)
 - `/sbin/init` — SysV-like init process (inittab, runlevels, respawn)
 - `/bin/sh` — POSIX sh-compatible shell with `$PATH` search, pipes, redirects, builtins
 - `/bin/echo`, `/bin/cat`, `/bin/ls`, `/bin/mkdir`, `/bin/rm` — core utilities
@@ -132,7 +132,7 @@ The following ELF binaries are bundled in the initrd:
 The ulibc provides: `printf`, `malloc`/`free`/`calloc`/`realloc`, `string.h`, `unistd.h`, `errno.h`, `pthread.h`, `signal.h` (with `raise`, `sigaltstack`, `sigpending`, `sigsuspend`), `stdio.h` (buffered I/O with `fopen`/`fread`/`fwrite`/`fclose`), `stdlib.h` (`atof`, `strtol`, `getenv` stub, `system` stub), `ctype.h`, `sys/mman.h` (`mmap`/`munmap`), `sys/ioctl.h` (`ioctl`), `time.h` (`nanosleep`/`clock_gettime`), `sys/times.h`, `sys/uio.h`, `sys/types.h`, `sys/stat.h`, `math.h` (`fabs`), `assert.h`, `fcntl.h`, `strings.h`, `inttypes.h`, `linux/futex.h`, and `realpath()`.
 
 ### Smoke tests
-The fulltest binary (`/sbin/fulltest`) runs a comprehensive suite of 102 smoke tests on boot, covering:
+The fulltest binary (`/sbin/fulltest`) runs a comprehensive suite of 120 smoke tests on boot, covering:
 - File I/O (`open`, `read`, `write`, `close`, `lseek`, `stat`, `fstat`)
 - Overlay copy-up, `dup2`, `pipe`, `select`, `poll`
 - TTY/ioctl, job control (`SIGTTIN`/`SIGTTOU`)
@@ -153,9 +153,15 @@ The fulltest binary (`/sbin/fulltest`) runs a comprehensive suite of 102 smoke t
 - Memory: `brk`, `mmap`/`munmap`, `clock_gettime`, shared memory (`shmget`/`shmat`/`shmdt`)
 - Advanced: `pread`/`pwrite`, `ftruncate`, `symlink`/`readlink`, `access`, `sigprocmask`/`sigpending`, `alarm`/`SIGALRM`, `O_APPEND`, `umask`, pipe capacity (`F_GETPIPE_SZ`/`F_SETPIPE_SZ`), `waitid`, `setitimer`/`getitimer`, `select`/`poll` on regular files, hard links
 - Advanced I/O: `epoll` (create/ctl/wait on pipe), `epollet` (edge-triggered), `inotify` (init/add_watch/rm_watch), `aio_*` (read/write/error/return)
-- System: `gettimeofday`, `mprotect`, `getrlimit`/`setrlimit`, `uname`
-- Dynamic linking: lazy PLT resolution, PLT caching
+- System: `gettimeofday`, `mprotect`, `getrlimit`/`setrlimit`, `uname`, `mount`/`umount2`
+- Dynamic linking: lazy PLT resolution, PLT caching, `dlopen`/`dlsym`/`dlclose`
 - LZ4 initrd decompression
+- Threads: `clone` (thread creation), `futex` (FUTEX_WAIT/WAKE)
+- Signals: `sigaltstack`, `sigqueue`, `sigsuspend`
+- IPC: POSIX message queues (`mq_*`), named semaphores (`sem_*`)
+- Network: socket API (`socket`/`bind`/`listen`/`getsockname`/`shutdown`)
+- Credentials: `chown`, `geteuid`/`getegid`, `seteuid`/`setegid`
+- Advanced: `pivot_root`, `execveat`, `CLOCK_MONOTONIC`
 
 All tests print `[test] ... OK` on success. Any failure calls `sys_exit(1)`.
 
@@ -169,10 +175,10 @@ make test-all
 Individual test targets:
 ```bash
 make check        # cppcheck + sparse + gcc -fanalyzer
-make test-host    # 115 host-side tests (test_utils + test_security + test_host_utils.sh)
-make test         # QEMU smoke test (4 CPUs, 120s timeout, 102 checks incl. ICMP ping, epoll, epollet, inotify, aio, LZ4, lazy PLT)
+make test-host    # 69 host-side tests (test_utils + test_security + test_host_utils.sh)
+make test         # QEMU smoke test (4 CPUs, 120s timeout, 120 checks incl. ICMP ping, epoll, epollet, inotify, aio, LZ4, lazy PLT, clone, pivot_root, dlopen/dlsym/dlclose, execveat, futex, sigaltstack, socket API, mqueue, semaphores, chown, mount/umount2)
 make test-1cpu    # Single-CPU smoke test (50s timeout)
-make test-battery # Full test battery: multi-disk ATA, VFS mount, ping, diskfs (16 checks)
+make test-battery # Full test battery: multi-disk ATA, VFS mount, ping, diskfs, clone, socket API, mqueue, semaphores, futex, sigaltstack, chown, mount/umount2 (33 checks)
 make test-gdb     # GDB scripted integrity checks (heap, PMM, VGA)
 ```
 

diff --git a/README.md b/README.md
index cf20df517f1949a224b891d19fbd0b18f016fff0..1414033af5cd68c6aa095a3693d4d8f89cf2bd3b 100644 (file)
--- a/README.md
+++ b/README.md
@@ -134,7 +134,7 @@ AdrOS is a Unix-like, POSIX-compatible, multi-architecture operating system deve
 - **Shell** — `/bin/sh` (POSIX sh-compatible with builtins, pipes, redirects, `$PATH` search)
 - **52 userland programs** — `/bin/cat`, `/bin/ls`, `/bin/mkdir`, `/bin/rm`, `/bin/echo`, `/bin/cp`, `/bin/mv`, `/bin/touch`, `/bin/ln`, `/bin/head`, `/bin/tail`, `/bin/wc`, `/bin/sort`, `/bin/uniq`, `/bin/cut`, `/bin/grep`, `/bin/sed`, `/bin/awk`, `/bin/find`, `/bin/which`, `/bin/chmod`, `/bin/chown`, `/bin/chgrp`, `/bin/mount`, `/bin/umount`, `/bin/ps`, `/bin/top`, `/bin/kill`, `/bin/df`, `/bin/du`, `/bin/free`, `/bin/date`, `/bin/hostname`, `/bin/uptime`, `/bin/uname`, `/bin/env`, `/bin/printenv`, `/bin/id`, `/bin/tee`, `/bin/dd`, `/bin/tr`, `/bin/basename`, `/bin/dirname`, `/bin/pwd`, `/bin/stat`, `/bin/sleep`, `/bin/clear`, `/bin/rmdir`, `/bin/dmesg`, `/bin/who`, `/bin/pie_test`
 - `/sbin/init` — SysV-like init process (inittab, runlevels, respawn)
-- `/sbin/fulltest` — comprehensive smoke test suite (102 checks)
+- `/sbin/fulltest` — comprehensive smoke test suite (120 checks)
 - `/bin/doom.elf` — DOOM (doomgeneric port) — runs on `/dev/fb0` + `/dev/kbd`
 - `/lib/ld.so` — dynamic linker with auxv parsing, PLT/GOT lazy relocation
 
@@ -163,9 +163,9 @@ AdrOS is a Unix-like, POSIX-compatible, multi-architecture operating system deve
 - **PMM spinlock** for SMP safety
 
 ### Testing
-- **115 host-side tests** — `test_utils.c` (28) + `test_security.c` (19) + `test_host_utils.sh` (68 cross-compiled utility tests)
-- **102 QEMU smoke tests** — 4-CPU expect-based (file I/O, signals, memory mgmt, IPC, devices, procfs, networking, epoll, epollet, inotify, aio, nanosleep, CoW fork, readv/writev, fsync, flock, posix_spawn, TSC precision, gettimeofday, mprotect, getrlimit/setrlimit, uname, LZ4, lazy PLT, execve)
-- **16-check test battery** — multi-disk ATA (hda+hdb+hdd), VFS mount, ping, diskfs ops (`make test-battery`)
+- **69 host-side tests** — `test_utils.c` (28) + `test_security.c` (19) + `test_host_utils.sh` (22 cross-compiled utility tests)
+- **120 QEMU smoke tests** — 4-CPU expect-based (file I/O, signals, memory mgmt, IPC, devices, procfs, networking, epoll, epollet, inotify, aio, nanosleep, CoW fork, readv/writev, fsync, flock, posix_spawn, TSC precision, gettimeofday, mprotect, getrlimit/setrlimit, uname, LZ4, lazy PLT, execve, clone, pivot_root, dlopen/dlsym/dlclose, execveat, futex, sigaltstack, socket API, mqueue, semaphores, chown, mount/umount2)
+- **33-check test battery** — multi-disk ATA (hda+hdb+hdd), VFS mount, ping, diskfs ops, clone, socket API, mqueue, semaphores, futex, sigaltstack, chown, mount/umount2 (`make test-battery`)
 - **Static analysis** — cppcheck, sparse, gcc -fanalyzer
 - **GDB scripted checks** — heap/PMM/VGA integrity
 - `make test-all` runs everything
@@ -204,10 +204,35 @@ QEMU debug helpers:
 
 See [POSIX_ROADMAP.md](docs/POSIX_ROADMAP.md) for a detailed checklist.
 
-**All 31 planned POSIX tasks are complete**, plus 60 additional features (91 total). The kernel covers **~98%** of the core POSIX interfaces needed for a practical Unix-like system. All 102 smoke tests, 16 battery checks, and 115 host tests pass clean. ARM64, RISC-V 64, and MIPS32 boot on QEMU.
+**All 31 planned POSIX tasks are complete**, plus 60 additional features (91 total). The kernel has **141 syscalls** with **124 tested** (87.9% coverage) by the 120 smoke tests. The kernel covers **~98%** of the core POSIX interfaces needed for a practical Unix-like system. All 120 smoke tests, 33 battery checks, and 69 host tests pass clean. ARM64, RISC-V 64, and MIPS32 boot on QEMU.
 
 Rump Kernel integration is in progress — prerequisites (condition variables, TSC nanosecond clock, IRQ chaining) are implemented and the `rumpuser` hypercall scaffold is in place.
 
+### Syscall Test Coverage
+
+| Metric | Value |
+|--------|-------|
+| Syscalls implemented | 141 |
+| Syscalls tested by fulltest | 124 (87.9%) |
+| Syscalls without test | 17 (12.1%) |
+| Smoke tests | 120 |
+| Battery checks | 33 |
+| Host tests | 69 |
+
+**17 untested syscalls:** `shmctl`, `set_thread_area` (indirect via clone), `accept`, `connect`, `send`, `recv`, `sendto`, `recvfrom`, `fdatasync`, `getaddrinfo`, `sendmsg`, `recvmsg`, `aio_suspend`, `setsockopt`, `getsockopt`, `getpeername`, `wait4`
+
+### Remaining POSIX Gaps
+
+For **100% POSIX compliance**, the following categories are still missing:
+- **pthreads complete** — mutex/cond/rwlock exist in ulibc but need kernel-level thread lifecycle, cancellation, per-thread errno via TLS
+- **TCP loopback** — `connect()`/`accept()` hang in QEMU; network I/O tests disabled
+- **Filesystem POSIX** — `mkfifo`/`mknod`, `fchmod`/`fchown`/`lchown`, `fchdir`, `sync`/`syncfs`, `statfs`/`fstatfs`, `readlinkat`/`mkdirat`/`fchmodat`
+- **Process/credentials** — `chroot`, `getgroups`/`setgroups`, saved setuid, `ptrace`, `nice`/`getpriority`/`setpriority`
+- **POSIX timers** — `timer_create`/`timer_delete`/`timer_settime`/`timer_gettime`, `clock_settime`/`clock_getres`/`clock_nanosleep`
+- **IPC** — `shmctl IPC_RMID/IPC_STAT`, unnamed semaphores (`sem_init`/`sem_destroy`), `mq_notify`/`mq_getattr`/`mq_setattr`
+- **Memory** — `mremap`, `msync`, `mincore`
+- **Signals** — `sigwait`/`sigwaitinfo`/`sigtimedwait`
+
 ## Directory Structure
 - `src/kernel/` — Architecture-independent kernel (VFS, syscalls, scheduler, tmpfs, diskfs, devfs, overlayfs, procfs, FAT12/16/32, ext2, PTY, TTY, shm, signals, networking, threads, vDSO, KASLR, permissions)
 - `src/arch/x86/` — x86-specific (boot, VMM, IDT, LAPIC, IOAPIC, SMP, ACPI, CPUID, SYSENTER, ELF loader, MTRR)

diff --git a/docs/FULL_POSIX_AUDIT.md b/docs/FULL_POSIX_AUDIT.md
index f0093abb0fa28858e78fb7a22a9e7668728a65b5..630b20f5dea04686ccc71d646aee683b9a5145de 100644 (file)
--- a/docs/FULL_POSIX_AUDIT.md
+++ b/docs/FULL_POSIX_AUDIT.md
@@ -41,13 +41,13 @@ lwIP is tracked as a git submodule (`.gitmodules` exists). DOOM is optional and
 | `setsockopt` / `getsockopt` | Required | ✅ **IMPLEMENTED** (syscalls 131/132) |
 | `shutdown` (socket) | Required | ✅ **IMPLEMENTED** (syscall 133) |
 | `getpeername` / `getsockname` | Required | ✅ **IMPLEMENTED** (syscalls 134/135) |
-| `madvise` | Optional | â\9d\8c Not implemented (low priority) |
+| `madvise` | Optional | â\9c\85 **IMPLEMENTED** (syscall 140) |
 | `mremap` | Linux ext | ❌ Not implemented (low priority) |
-| `execveat` | Linux ext | â\9d\8c Not implemented (low priority) |
+| `execveat` | Linux ext | â\9c\85 **IMPLEMENTED** (syscall 142) |
 | `umount2` | Required | ✅ **IMPLEMENTED** (syscall 138) |
 | `ioctl FIONREAD` | Required | ✅ **IMPLEMENTED** (ioctl 0x541B) |
 
-**9 of 12 previously missing syscalls are now implemented.** The kernel now has **139 syscalls** (138 entries) total.
+**9 of 12 previously missing syscalls are now implemented.** The kernel now has **141 syscalls** total.
 
 ### 2B. ulibc Headers — Status Update
 
@@ -353,7 +353,7 @@ Native Binutils 2.42 + GCC 13.2.0 built as ELF32 i686 static binaries.
 
 | Component | Current State | Ready to Port? |
 |---|---|---|
-| **Kernel syscalls** | 139 syscalls (138 entries), ~99% POSIX | ✅ All critical syscalls implemented |
+| **Kernel syscalls** | 141 syscalls, ~99% POSIX, 124/141 tested (87.9%) | ✅ All critical syscalls implemented |
 | **ulibc** | Full libc for AdrOS userspace | ✅ Sufficient for 52 utilities |
 | **Build system** | Works with `git clone --recursive` | ✅ Submodules + .gitignore |
 | **Newlib** | ✅ **DONE** | `newlib/libgloss/adros/` with all stubs |
@@ -362,4 +362,25 @@ Native Binutils 2.42 + GCC 13.2.0 built as ELF32 i686 static binaries.
 | **Bash** | Not started | **Feasible** — all kernel blockers resolved, Newlib provides libc |
 | **Busybox** | Not started | **Feasible** — after Bash |
 
-**Bottom line:** The kernel is **~99% POSIX-ready** with 139 syscalls (138 entries). All 30 required ulibc headers are implemented, all previously missing functions in existing headers are resolved, and pthread sync primitives are complete with futex-based locking. The Newlib port and native toolchain (GCC 13.2 + Binutils 2.42) are **complete**. The next step is cross-compiling Bash, which is now feasible since all kernel-level and library-level blockers have been resolved. AdrOS ships with 52 native POSIX utilities, 101 smoke tests, and full POSIX header coverage.
+**Bottom line:** The kernel is **~99% POSIX-ready** with 141 syscalls (124 tested, 87.9% coverage). All 30 required ulibc headers are implemented, all previously missing functions in existing headers are resolved, and pthread sync primitives are complete with futex-based locking. The Newlib port and native toolchain (GCC 13.2 + Binutils 2.42) are **complete**. The next step is cross-compiling Bash, which is now feasible since all kernel-level and library-level blockers have been resolved. AdrOS ships with 52 native POSIX utilities, 120 smoke tests, and full POSIX header coverage.
+
+### Syscall Test Coverage
+
+The fulltest suite exercises **124 of 141** kernel syscalls (87.9%).
+
+**17 untested syscalls:** `shmctl`, `set_thread_area`, `accept`, `connect`, `send`, `recv`, `sendto`, `recvfrom`, `fdatasync`, `getaddrinfo`, `sendmsg`, `recvmsg`, `aio_suspend`, `setsockopt`, `getsockopt`, `getpeername`, `wait4`
+
+### Remaining POSIX Gaps for 100% Compliance
+
+These POSIX-mandated features are not yet implemented in the kernel:
+
+| Category | Missing Features |
+|----------|-----------------|
+| **Process/Credentials** | `chroot`, `getgroups`/`setgroups`, `getpgid`/`getsid`, `ptrace`, `nice`/`getpriority`/`setpriority`, saved set-user-ID |
+| **Filesystem** | `mkfifo`/`mknod`, `fchdir`, `fchmod`/`fchown`/`lchown`, `sync`/`syncfs`, `statfs`/`fstatfs`, `fpathconf`/`pathconf`, `readlinkat`/`mkdirat`/`fchmodat` |
+| **Signals** | `sigwait`/`sigwaitinfo`/`sigtimedwait` |
+| **POSIX Timers** | `timer_create`/`timer_delete`/`timer_settime`/`timer_gettime`, `clock_settime`/`clock_getres`/`clock_nanosleep` |
+| **IPC** | `shmctl IPC_RMID/IPC_STAT`, `sem_init`/`sem_destroy`, `mq_notify`/`mq_getattr`/`mq_setattr` |
+| **Memory** | `mremap`, `msync`, `mincore` |
+| **Network** | `socketpair`, TCP loopback (`connect`/`accept`/`send`/`recv`), `AF_UNIX`/`AF_INET6` |
+| **Threads** | `pthread_cancel`/`pthread_testcancel`/`pthread_detach`, thread-safe `errno` via TLS, `pthread_atfork` |

diff --git a/docs/POSIX_ROADMAP.md b/docs/POSIX_ROADMAP.md
index f1520d995eb0b061894ee1001d7c762e4fbbaaf1..631a37eff8d3788389f06d2f9a49d18b5820d688 100644 (file)
--- a/docs/POSIX_ROADMAP.md
+++ b/docs/POSIX_ROADMAP.md
@@ -295,7 +295,7 @@ Notes:
 | Feature | Status | Notes |
 |---------|--------|-------|
 | ELF32 loader | [x] | Secure with W^X + ASLR; supports `ET_EXEC` + `ET_DYN` + `PT_INTERP` |
-| `/sbin/fulltest` (smoke tests) | [x] | Comprehensive test suite (102 checks: file I/O, signals, memory, IPC, devices, procfs, networking, epoll, epollet, inotify, aio, nanosleep, CoW fork, readv/writev, fsync, flock, posix_spawn, TSC precision, gettimeofday, mprotect, getrlimit/setrlimit, uname, LZ4, lazy PLT, execve) |
+| `/sbin/fulltest` (smoke tests) | [x] | Comprehensive test suite (120 checks: file I/O, signals, memory, IPC, devices, procfs, networking, epoll, epollet, inotify, aio, nanosleep, CoW fork, readv/writev, fsync, flock, posix_spawn, TSC precision, gettimeofday, mprotect, getrlimit/setrlimit, uname, LZ4, lazy PLT, execve, clone, pivot_root, dlopen/dlsym/dlclose, execveat, futex, sigaltstack, socket API, mqueue, semaphores, chown, mount/umount2) |
 | `/bin/echo` | [x] | argv/envp test |
 | `/bin/sh` | [x] | POSIX sh-compatible shell; builtins, pipes, redirects, `$PATH` search |
 | `/bin/cat` | [x] | |
@@ -449,11 +449,43 @@ Notes:
 
 ---
 
+## Syscall Test Coverage
+
+The fulltest suite exercises **124 of 141** kernel syscalls (87.9% coverage).
+
+### Tested Syscalls (124/141)
+
+`write`, `exit`, `getpid`, `open`, `read`, `close`, `waitpid`, `lseek`, `fstat`, `stat`, `dup`, `dup2`, `pipe`, `execve`, `fork`, `getppid`, `poll`, `kill`, `select`, `ioctl`, `setsid`, `setpgid`, `getpgrp`, `sigaction`, `sigprocmask`, `sigreturn`, `mkdir`, `unlink`, `getdents`, `fcntl`, `chdir`, `getcwd`, `pipe2`, `dup3`, `openat`, `fstatat`, `unlinkat`, `rename`, `rmdir`, `brk`, `nanosleep`, `clock_gettime`, `mmap`, `munmap`, `shmget`, `shmat`, `chmod`, `chown`, `getuid`, `getgid`, `link`, `symlink`, `readlink`, `socket`, `bind`, `listen`, `clone`, `gettid`, `fsync`, `sigpending`, `pread`, `pwrite`, `access`, `umask`, `setuid`, `setgid`, `truncate`, `ftruncate`, `sigsuspend`, `readv`, `writev`, `alarm`, `times`, `futex`, `sigaltstack`, `flock`, `geteuid`, `getegid`, `seteuid`, `setegid`, `setitimer`, `getitimer`, `waitid`, `sigqueue`, `posix_spawn`, `mq_open`, `mq_close`, `mq_send`, `mq_receive`, `mq_unlink`, `sem_open`, `sem_close`, `sem_wait`, `sem_post`, `sem_unlink`, `sem_getvalue`, `dlopen`, `dlsym`, `dlclose`, `epoll_create`, `epoll_ctl`, `epoll_wait`, `inotify_init`, `inotify_add_watch`, `inotify_rm_watch`, `pivot_root`, `aio_read`, `aio_write`, `aio_error`, `aio_return`, `mount`, `gettimeofday`, `mprotect`, `getrlimit`, `setrlimit`, `shutdown`, `getsockname`, `uname`, `getrusage`, `umount2`, `madvise`, `execveat`
+
+### Untested Syscalls (17/141)
+
+| Syscall | Reason |
+|---------|--------|
+| `shmctl` | Shared memory control (IPC_RMID/IPC_STAT) not tested |
+| `set_thread_area` | Used implicitly by clone/TLS, no direct test |
+| `accept` | TCP connect/accept hangs in QEMU — test disabled |
+| `connect` | TCP loopback hangs in QEMU — test disabled |
+| `send` | Depends on connect — no test |
+| `recv` | Depends on connect — no test |
+| `sendto` | UDP I/O not tested |
+| `recvfrom` | UDP I/O not tested |
+| `fdatasync` | Similar to fsync but data-only — no test |
+| `getaddrinfo` | DNS resolution not tested in fulltest |
+| `sendmsg` | Scatter/gather socket I/O not tested |
+| `recvmsg` | Scatter/gather socket I/O not tested |
+| `aio_suspend` | Async I/O wait not tested |
+| `setsockopt` | Socket options not tested |
+| `getsockopt` | Socket options not tested |
+| `getpeername` | Depends on connect — no test |
+| `wait4` | Different from waitpid — no test |
+
+---
+
 ## Remaining Work
 
 All previously identified gaps have been implemented. Rump Kernel integration prerequisites (condition variables, TSC nanosecond clock, IRQ chaining) are complete, and the `rumpuser` hypercall scaffold is in place.
 
-Potential future enhancements:
+### Future Enhancements
 
 | Area | Description |
 |------|-------------|
@@ -463,3 +495,55 @@ Potential future enhancements:
 | **ARM64/RISC-V/MIPS subsystems** | PMM, VMM, scheduler, syscalls for non-x86 |
 | **Intel HDA audio** | DMA ring buffer audio driver |
 | ~~**USTAR initrd format**~~ | ✅ Implemented — USTAR + LZ4 Frame format |
+
+### POSIX Gaps for 100% Compliance
+
+These are POSIX-mandated features not yet implemented in the kernel:
+
+#### Process & Credentials
+- `chroot` — Change root directory
+- `getgroups` / `setgroups` — Supplementary group IDs
+- `getpgid` / `getsid` — Query PGID/SID of arbitrary process
+- `ptrace` — Process tracing (for gdb/strace)
+- `nice` / `getpriority` / `setpriority` — Process priority
+- `pause` — Wait for signal (sigsuspend partially covers)
+- Saved set-user-ID (POSIX requires)
+
+#### Filesystem
+- `mkfifo` / `mknod` — Create FIFOs and device nodes
+- `fchdir` — chdir via fd
+- `fchmod` / `fchown` / `lchown` — chmod/chown by fd or without symlink follow
+- `sync` / `syncfs` — Synchronize entire filesystem
+- `statfs` / `fstatfs` — Filesystem statistics
+- `fpathconf` / `pathconf` — Configurable path variables
+- `readlinkat` / `mkdirat` / `fchmodat` — Missing *at() variants
+
+#### Signals
+- `sigwait` / `sigwaitinfo` / `sigtimedwait` — Synchronous signal waiting
+
+#### POSIX Timers
+- `timer_create` / `timer_delete` / `timer_settime` / `timer_gettime` — POSIX timers
+- `clock_settime` / `clock_getres` / `clock_nanosleep` — Clock management
+
+#### IPC
+- `shmctl IPC_RMID/IPC_STAT` — Shared memory control operations
+- `sem_init` / `sem_destroy` — Unnamed (anonymous) semaphores
+- `mq_notify` / `mq_getattr` / `mq_setattr` — Message queue notifications and attributes
+
+#### Memory
+- `mremap` — Remap virtual memory
+- `msync` — Synchronize mmap with file
+- `mincore` — Check page residency
+
+#### Network
+- `socketpair` — Connected socket pairs (UNIX domain)
+- TCP loopback (`connect`/`accept`/`send`/`recv`) — currently hangs in QEMU
+- `AF_UNIX` / `AF_INET6` address families
+
+#### Threads (pthreads)
+- Full thread lifecycle: `pthread_cancel`, `pthread_testcancel`, `pthread_detach`
+- Thread-safe `errno` via TLS (per-thread errno)
+- `pthread_atfork` handlers
+
+#### Terminal
+- `tcsendbreak` / `tcdrain` / `tcflush` / `tcflow` — Terminal control (ulibc has wrappers, kernel ioctl needed)

diff --git a/docs/SELF_HOSTING_ANALYSIS.md b/docs/SELF_HOSTING_ANALYSIS.md
index bd238d142d142c9d424ce114d1e8d61d33ff7f81..d7bcf269aafdcd1c9a5b6562fc2ab569d7a543f6 100644 (file)
--- a/docs/SELF_HOSTING_ANALYSIS.md
+++ b/docs/SELF_HOSTING_ANALYSIS.md
@@ -323,7 +323,7 @@ This is the final step to self-hosting:
 
 | Category | Audit Claim | Actual (verified) |
 |----------|-------------|-------------------|
-| Kernel syscalls | ~85% POSIX | **~92%** — 135 syscall numbers, missing ~8 |
+| Kernel syscalls | ~85% POSIX | **~99%** — 141 syscalls, 124/141 tested (87.9%), missing ~17 untested + ~55 POSIX features |
 | ulibc coverage | "NOT sufficient" | **Much improved** — 25 headers, proper malloc, but still missing regex/glob/network headers |
 | Cross-toolchain | Not started | **✅ COMPLETE** — GCC 13.2.0 + Newlib + Binutils |
 | Bash cross-compiled | Not started | **✅ DONE** — static ELF, needs runtime stubs |
@@ -331,4 +331,25 @@ This is the final step to self-hosting:
 | Busybox | Not started | ❌ |
 | Native GCC | Not started | ❌ |
 
-**Bottom line:** The kernel is ~92% POSIX-ready. The cross-toolchain is complete. The #1 blocker to running Bash natively is **converting the ~30 ENOSYS stubs in libgloss/posix_stubs.c to real AdrOS syscall wrappers** — the kernel already supports every required operation. This is a straightforward 1-2 day task that unblocks everything else.
+**Bottom line:** The kernel is ~99% POSIX-ready with 141 syscalls (124 tested, 87.9% coverage). The cross-toolchain is complete. The #1 blocker to running Bash natively is **converting the ~30 ENOSYS stubs in libgloss/posix_stubs.c to real AdrOS syscall wrappers** — the kernel already supports every required operation. This is a straightforward 1-2 day task that unblocks everything else.
+
+### Syscall Test Coverage
+
+The fulltest suite exercises **124 of 141** kernel syscalls (87.9%).
+
+**17 untested syscalls:** `shmctl`, `set_thread_area`, `accept`, `connect`, `send`, `recv`, `sendto`, `recvfrom`, `fdatasync`, `getaddrinfo`, `sendmsg`, `recvmsg`, `aio_suspend`, `setsockopt`, `getsockopt`, `getpeername`, `wait4`
+
+### Remaining POSIX Gaps
+
+For 100% POSIX compliance, the following categories are still missing in the kernel:
+
+| Category | Missing Features |
+|----------|-----------------|
+| **Process/Credentials** | `chroot`, `getgroups`/`setgroups`, `getpgid`/`getsid`, `ptrace`, `nice`/`getpriority`/`setpriority`, saved set-user-ID |
+| **Filesystem** | `mkfifo`/`mknod`, `fchdir`, `fchmod`/`fchown`/`lchown`, `sync`/`syncfs`, `statfs`/`fstatfs`, `fpathconf`/`pathconf`, `readlinkat`/`mkdirat`/`fchmodat` |
+| **Signals** | `sigwait`/`sigwaitinfo`/`sigtimedwait` |
+| **POSIX Timers** | `timer_create`/`timer_delete`/`timer_settime`/`timer_gettime`, `clock_settime`/`clock_getres`/`clock_nanosleep` |
+| **IPC** | `shmctl IPC_RMID/IPC_STAT`, `sem_init`/`sem_destroy`, `mq_notify`/`mq_getattr`/`mq_setattr` |
+| **Memory** | `mremap`, `msync`, `mincore` |
+| **Network** | `socketpair`, TCP loopback (`connect`/`accept`/`send`/`recv`), `AF_UNIX`/`AF_INET6` |
+| **Threads** | `pthread_cancel`/`pthread_testcancel`/`pthread_detach`, thread-safe `errno` via TLS, `pthread_atfork` |

diff --git a/docs/SUPPLEMENTARY_ANALYSIS.md b/docs/SUPPLEMENTARY_ANALYSIS.md
index b6aef01d8806206e04b49cc66856598a1716ae08..a96e260ee453c0c69c3e224ff162c41f2b3e13fb 100644 (file)
--- a/docs/SUPPLEMENTARY_ANALYSIS.md
+++ b/docs/SUPPLEMENTARY_ANALYSIS.md
@@ -231,7 +231,7 @@ for the full list. All previously identified Tier 1/2/3 gaps have been resolved.
 8. **Hardware** — PCI, ATA PIO+DMA (bounce + zero-copy), Virtio-blk, LAPIC/IOAPIC, SMP (4 CPUs), ACPI, VBE framebuffer, SYSENTER, CPUID, RTC, MTRR write-combining
 9. **Networking** — E1000 NIC, lwIP TCP/IP (IPv4+IPv6 dual-stack), socket API (TCP+UDP), DNS resolver, DHCP client
 10. **Userland** — ulibc (full libc), ELF loader with W^X + ASLR, functional `ld.so` (auxv + PLT/GOT + `dlopen`/`dlsym`/`dlclose`), POSIX shell, core utilities, DOOM port
-11. **Testing** — 102 smoke tests, 16 battery checks, 115 host tests (28 unit + 19 security + 68 utility), cppcheck, sparse, gcc -fanalyzer, GDB scripted checks
+11. **Testing** — 120 smoke tests, 33 battery checks, 69 host tests (28 unit + 19 security + 22 utility), cppcheck, sparse, gcc -fanalyzer, GDB scripted checks
 12. **Security** — SMEP, PAE+NX, ASLR, guard pages (user + kernel), user_range_ok hardened, sigreturn eflags sanitized, atomic file refcounts, VFS permission enforcement (uid/gid/euid/egid vs file mode)
 13. **Scheduler** — O(1) with bitmap + active/expired, 32 priority levels, decay-based priority, CPU time accounting
 14. **Threads** — `clone`, `gettid`, TLS via GDT, pthread in ulibc, futex synchronization
@@ -359,4 +359,4 @@ TSC nanosecond clock, and IRQ chaining are already implemented), **full SMP sche
 (moving processes to AP runqueues — per-CPU infrastructure in place), **non-x86 subsystems**
 (PMM/VMM/scheduler for ARM64/RISC-V/MIPS), and Intel HDA audio.
 
-102 QEMU smoke tests, 16 battery checks, and 115 host tests pass clean.
+120 QEMU smoke tests, 33 battery checks, and 69 host tests pass clean.

diff --git a/docs/TESTING_PLAN.md b/docs/TESTING_PLAN.md
index 98453c01194a989a423f7f8861203faaefeded09..58cd34349691db9839ec1efc7e9422a95cb3b97e 100644 (file)
--- a/docs/TESTING_PLAN.md
+++ b/docs/TESTING_PLAN.md
@@ -5,9 +5,9 @@
 All testing layers are **implemented and operational**:
 
 - **Static analysis** (`make check`): cppcheck + sparse + gcc -fanalyzer
-- **QEMU smoke tests** (`make test`): expect-based, 102 checks (file I/O, signals, memory, IPC, devices, procfs, networking, epoll, epollet, inotify, aio, nanosleep, CLOCK_REALTIME, /dev/urandom, /proc/cmdline, CoW fork, readv/writev, fsync, truncate, getuid/getgid, chmod, flock, times, gettid, posix_spawn, TSC ns precision, SIGSEGV, gettimeofday, mprotect, getrlimit/setrlimit, uname, LZ4 initrd decomp, lazy PLT, execve), 4-CPU SMP, 120s timeout
-- **Test battery** (`make test-battery`): 16 checks across 5 QEMU scenarios — multi-disk ATA, VFS mount, ping, diskfs
-- **Host unit tests** (`make test-host`): 115 tests — `test_utils.c` (28) + `test_security.c` (19) + `test_host_utils.sh` (68 cross-compiled utility tests)
+- **QEMU smoke tests** (`make test`): expect-based, 120 checks (file I/O, signals, memory, IPC, devices, procfs, networking, epoll, epollet, inotify, aio, nanosleep, CLOCK_REALTIME/CLOCK_MONOTONIC, /dev/urandom, /proc/cmdline, CoW fork, readv/writev, fsync, truncate, getuid/getgid, chmod, flock, times, gettid, posix_spawn, TSC ns precision, SIGSEGV, gettimeofday, mprotect, getrlimit/setrlimit, uname, LZ4 initrd decomp, lazy PLT, execve, clone, pivot_root, dlopen/dlsym/dlclose, execveat, futex, sigaltstack, socket API, mqueue, semaphores, chown, mount/umount2), 4-CPU SMP, 120s timeout
+- **Test battery** (`make test-battery`): 33 checks across QEMU scenarios — multi-disk ATA, VFS mount, ping, diskfs, clone, socket API, mqueue, semaphores, futex, sigaltstack, chown, mount/umount2
+- **Host unit tests** (`make test-host`): 69 tests — `test_utils.c` (28) + `test_security.c` (19) + `test_host_utils.sh` (22 cross-compiled utility tests)
 - **GDB scripted checks** (`make test-gdb`): heap/PMM/VGA integrity validation
 - **Full suite** (`make test-all`): runs check + test-host + test
 - **Multi-arch build verification**: `make ARCH=arm`, `make ARCH=riscv`, and `make ARCH=mips` compile and boot on QEMU
@@ -111,8 +111,8 @@ To run manually: boot AdrOS with `-vga std`, then execute `/bin/doom.elf` from t
 
 ```makefile
 make check        # cppcheck + sparse + gcc -fanalyzer
-make test         # QEMU + expect automated smoke test (102 checks incl. ICMP ping, epoll, epollet, inotify, aio, CoW fork, flock, posix_spawn, gettimeofday, mprotect, uname, LZ4, lazy PLT)
-make test-battery # Full test battery: multi-disk ATA, VFS mount, ping, diskfs (16 checks)
+make test         # QEMU + expect automated smoke test (120 checks incl. ICMP ping, epoll, epollet, inotify, aio, CoW fork, flock, posix_spawn, gettimeofday, mprotect, uname, LZ4, lazy PLT, clone, pivot_root, dlopen/dlsym/dlclose, execveat, futex, sigaltstack, socket API, mqueue, semaphores, chown, mount/umount2)
+make test-battery # Full test battery: multi-disk ATA, VFS mount, ping, diskfs, clone, socket API, mqueue, semaphores, futex, sigaltstack, chown, mount/umount2 (33 checks)
 make test-host    # Host-side unit tests for pure functions
 make test-gdb     # QEMU + GDB scripted checks (optional)
 make test-all     # All of the above

diff --git a/docs/TIER6_PLAN.md b/docs/TIER6_PLAN.md
index 34d9f8e91c6c5ca8b7ed17641e952d112f35c1f7..8013dced904a06d48e8ef5560fbc3fada3446af5 100644 (file)
--- a/docs/TIER6_PLAN.md
+++ b/docs/TIER6_PLAN.md
@@ -2,7 +2,7 @@
 
 **Date:** 2026-03-14
 **Prerequisite:** Tiers 1-5 complete (commit aa5474a), audit updated (commit f3a652e)
-**Current state:** ~99% POSIX, 139 syscalls, 101 smoke tests, all ulibc headers complete
+**Current state:** ~99% POSIX, 141 syscalls, 124/141 tested (87.9%), 120 smoke tests, 33 battery checks, all ulibc headers complete
 
 ---