head 1.2; access; symbols netbsd-11-0-RC4:1.2 netbsd-11-0-RC3:1.2 netbsd-11-0-RC2:1.2 netbsd-11-0-RC1:1.2 perseant-exfatfs-base-20250801:1.2 netbsd-11:1.2.0.104 netbsd-11-base:1.2 netbsd-10-1-RELEASE:1.2 perseant-exfatfs-base-20240630:1.2 perseant-exfatfs:1.2.0.102 perseant-exfatfs-base:1.2 netbsd-8-3-RELEASE:1.2 netbsd-9-4-RELEASE:1.2 netbsd-10-0-RELEASE:1.2 netbsd-10-0-RC6:1.2 netbsd-10-0-RC5:1.2 netbsd-10-0-RC4:1.2 netbsd-10-0-RC3:1.2 netbsd-10-0-RC2:1.2 netbsd-10-0-RC1:1.2 netbsd-10:1.2.0.100 netbsd-10-base:1.2 netbsd-9-3-RELEASE:1.2 cjep_sun2x-base1:1.2 cjep_sun2x:1.2.0.98 cjep_sun2x-base:1.2 cjep_staticlib_x-base1:1.2 netbsd-9-2-RELEASE:1.2 cjep_staticlib_x:1.2.0.96 cjep_staticlib_x-base:1.2 netbsd-9-1-RELEASE:1.2 phil-wifi-20200421:1.2 phil-wifi-20200411:1.2 is-mlppp:1.2.0.94 is-mlppp-base:1.2 phil-wifi-20200406:1.2 netbsd-8-2-RELEASE:1.2 netbsd-9-0-RELEASE:1.2 netbsd-9-0-RC2:1.2 netbsd-9-0-RC1:1.2 phil-wifi-20191119:1.2 netbsd-9:1.2.0.92 netbsd-9-base:1.2 phil-wifi-20190609:1.2 netbsd-8-1-RELEASE:1.2 netbsd-8-1-RC1:1.2 pgoyette-compat-merge-20190127:1.2 pgoyette-compat-20190127:1.2 pgoyette-compat-20190118:1.2 pgoyette-compat-1226:1.2 pgoyette-compat-1126:1.2 pgoyette-compat-1020:1.2 pgoyette-compat-0930:1.2 pgoyette-compat-0906:1.2 netbsd-7-2-RELEASE:1.2 pgoyette-compat-0728:1.2 netbsd-8-0-RELEASE:1.2 phil-wifi:1.2.0.90 phil-wifi-base:1.2 pgoyette-compat-0625:1.2 netbsd-8-0-RC2:1.2 pgoyette-compat-0521:1.2 pgoyette-compat-0502:1.2 pgoyette-compat-0422:1.2 netbsd-8-0-RC1:1.2 pgoyette-compat-0415:1.2 pgoyette-compat-0407:1.2 pgoyette-compat-0330:1.2 pgoyette-compat-0322:1.2 pgoyette-compat-0315:1.2 netbsd-7-1-2-RELEASE:1.2 pgoyette-compat:1.2.0.88 pgoyette-compat-base:1.2 netbsd-7-1-1-RELEASE:1.2 matt-nb8-mediatek:1.2.0.86 matt-nb8-mediatek-base:1.2 perseant-stdc-iso10646:1.2.0.84 perseant-stdc-iso10646-base:1.2 netbsd-8:1.2.0.82 netbsd-8-base:1.2 prg-localcount2-base3:1.2 prg-localcount2-base2:1.2 prg-localcount2-base1:1.2 prg-localcount2:1.2.0.80 prg-localcount2-base:1.2 pgoyette-localcount-20170426:1.2 bouyer-socketcan-base1:1.2 pgoyette-localcount-20170320:1.2 netbsd-7-1:1.2.0.78 netbsd-7-1-RELEASE:1.2 netbsd-7-1-RC2:1.2 netbsd-7-nhusb-base-20170116:1.2 bouyer-socketcan:1.2.0.76 bouyer-socketcan-base:1.2 pgoyette-localcount-20170107:1.2 netbsd-7-1-RC1:1.2 pgoyette-localcount-20161104:1.2 netbsd-7-0-2-RELEASE:1.2 localcount-20160914:1.2 netbsd-7-nhusb:1.2.0.74 netbsd-7-nhusb-base:1.2 pgoyette-localcount-20160806:1.2 pgoyette-localcount-20160726:1.2 pgoyette-localcount:1.2.0.72 pgoyette-localcount-base:1.2 netbsd-7-0-1-RELEASE:1.2 netbsd-7-0:1.2.0.70 netbsd-7-0-RELEASE:1.2 netbsd-7-0-RC3:1.2 netbsd-7-0-RC2:1.2 netbsd-7-0-RC1:1.2 netbsd-5-2-3-RELEASE:1.2 netbsd-5-1-5-RELEASE:1.2 netbsd-6-0-6-RELEASE:1.2 netbsd-6-1-5-RELEASE:1.2 netbsd-7:1.2.0.68 netbsd-7-base:1.2 yamt-pagecache-base9:1.2 yamt-pagecache-tag8:1.2 netbsd-6-1-4-RELEASE:1.2 netbsd-6-0-5-RELEASE:1.2 tls-earlyentropy:1.2.0.66 tls-earlyentropy-base:1.2 riastradh-xf86-video-intel-2-7-1-pre-2-21-15:1.2 riastradh-drm2-base3:1.2 netbsd-6-1-3-RELEASE:1.2 netbsd-6-0-4-RELEASE:1.2 netbsd-5-2-2-RELEASE:1.2 netbsd-5-1-4-RELEASE:1.2 netbsd-6-1-2-RELEASE:1.2 netbsd-6-0-3-RELEASE:1.2 netbsd-5-2-1-RELEASE:1.2 netbsd-5-1-3-RELEASE:1.2 netbsd-6-1-1-RELEASE:1.2 riastradh-drm2-base2:1.2 riastradh-drm2-base1:1.2 riastradh-drm2:1.2.0.60 riastradh-drm2-base:1.2 netbsd-6-1:1.2.0.64 netbsd-6-0-2-RELEASE:1.2 netbsd-6-1-RELEASE:1.2 netbsd-6-1-RC4:1.2 netbsd-6-1-RC3:1.2 agc-symver:1.2.0.62 agc-symver-base:1.2 netbsd-6-1-RC2:1.2 netbsd-6-1-RC1:1.2 yamt-pagecache-base8:1.2 netbsd-5-2:1.2.0.58 netbsd-6-0-1-RELEASE:1.2 yamt-pagecache-base7:1.2 netbsd-5-2-RELEASE:1.2 netbsd-5-2-RC1:1.2 matt-nb6-plus-nbase:1.2 yamt-pagecache-base6:1.2 netbsd-6-0:1.2.0.56 netbsd-6-0-RELEASE:1.2 netbsd-6-0-RC2:1.2 tls-maxphys:1.2.0.54 tls-maxphys-base:1.2 matt-nb6-plus:1.2.0.52 matt-nb6-plus-base:1.2 netbsd-6-0-RC1:1.2 yamt-pagecache-base5:1.2 yamt-pagecache-base4:1.2 netbsd-6:1.2.0.50 netbsd-6-base:1.2 netbsd-5-1-2-RELEASE:1.2 netbsd-5-1-1-RELEASE:1.2 yamt-pagecache-base3:1.2 yamt-pagecache-base2:1.2 yamt-pagecache:1.2.0.48 yamt-pagecache-base:1.2 cherry-xenmp:1.2.0.46 cherry-xenmp-base:1.2 bouyer-quota2-nbase:1.2 bouyer-quota2:1.2.0.44 bouyer-quota2-base:1.2 matt-mips64-premerge-20101231:1.2 matt-nb5-mips64-premerge-20101231:1.2 matt-nb5-pq3:1.2.0.42 matt-nb5-pq3-base:1.2 netbsd-5-1:1.2.0.40 netbsd-5-1-RELEASE:1.2 netbsd-5-1-RC4:1.2 matt-nb5-mips64-k15:1.2 netbsd-5-1-RC3:1.2 netbsd-5-1-RC2:1.2 netbsd-5-1-RC1:1.2 netbsd-5-0-2-RELEASE:1.2 matt-nb5-mips64-premerge-20091211:1.2 matt-premerge-20091211:1.2 matt-nb5-mips64-u2-k2-k4-k7-k8-k9:1.2 matt-nb4-mips64-k7-u2a-k9b:1.2 matt-nb5-mips64-u1-k1-k5:1.2 matt-nb5-mips64:1.2.0.38 netbsd-5-0-1-RELEASE:1.2 jym-xensuspend-nbase:1.2 netbsd-5-0:1.2.0.36 netbsd-5-0-RELEASE:1.2 netbsd-5-0-RC4:1.2 netbsd-5-0-RC3:1.2 netbsd-5-0-RC2:1.2 jym-xensuspend:1.2.0.34 jym-xensuspend-base:1.2 netbsd-5-0-RC1:1.2 netbsd-5:1.2.0.32 netbsd-5-base:1.2 matt-mips64-base2:1.2 matt-mips64:1.2.0.30 mjf-devfs2:1.2.0.28 mjf-devfs2-base:1.2 netbsd-4-0-1-RELEASE:1.2 wrstuden-revivesa-base-3:1.2 wrstuden-revivesa-base-2:1.2 wrstuden-fixsa-newbase:1.2 wrstuden-revivesa-base-1:1.2 yamt-pf42-base4:1.2 yamt-pf42-base3:1.2 hpcarm-cleanup-nbase:1.2 yamt-pf42-baseX:1.2 yamt-pf42-base2:1.2 wrstuden-revivesa:1.2.0.26 wrstuden-revivesa-base:1.2 yamt-pf42:1.2.0.24 yamt-pf42-base:1.2 keiichi-mipv6:1.2.0.22 keiichi-mipv6-base:1.2 matt-armv6-nbase:1.2 matt-armv6-prevmlocking:1.2 wrstuden-fixsa-base-1:1.2 netbsd-4-0:1.2.0.20 netbsd-4-0-RELEASE:1.2 cube-autoconf:1.2.0.18 cube-autoconf-base:1.2 netbsd-4-0-RC5:1.2 netbsd-4-0-RC4:1.2 netbsd-4-0-RC3:1.2 netbsd-4-0-RC2:1.2 netbsd-4-0-RC1:1.2 matt-armv6:1.2.0.16 matt-armv6-base:1.2 matt-mips64-base:1.2 hpcarm-cleanup:1.2.0.14 hpcarm-cleanup-base:1.2 netbsd-3-1-1-RELEASE:1.2 netbsd-3-0-3-RELEASE:1.2 wrstuden-fixsa:1.2.0.12 wrstuden-fixsa-base:1.2 abandoned-netbsd-4-base:1.2 abandoned-netbsd-4:1.2.0.6 netbsd-3-1:1.2.0.8 netbsd-3-1-RELEASE:1.2 netbsd-3-0-2-RELEASE:1.2 netbsd-3-1-RC4:1.2 netbsd-3-1-RC3:1.2 netbsd-3-1-RC2:1.2 netbsd-3-1-RC1:1.2 netbsd-4:1.2.0.10 netbsd-4-base:1.2 netbsd-3-0-1-RELEASE:1.2 netbsd-3-0:1.2.0.4 netbsd-3-0-RELEASE:1.2 netbsd-3-0-RC6:1.2 netbsd-3-0-RC5:1.2 netbsd-3-0-RC4:1.2 netbsd-3-0-RC3:1.2 netbsd-3-0-RC2:1.2 netbsd-3-0-RC1:1.2 netbsd-2-0-3-RELEASE:1.1 netbsd-2-1:1.1.4.1.0.2 netbsd-2-1-RELEASE:1.1.4.1 netbsd-2-1-RC6:1.1.4.1 netbsd-2-1-RC5:1.1.4.1 netbsd-2-1-RC4:1.1.4.1 netbsd-2-1-RC3:1.1.4.1 netbsd-2-1-RC2:1.1.4.1 netbsd-2-1-RC1:1.1.4.1 netbsd-2-0-2-RELEASE:1.1 netbsd-3:1.2.0.2 netbsd-3-base:1.2 netbsd-2-0-1-RELEASE:1.1 netbsd-2:1.1.0.4 netbsd-2-base:1.1 netbsd-2-0-RELEASE:1.1 netbsd-2-0-RC5:1.1 netbsd-2-0-RC4:1.1 netbsd-2-0-RC3:1.1 netbsd-2-0-RC2:1.1 netbsd-2-0-RC1:1.1 netbsd-2-0:1.1.0.2 netbsd-2-0-base:1.1; locks; strict; comment @# @; 1.2 date 2005.02.26.05.45.54; author perseant; state Exp; branches; next 1.1; 1.1 date 2003.02.03.07.45.07; author perseant; state Exp; branches 1.1.4.1; next ; 1.1.4.1 date 2005.05.10.05.08.57; author riz; state Exp; branches; next ; desc @@ 1.2 log @Various minor LFS improvements: * Extend the lfs library from fsck_lfs(8) so that it can be used with a not-yet-existent LFS. Make newfs_lfs(8) use this library, so it can create LFSs whose Ifile is larger than one segment. * Make newfs_lfs(8) use strsuftoi64() for its arguments, a la newfs(8). * Make fsck_lfs(8) respect the "file system is clean" flag. * Don't let fsck_lfs(8) think it has dirty blocks when invoked with the -n flag. @ text @#!/bin/sh # # Create a bunch of small files at once, then delete half of them. # The file size is less than the segment size. # This forces live blocks in half-empty segments. # If the filesystem is small enough, the cleaner will have to run in # order for this to complete. # # Argument is directory in which to run. # echo -n "making small files: " for i in 0 1 2 3 4 5 6 7 8 9 a b c d e f do echo -n "$i " for j in 0 1 do dd if=/dev/zero of=$1/f$i$j bs=65536 count=1 >/dev/null 2>&1 done sync rm -f $1/f*1 done echo "done." echo "Sleeping for 10 seconds...." sleep 10 echo "Trying with another half meg; expect 'no space on device'" dd if=/dev/zero of=$1/f61 bs=512 count=1024 >/dev/null || true sync df -h $1 @ 1.1 log @Break out fsck function; add rename hard link test; change small files test to provoke the cleaner into running as well. @ text @d4 3 a6 2 # Create a bunch of small files at once, then delete most of them. # This forces live blocks in nearly empty segments. d12 2 a13 1 for i in 0 1 2 3 4 5 d15 1 d18 1 a18 4 # Quarter megabyte files, two at a time # for a maximum of six at once # (enough to force cleaning on a 2.88 disk) dd if=/dev/zero of=$1/f$i$j bs=512 count=512 & a19 1 wait a21 2 df -k $1 ls -l $1 d23 1 d28 4 a31 2 echo "Trying with another half meg" dd if=/dev/zero of=$1/f61 bs=512 count=1024 @ 1.1.4.1 log @Pull up the following revisions (requested by perseant in ticket #1281): 1.8 sys/ufs/lfs/TODO 1.75 sys/ufs/lfs/lfs.h (via patch) 1.74 sys/ufs/lfs/lfs_alloc.c (via patch) 1.49, 1.51 sys/ufs/lfs/lfs_balloc.c (1.51 via patch) 1.78 sys/ufs/lfs/lfs_bio.c 1.62 sys/ufs/lfs/lfs_extern.h (via patch) 1.156 sys/ufs/lfs/lfs_segment.c (via patch) 1.48 sys/ufs/lfs/lfs_subr.c 1.101 sys/ufs/lfs/lfs_syscalls.c 1.163 sys/ufs/lfs/lfs_vfsops.c (via patch) 1.134 sys/ufs/lfs/lfs_vnops.c (via patch) 1.61 sys/ufs/ufs/ufs_readwrite.c (via patch) 1.20 libexec/lfs_cleanerd/clean.h (via patch) 1.52 libexec/lfs_cleanerd/cleanerd.c (via patch) 1.41 libexec/lfs_cleanerd/library.c (via patch) 1.4 regress/sys/fs/lfs/newfs_fsck/Makefile 1.2 regress/sys/fs/lfs/newfs_fsck/mkfs_mount 1.2 regress/sys/fs/lfs/newfs_fsck/smallfiles 1.3 sbin/fsck_lfs/bufcache.c 1.3 sbin/fsck_lfs/bufcache.h 1.3 sbin/fsck_lfs/lfs.h 1.8 sbin/fsck_lfs/lfs.c (via patch) 1.8 sbin/fsck_lfs/pass3.c (via patch) 1.18 sbin/fsck_lfs/pass0.c (via patch) 1.18 sbin/fsck_lfs/utilities.c (via patch) 1.7 sbin/fsck_lfs/segwrite.c 1.19 sbin/fsck_lfs/setup.c (via patch) 1.3 sbin/newfs_lfs/Makefile 0 sbin/newfs_lfs/lfs.c (yes, remove it) 1.1 sbin/newfs_lfs/make_lfs.c 1.15 sbin/newfs_lfs/newfs.c (via patch) Various minor LFS improvements. Kernel: * Note when lfs_putpages(9) thinks it is not going to be writing any pages before calling genfs_putpages(9). This prevents a situation in which blocks can be queued for writing without a segment header. * Correct computation of NRESERVE(), though it is still a gross overestimate in most cases. Note that if NRESERVE() is too high, it may be impossible to create files on the filesystem. We catch this case on filesystem mount and refuse to mount r/w. * Allow filesystems to be mounted whose block size is == MAXBSIZE. * Somewhere along the line, ufs_bmaparray(9) started mangling UNWRITTEN entries in indirect blocks again, triggering a failed assertion "daddr <= LFS_MAX_DADDR". Explicitly convert to and from int32_t to correct this. Should fix PR #29045. * Add a high-water mark for the number of dirty pages any given LFS can hold before triggering a flush. This is settable by sysctl, but off (zero) by default. * Be more careful about the MAX_BYTES and MAX_BUFS computations so we shouldn't see "please increase to at least zero" messages. * Note that VBLK and VCHR vnodes can have nonzero values in di_db[0] even though their v_size == 0. Don't panic when we see this. Fixes PR #26680. * Change lfs_bfree to a signed quantity. The manner in which it is processed before being passed to the cleaner means that sometimes it may drop below zero, and the cleaner must be aware of this. * Never report bfree < 0 (or higher than lfs_dsize) through lfs_statfs(9). This prevents df(1) from ever telling us that our full filesystems have 16TB free. * Account space allocated through lfs_balloc(9) that does not have associated buffer headers, so that the pagedaemon doesn't run us out of segments. * Return ENOSPC from lfs_balloc(9) when bfree drops to zero. * Address a deadlock in lfs_bmapv/lfs_markv when the filesystem is being unmounted. Because vfs_busy() is a shared lock, and lfs_bmapv/lfs_markv mark the filesystem vfs_busy(), the cleaner can be holding the lock that umount() is blocking on, then try to vfs_busy() again in getnewvnode(). cleaner: * Adapt lfs_cleanerd to use the fcntl call to get the Ifile filehandle, so it need not be in the namespace. * Make lfs_cleanerd be more careful when there are very few available segments. * Make lfs_cleanerd less verbose when the filesystem is unmounted. newfs_lfs, fsck_lfs, and regression: * Extend the lfs library from fsck_lfs(8) so that it can be used with a not-yet-existent LFS. Make newfs_lfs(8) use this library, so it can create LFSs whose Ifile is larger than one segment. Addresses PR #11110. * Make newfs_lfs(8) use strsuftoi64() for its arguments, a la newfs(8). * Make fsck_lfs(8) respect the "file system is clean" flag. * Don't let fsck_lfs(8) think it has dirty blocks when invoked with the -n flag. * Remove the Ifile from the filesystem namespace. The cleaner now uses a fcntl call on the root inode to find the Ifile filehandle. (As a side-effect, addresses PR #29144.) @ text @d4 2 a5 3 # Create a bunch of small files at once, then delete half of them. # The file size is less than the segment size. # This forces live blocks in half-empty segments. d11 1 a11 2 echo -n "making small files: " for i in 0 1 2 3 4 5 6 7 8 9 a b c d e f a12 1 echo -n "$i " d15 4 a18 1 dd if=/dev/zero of=$1/f$i$j bs=65536 count=1 >/dev/null 2>&1 d20 1 d23 2 a25 1 echo "done." d30 2 a31 4 echo "Trying with another half meg; expect 'no space on device'" dd if=/dev/zero of=$1/f61 bs=512 count=1024 >/dev/null || true sync df -h $1 @