head 1.1; branch 1.1.1; access; symbols netbsd-11-0-RC4:1.1.1.4 netbsd-11-0-RC3:1.1.1.4 netbsd-11-0-RC2:1.1.1.4 netbsd-11-0-RC1:1.1.1.4 perseant-exfatfs-base-20250801:1.1.1.4 netbsd-11:1.1.1.4.0.40 netbsd-11-base:1.1.1.4 netbsd-10-1-RELEASE:1.1.1.4 perseant-exfatfs-base-20240630:1.1.1.4 perseant-exfatfs:1.1.1.4.0.38 perseant-exfatfs-base:1.1.1.4 netbsd-8-3-RELEASE:1.1.1.4 netbsd-9-4-RELEASE:1.1.1.4 netbsd-10-0-RELEASE:1.1.1.4 netbsd-10-0-RC6:1.1.1.4 netbsd-10-0-RC5:1.1.1.4 netbsd-10-0-RC4:1.1.1.4 netbsd-10-0-RC3:1.1.1.4 netbsd-10-0-RC2:1.1.1.4 netbsd-10-0-RC1:1.1.1.4 netbsd-10:1.1.1.4.0.36 netbsd-10-base:1.1.1.4 netbsd-9-3-RELEASE:1.1.1.4 cjep_sun2x-base1:1.1.1.4 cjep_sun2x:1.1.1.4.0.34 cjep_sun2x-base:1.1.1.4 cjep_staticlib_x-base1:1.1.1.4 netbsd-9-2-RELEASE:1.1.1.4 cjep_staticlib_x:1.1.1.4.0.32 cjep_staticlib_x-base:1.1.1.4 netbsd-9-1-RELEASE:1.1.1.4 phil-wifi-20200421:1.1.1.4 phil-wifi-20200411:1.1.1.4 is-mlppp:1.1.1.4.0.30 is-mlppp-base:1.1.1.4 phil-wifi-20200406:1.1.1.4 netbsd-8-2-RELEASE:1.1.1.4 netbsd-9-0-RELEASE:1.1.1.4 netbsd-9-0-RC2:1.1.1.4 netbsd-9-0-RC1:1.1.1.4 phil-wifi-20191119:1.1.1.4 netbsd-9:1.1.1.4.0.28 netbsd-9-base:1.1.1.4 phil-wifi-20190609:1.1.1.4 netbsd-8-1-RELEASE:1.1.1.4 netbsd-8-1-RC1:1.1.1.4 pgoyette-compat-merge-20190127:1.1.1.4 pgoyette-compat-20190127:1.1.1.4 pgoyette-compat-20190118:1.1.1.4 pgoyette-compat-1226:1.1.1.4 pgoyette-compat-1126:1.1.1.4 pgoyette-compat-1020:1.1.1.4 pgoyette-compat-0930:1.1.1.4 pgoyette-compat-0906:1.1.1.4 netbsd-7-2-RELEASE:1.1.1.4 pgoyette-compat-0728:1.1.1.4 netbsd-8-0-RELEASE:1.1.1.4 phil-wifi:1.1.1.4.0.26 phil-wifi-base:1.1.1.4 pgoyette-compat-0625:1.1.1.4 netbsd-8-0-RC2:1.1.1.4 pgoyette-compat-0521:1.1.1.4 pgoyette-compat-0502:1.1.1.4 pgoyette-compat-0422:1.1.1.4 netbsd-8-0-RC1:1.1.1.4 pgoyette-compat-0415:1.1.1.4 pgoyette-compat-0407:1.1.1.4 pgoyette-compat-0330:1.1.1.4 pgoyette-compat-0322:1.1.1.4 pgoyette-compat-0315:1.1.1.4 netbsd-7-1-2-RELEASE:1.1.1.4 pgoyette-compat:1.1.1.4.0.24 pgoyette-compat-base:1.1.1.4 netbsd-7-1-1-RELEASE:1.1.1.4 matt-nb8-mediatek:1.1.1.4.0.22 matt-nb8-mediatek-base:1.1.1.4 perseant-stdc-iso10646:1.1.1.4.0.20 perseant-stdc-iso10646-base:1.1.1.4 netbsd-8:1.1.1.4.0.18 netbsd-8-base:1.1.1.4 prg-localcount2-base3:1.1.1.4 prg-localcount2-base2:1.1.1.4 prg-localcount2-base1:1.1.1.4 prg-localcount2:1.1.1.4.0.16 prg-localcount2-base:1.1.1.4 pgoyette-localcount-20170426:1.1.1.4 bouyer-socketcan-base1:1.1.1.4 pgoyette-localcount-20170320:1.1.1.4 netbsd-7-1:1.1.1.4.0.14 netbsd-7-1-RELEASE:1.1.1.4 netbsd-7-1-RC2:1.1.1.4 netbsd-7-nhusb-base-20170116:1.1.1.4 bouyer-socketcan:1.1.1.4.0.12 bouyer-socketcan-base:1.1.1.4 pgoyette-localcount-20170107:1.1.1.4 netbsd-7-1-RC1:1.1.1.4 pgoyette-localcount-20161104:1.1.1.4 netbsd-7-0-2-RELEASE:1.1.1.4 localcount-20160914:1.1.1.4 netbsd-7-nhusb:1.1.1.4.0.10 netbsd-7-nhusb-base:1.1.1.4 pgoyette-localcount-20160806:1.1.1.4 pgoyette-localcount-20160726:1.1.1.4 pgoyette-localcount:1.1.1.4.0.8 pgoyette-localcount-base:1.1.1.4 netbsd-7-0-1-RELEASE:1.1.1.4 netbsd-7-0:1.1.1.4.0.6 netbsd-7-0-RELEASE:1.1.1.4 netbsd-7-0-RC3:1.1.1.4 netbsd-7-0-RC2:1.1.1.4 netbsd-7-0-RC1:1.1.1.4 netbsd-6-0-6-RELEASE:1.1.1.3 netbsd-6-1-5-RELEASE:1.1.1.3 netbsd-7:1.1.1.4.0.4 netbsd-7-base:1.1.1.4 yamt-pagecache-base9:1.1.1.4 yamt-pagecache-tag8:1.1.1.3 netbsd-6-1-4-RELEASE:1.1.1.3 netbsd-6-0-5-RELEASE:1.1.1.3 tls-earlyentropy:1.1.1.4.0.2 tls-earlyentropy-base:1.1.1.4 riastradh-xf86-video-intel-2-7-1-pre-2-21-15:1.1.1.4 riastradh-drm2-base3:1.1.1.4 atf-0-20:1.1.1.4 atf-0-19:1.1.1.3 GITHUB_JMMV:1.1.1 netbsd-6-1-3-RELEASE:1.1.1.3 netbsd-6-0-4-RELEASE:1.1.1.3 netbsd-6-1-2-RELEASE:1.1.1.3 netbsd-6-0-3-RELEASE:1.1.1.3 netbsd-6-1-1-RELEASE:1.1.1.3 riastradh-drm2-base2:1.1.1.3 riastradh-drm2-base1:1.1.1.3 riastradh-drm2:1.1.1.3.0.16 riastradh-drm2-base:1.1.1.3 netbsd-6-1:1.1.1.3.0.22 netbsd-6-0-2-RELEASE:1.1.1.3 netbsd-6-1-RELEASE:1.1.1.3 khorben-n900:1.1.1.3.0.20 netbsd-6-1-RC4:1.1.1.3 netbsd-6-1-RC3:1.1.1.3 agc-symver:1.1.1.3.0.18 agc-symver-base:1.1.1.3 netbsd-6-1-RC2:1.1.1.3 netbsd-6-1-RC1:1.1.1.3 atf-0-17:1.1.1.3 yamt-pagecache-base8:1.1.1.3 netbsd-6-0-1-RELEASE:1.1.1.3 yamt-pagecache-base7:1.1.1.3 matt-nb6-plus-nbase:1.1.1.3 yamt-pagecache-base6:1.1.1.3 netbsd-6-0:1.1.1.3.0.14 netbsd-6-0-RELEASE:1.1.1.3 netbsd-6-0-RC2:1.1.1.3 tls-maxphys:1.1.1.3.0.12 tls-maxphys-base:1.1.1.4 matt-nb6-plus:1.1.1.3.0.10 matt-nb6-plus-base:1.1.1.3 netbsd-6-0-RC1:1.1.1.3 atf-0-16:1.1.1.3 yamt-pagecache-base5:1.1.1.3 yamt-pagecache-base4:1.1.1.3 netbsd-6:1.1.1.3.0.8 netbsd-6-base:1.1.1.3 atf-0-15:1.1.1.3 yamt-pagecache-base3:1.1.1.3 yamt-pagecache-base2:1.1.1.3 yamt-pagecache:1.1.1.3.0.6 yamt-pagecache-base:1.1.1.3 atf-0-14:1.1.1.3 cherry-xenmp:1.1.1.3.0.4 cherry-xenmp-base:1.1.1.3 atf-0-13:1.1.1.3 bouyer-quota2-nbase:1.1.1.3 bouyer-quota2:1.1.1.3.0.2 bouyer-quota2-base:1.1.1.3 matt-mips64-premerge-20101231:1.1.1.3 atf-0-12:1.1.1.3 atf-0-11:1.1.1.3 atf-0-10:1.1.1.3 atf-0-9:1.1.1.2 atf-0-8:1.1.1.2 atf-0-7:1.1.1.2 matt-premerge-20091211:1.1.1.1 jym-xensuspend-nbase:1.1.1.1 jym-xensuspend:1.1.1.1.0.2 jym-xensuspend-base:1.1.1.1 atf-0-6:1.1.1.1 TNF:1.1.1; locks; strict; comment @# @; 1.1 date 2009.01.19.07.11.51; author jmmv; state Exp; branches 1.1.1.1; next ; 1.1.1.1 date 2009.01.19.07.11.51; author jmmv; state Exp; branches; next 1.1.1.2; 1.1.1.2 date 2009.12.22.13.25.45; author jmmv; state Exp; branches; next 1.1.1.3; 1.1.1.3 date 2010.07.03.08.04.47; author jmmv; state Exp; branches 1.1.1.3.6.1 1.1.1.3.12.1; next 1.1.1.4; 1.1.1.4 date 2014.02.11.16.07.06; author jmmv; state Exp; branches; next ; commitid uLclGGDjdTDOrHox; 1.1.1.3.6.1 date 2014.05.22.15.40.11; author yamt; state Exp; branches; next ; commitid TzMwNuE6CLSD5yBx; 1.1.1.3.12.1 date 2014.08.19.23.45.53; author tls; state Exp; branches; next ; commitid jTnpym9Qu0o4R1Nx; desc @@ 1.1 log @Initial revision @ text @ Automated Testing Framework (atf) The NetBSD Foundation, Inc. --------------------------------------------------------------------------- Introduction ============ The Automated Testing Framework (ATF) is a collection of libraries and utilities designed to ease unattended application testing in the hands of developers and end users of a specific piece of software. As regards developers, ATF provides the necessary means to easily create test suites composed of multiple test programs, which in turn are a collection of test cases. It also attempts to simplify the debugging of problems when these test cases detect an error by providing as much information as possible about the failure. As regards users, it simplifies the process of running the test suites and, in special, encourages end users to run them often: they do not need to have source trees around nor any other development tools installed to be able to certify that a given piece of software works on their machine as advertised. Other documents =============== * AUTHORS: List of authors and contributors for this project. * COPYING: License information. * ChangeLog: Pointers to the code repository. No actual history is provided here. * INSTALL: Compilation and installation instructions. These is not the standard document shipped with many packages, so be sure to read it for things that are specific to ATF's build. * NEWS: List of major changes between formal, published releases. * ROADMAP: List of changes planned for future releases. Contributing ============ If you are planning to contribute code to the project, be absolutely sure to read doc/hacking.txt first. --------------------------------------------------------------------------- End of document @ 1.1.1.1 log @Import ATF 0.6. Replaces the old ATF 0.5 that was in dist/atf. Changes in this release: * Make atf-exec be able to kill its child process after a certain period of time; this is controlled through the new -t option. * Change atf-sh to use atf-exec's -t option to control the test case's timeouts, instead of doing it internally. Same behavior as before, but noticeably faster. * atf-exec's -g option and atf-killpg are gone due to the previous change. * Added the atf-check(1) tool, a program that executes a given command and checks its exit code against a known value and allows the management of stdout and stderr in multiple ways. This replaces the previous atf_check function in the atf-sh library and exposes this functionality to both atf-c and atf-c++. * Added the ATF_REQUIRE family of macros to the C interface. These help in checking for fatal test conditions. The old ATF_CHECK macros now perform non-fatal checks only. I.e. by using ATF_CHECK, the test case can now continue its execution and the failures will not be reported until the end of the whole run. * Extended the amount of ATF_CHECK_* C macros with new ones to provide more features to the developer. These also have their corresponding counterparts in the ATF_REQUIRE_* family. The new macros (listing the suffixes only) are: _EQ (replaces _EQUAL), _EQ_MSG, _STREQ and _STREQ_MSG. @ text @@ 1.1.1.2 log @Import atf 0.7. Changes in this release: * Added build-time checks to atf-c and atf-c++. A binding for atf-sh will come later. * Migrated all build-time checks for header files to proper ATF tests. This demonstrates the use of the new feature described above. * Added an internal API for child process management. * Converted all plain-text distribution documents to a Docbook canonical version, and include pre-generated plain text and HTML copies in the distribution file. * Simplified the contents of the Makefile.am by regenerating it from a canonical Makefile.am.m4 source. As a side-effect, some dependency specifications were fixed. * Migrated all checks from the check target to installcheck, as these require ATF to be installed. * Fixed sign comparison mismatches triggered by the now-enabled -Wsign-compare. * Fixed many memory and object leaks. @ text @d1 3 a3 1 Basic information a4 1 By Julio Merino, The NetBSD Foundation d6 2 a7 1 Contents d9 3 a11 1 1. Introduction d13 5 a17 1 2. Other documents d19 5 a23 1 3. Contributing a24 1 Introduction d26 2 a27 3 The Automated Testing Framework (ATF) is a collection of libraries and utilities designed to ease unattended application testing in the hands of developers and end users of a specific piece of software. d29 1 a29 5 As regards developers, ATF provides the necessary means to easily create test suites composed of multiple test programs, which in turn are a collection of test cases. It also attempts to simplify the debugging of problems when these test cases detect an error by providing as much information as possible about the failure. d31 1 a31 5 As regards users, it simplifies the process of running the test suites and, in special, encourages end users to run them often: they do not need to have source trees around nor any other development tools installed to be able to certify that a given piece of software works on their machine as advertised. d33 2 a34 1 Other documents d36 3 a38 1 * AUTHORS: List of authors and contributors for this project. d40 1 a40 1 * COPYING: License information. d42 1 a42 3 * INSTALL: Compilation and installation instructions. These is not the standard document shipped with many packages, so be sure to read it for things that are specific to ATF's build. a43 1 * NEWS: List of major changes between formal, published releases. d45 2 a46 1 Contributing d48 6 a53 2 If you are planning to contribute code to the project, be absolutely sure to read doc/hacking.txt first. @ 1.1.1.3 log @Import atf 0.10: Miscellaneous features * Added expected failures support to test cases and atf-run. These include, for example, expected clean exits, expected reception of fatal signals, expected timeouts and expected errors in condition checks. These statuses can be used to denote test cases that are known to fail due to a bug in the code they are testing. atf-report reports these tests separately but they do not count towards the failed test cases amount. * Added the ATF_CHECK_ERRNO and ATF_REQUIRE_ERRNO to the C library to allow easy checking of call failures that update errno. * Added the has.cleanup meta-data property to test caes that specifies whether the test case has a cleanup routine or not; its value is automatically set. This property is read by atf-run to know if it has to run the cleanup routine; skipping this run for every test case significantly speeds up the run time of test suites. * Reversed the order of the ATF_CHECK_THROW macro in the C++ binding to take the expected exception as the first argument and the statement to execute as the second argument. Changes in atf-check * Changed atf-check to support negating the status and output checks by prefixing them with not- and added support to specify multiple checkers for stdout and stderr, not only one. * Added the match output checker to atf-check to look for regular expressions in the stdout and stderr of commands. * Modified the exit checks in atf-check to support checking for the reception of signals. Code simplifications and cleanups * Removed usage messages from test programs to simplify the implementation of every binding by a significant amount. They just now refer the user to the appropriate manual page and do not attempt to wrap lines on terminal boundaries. Test programs are not supposed to be run by users directly so this minor interface regression is not important. * Removed the atf-format internal utility, which is unused after the change documented above. * Removed the atf-cleanup internal utility. It has been unused since the test case isolation was moved to atf-run in 0.8 * Splitted the Makefile.am into smaller files for easier maintenance and dropped the use of M4. Only affects users building from the repository sources. * Intermixed tests with the source files in the source tree to provide them more visibility and easier access. The tests directory is gone from the source tree and tests are now suffixed by _test, not prefixed by t_. * Simplifications to the atf-c library: removed the io, tcr and ui modules as they had become unnecessary after all simplifications introduced since the 0.8 release. * Removed the application/X-atf-tcr format introduced in 0.8 release. Tests now print a much simplified format that is easy to parse and nicer to read by end users. As a side effect, the default for test cases is now to print their results to stdout unless otherwise stated by providing the -r flag. * Removed XML distribution documents and replaced them with plain-text documents. They provided little value and introduced a lot of complexity to the build system. * Simplified the output of atf-version by not attempting to print a revision number when building form a distfile. Makes the build system easier to maintain. @ text @d1 1 a1 2 Introductory information Automated Testing Framework =========================================================================== d3 1 d5 1 a5 2 Introduction ************ d7 1 a7 3 The Automated Testing Framework (ATF) is a collection of libraries and utilities designed to ease unattended application testing in the hands of developers and end users of a specific piece of software. d9 1 a9 5 As regards developers, ATF provides the necessary means to easily create test suites composed of multiple test programs, which in turn are a collection of test cases. It also attempts to simplify the debugging of problems when these test cases detect an error by providing as much information as possible about the failure. d11 1 a11 5 As regards users, it simplifies the process of running the test suites and, in special, encourages end users to run them often: they do not need to have source trees around nor any other development tools installed to be able to certify that a given piece of software works on their machine as advertised. d13 1 d15 3 a17 2 Other documents *************** d19 5 a23 1 * AUTHORS: List of authors and contributors for this project. d25 5 a29 1 * COPYING: License information. d31 1 a31 3 * INSTALL: Compilation and installation instructions. These is not the standard document shipped with many packages, so be sure to read it for things that are specific to ATF's build. d33 1 a33 1 * NEWS: List of major changes between formal, published releases. d35 1 d37 10 a46 2 =========================================================================== vim: filetype=text:textwidth=75:expandtab:shiftwidth=2:softtabstop=2 @ 1.1.1.3.12.1 log @Rebase to HEAD as of a few days ago. @ text @d8 15 a22 12 The Automated Testing Framework (ATF) is a collection of libraries to implement test programs in a variety of languages. At the moment, ATF offers C, C++ and POSIX shell bindings with which to implement tests. These bindings all offer a similar set of functionality and any test program written with them exposes a consistent user interface. ATF-based test programs rely on a separate runtime engine to execute them. The runtime engine is in charge of isolating the test programs from the rest of the system to ensure that their results are deterministic and that they cannot affect the running system. The runtime engine is also responsible for gathering the results of all tests and composing reports. The current runtime of choice is Kyua. @ 1.1.1.3.6.1 log @sync with head. for a reference, the tree before this commit was tagged as yamt-pagecache-tag8. this commit was splitted into small chunks to avoid a limitation of cvs. ("Protocol error: too many arguments") @ text @d8 15 a22 12 The Automated Testing Framework (ATF) is a collection of libraries to implement test programs in a variety of languages. At the moment, ATF offers C, C++ and POSIX shell bindings with which to implement tests. These bindings all offer a similar set of functionality and any test program written with them exposes a consistent user interface. ATF-based test programs rely on a separate runtime engine to execute them. The runtime engine is in charge of isolating the test programs from the rest of the system to ensure that their results are deterministic and that they cannot affect the running system. The runtime engine is also responsible for gathering the results of all tests and composing reports. The current runtime of choice is Kyua. @ 1.1.1.4 log @Import atf-0.20: Experimental version released on February 7th, 2014. This is the first release without the code for the deprecated tools. If you require such code, please fetch a copy of the 0.19 release and extract the 'tools' directory for your own consumption. * Removed the deprecated tools. This includes atf-config, atf-report, atf-run and atf-version. @ text @d8 15 a22 12 The Automated Testing Framework (ATF) is a collection of libraries to implement test programs in a variety of languages. At the moment, ATF offers C, C++ and POSIX shell bindings with which to implement tests. These bindings all offer a similar set of functionality and any test program written with them exposes a consistent user interface. ATF-based test programs rely on a separate runtime engine to execute them. The runtime engine is in charge of isolating the test programs from the rest of the system to ensure that their results are deterministic and that they cannot affect the running system. The runtime engine is also responsible for gathering the results of all tests and composing reports. The current runtime of choice is Kyua. @