NetBSD


NetBSD is a free and open-source Unix-like operating system based on the Berkeley Software Distribution. It was the first open-source BSD descendant officially released after 386BSD was forked. It continues to be actively developed and is available for many platforms, including servers, desktops, handheld devices, and embedded systems.
The NetBSD project focuses on code clarity, careful design, and portability across many computer architectures. Its source code is publicly available and permissively licensed.

History

NetBSD was originally derived from the 4.3BSD-Reno release of the Berkeley Software Distribution from the Computer Systems Research Group of the University of California, Berkeley, via their Net/2 source code release and the 386BSD project. The NetBSD project began as a result of frustration within the 386BSD developer community with the pace and direction of the operating system's development. The four founders of the NetBSD project, Chris Demetriou, Theo de Raadt, Adam Glass, and Charles Hannum, felt that a more open development model would benefit the project: one centered on portable, clean, correct code. They aimed to produce a unified, multi-platform, production-quality, BSD-based operating system. The name "NetBSD" was suggested by De Raadt, based on the importance and growth of networks such as the Internet at that time, and the distributed, collaborative nature of its development.
The NetBSD source code repository was established on 21 March 1993 and the first official release, NetBSD 0.8, was made on 19 April 1993. This was derived from 386BSD 0.1 plus the version 0.2.2 unofficial patchkit, with several programs from the Net/2 release missing from 386BSD re-integrated, and various other improvements. The first multi-platform release, NetBSD 1.0, was made in October 1994, and being updated with 4.4BSD-Lite sources, it was free of all legally encumbered 4.3BSD Net/2 code. Also in 1994, for disputed reasons, one of the founders, Theo de Raadt, was removed from the project. He later founded a new project, OpenBSD, from a forked version of NetBSD 1.0 near the end of 1995.
In 1998, NetBSD 1.3 introduced the pkgsrc packages collection.
Until 2004, NetBSD 1.x releases were made at roughly annual intervals, with minor "patch" releases in between. From release 2.0 onwards, NetBSD uses semantic versioning, and each major NetBSD release corresponds to an incremented major version number, i.e. the major releases following 2.0 are 3.0, 4.0 and so on. The previous minor releases are now divided into two categories: x.y "stable" maintenance releases and x.y.z releases containing only security and critical fixes.

Features

Portability

As the project's motto suggests, NetBSD has been ported to a large number of 32- and 64-bit architectures. These range from VAX minicomputers to Pocket PC PDAs. As of 2019, NetBSD supports 59 hardware platforms. The kernel and userland for these platforms are all built from a central unified source-code tree managed by CVS. Currently, unlike other kernels such as μClinux, the NetBSD kernel requires the presence of an MMU in any given target architecture.
NetBSD's portability is aided by the use of hardware abstraction layer interfaces for low-level hardware access such as bus input/output or DMA. Using this portability layer, device drivers can be split into "machine-independent" and "machine-dependent" components. This makes a single driver easily usable on several platforms by hiding hardware access details, and reduces the work to port it to a new system.
This permits a particular device driver for a PCI card to work without modifications, whether it is in a PCI slot on an IA-32, Alpha, PowerPC, SPARC, or other architecture with a PCI bus. Also, a single driver for a specific device can operate via several different buses, like ISA, PCI, or PC Card.
In comparison, Linux device driver code often must be reworked for each new architecture. As a consequence, in porting efforts by NetBSD and Linux developers, NetBSD has taken much less time to port to new hardware.
This platform independence aids the development of embedded systems, particularly since NetBSD 1.6, when the entire toolchain of compilers, assemblers, linkers, and other tools fully support cross-compiling.
In 2005, as a demonstration of NetBSD's portability and suitability for embedded applications, Technologic Systems, a vendor of embedded systems hardware, designed and demonstrated a NetBSD-powered kitchen toaster.
Commercial ports to embedded platforms, including the AMD Geode LX800, Freescale PowerQUICC processors, Marvell Orion, AMCC 405 family of PowerPC processors, Intel XScale IOP and IXP series, were available from and supported by Wasabi Systems.

Portable build framework

The NetBSD cross-compiling framework lets a developer build a complete NetBSD system for an architecture from a more powerful system of different architecture, including on a different operating system. Several embedded systems using NetBSD have required no additional software development other than toolchain and target rehost.

The pkgsrc packages collection

NetBSD features pkgsrc, a framework for building and managing third-party application software packages. The pkgsrc collection consists of more than 20,000 packages as of. Building and installing packages such as KDE, GNOME, the Apache HTTP Server or Perl is performed through the use of a system of makefiles. This can automatically fetch the source code, unpack, patch, configure, build and install the package such that it can be removed again later. An alternative to compiling from source is to use a precompiled binary package. In either case, any prerequisites/dependencies will be installed automatically by the package system, without need for manual intervention.
pkgsrc supports not only NetBSD, but also several other BSD variants like FreeBSD and Darwin/Mac OS X, and other Unix-like operating systems such as Linux, Solaris, IRIX, and others, as well as Interix. pkgsrc was previously adopted as the official package management system for DragonFly BSD.

Symmetric multiprocessing

NetBSD has supported SMP since the NetBSD 2.0 release in 2004, which was initially implemented using the giant lock approach. During the development cycle of the NetBSD 5 release, major work was done to improve SMP support; most of the kernel subsystems were modified to use the fine-grained locking approach. New synchronization primitives were implemented and scheduler activations was replaced with a in February 2007. A scalable M2 thread scheduler was implemented, though the old 4.4BSD scheduler still remains the default but was modified to scale with SMP. Threaded software interrupts were implemented to improve synchronization. The virtual memory system, memory allocator and trap handling were made MP safe. The file system framework, including the VFS and major file systems were modified to be MP safe. Since April 2008 the only subsystems running with a giant lock are the network protocols and most device drivers.

Security

NetBSD provides various features in the security area. The Kernel Authorization framework is a subsystem managing all authorization requests inside the kernel, and used as system-wide security policy. It allows external modules to plug-in the authorization process. NetBSD also incorporates exploit mitigation features, ASLR, KASLR, restricted mprotect and Segvguard from the PaX project, and GCC Stack Smashing Protection compiler extensions. Verified Executables is an in-kernel file integrity subsystem in NetBSD. It allows the user to set digital fingerprints of files, and take a number of different actions if files do not match their fingerprints. For example, one can allow Perl to run only scripts that match their fingerprints. The cryptographic device driver allows using disks or partitions for encrypted storage.

Virtualization

The Xen virtual-machine monitor has been supported in NetBSD since release 3.0. The use of Xen requires a special pre-kernel boot environment that loads a Xen-specialized kernel as the "host OS". Any number of "guest OSes" virtualized computers, with or without specific Xen/DomU support, can be run in parallel with the appropriate hardware resources.
The need for a third-party boot manager, such as GRUB, was eliminated with NetBSD 5's Xen-compatible boot manager. NetBSD 6 as a Dom0 has been benchmarked comparably to Linux, with better performance than Linux in some tests.
As of NetBSD 9.0, accelerated virtualization is provided through the native hypervisor NVMM.
It provides a virtualization API, libnvmm, that can be leveraged by emulators such as QEMU. A unique property of NVMM is that the kernel never accesses guest VM memory, only creating it.
HAXM provides an alternative solution for acceleration in QEMU for Intel CPUs only, similar to Linux's KVM.
NetBSD 5.0 introduced the rump kernel, an architecture to run drivers in user-space by emulating kernel-space calls. This anykernel architecture allows adding support of NetBSD drivers to other kernel architectures, ranging from exokernels to monolithic kernels.

Storage

NetBSD includes many enterprise features like iSCSI, a journaling filesystem, logical volume management and the ZFS filesystem.
The bio interface for vendor-agnostic RAID volume management through bioctl has been available in NetBSD since 2007.
The WAPBL journaling filesystem, an extension of the BSD FFS filesystem, was contributed by Wasabi Systems in 2008.
The NetBSD Logical Volume Manager is based on a BSD reimplementation of a device-mapper driver and a port of the Linux Logical Volume Manager tools. It was mostly written during the Google Summer of Code 2008.
The ZFS filesystem developed by Sun Microsystems was imported into the NetBSD base system in 2009. Currently, the NetBSD ZFS port is based on ZFS version 22.
The CHFS Flash memory filesystem was imported into NetBSD in November 2011. CHFS is a file system developed at the Department of Software Engineering, University of Szeged, Hungary, and is the first open source Flash-specific file system written for NetBSD.

Compatibility with other operating systems

At the source code level, NetBSD is very nearly entirely compliant with POSIX.1 standard and mostly compliant with POSIX.2.
NetBSD provides system call-level binary compatibility on the appropriate processor architectures with its previous releases, but also with several other UNIX-derived and UNIX-like operating systems, including Linux, and other 4.3BSD derivatives like SunOS 4. This allows NetBSD users to run many applications that are only distributed in binary form for other operating systems, usually with no significant loss of performance.
A variety of "foreign" disk filesystem formats are also supported in NetBSD, including ZFS, FAT, NTFS, Linux ext2fs, Apple HFS and OS X UFS, RISC OS FileCore/ADFS, AmigaOS Fast File System, IRIX EFS, Version 7 Unix File System, and many more through PUFFS.

Kernel scripting

Kernel-space scripting with the Lua programming language is a relatively new feature in NetBSD; it is available as of NetBSD 7.0. The Lua language was initially ported to the NetBSD kernel during Google Summer of Code 2010 and has undergone several improvements since then. There are two main differences between user and kernel space Lua: kernel Lua does not support floating-point numbers; as such, only Lua integers are available. It also does not have full support to user space libraries that rely on the operating system.

Sensors

NetBSD has featured a native hardware monitoring framework since 1999/2000, and in 2003, it served as the inspiration behind the OpenBSD's sysctl hw.sensors framework when some NetBSD drivers were being ported to OpenBSD.
, NetBSD had close to 85 device drivers exporting data through the API of the envsys framework. Since the 2007 revision, serialisation of data between the kernel and userland is done through XML property lists with the help of NetBSD's proplib.

Uses

NetBSD's clean design, high performance, scalability, and support for many architectures has led to its use in embedded devices and servers, especially in networking applications.
A commercial real-time operating system, QNX, uses a network stack based on NetBSD code, and provides various drivers ported from NetBSD.
Dell Force10 uses NetBSD as the underlying operating system that powers FTOS, which is used in high scalability switch/routers. Force10 also made a donation to the NetBSD Foundation in 2007 to help further research and the open development community.
Wasabi Systems provides a commercial Wasabi Certified BSD product based on NetBSD with proprietary enterprise features and extensions, which are focused on embedded, server and storage applications.
NetBSD was used in NASA's SAMS-II Project of measuring the microgravity environment on the International Space Station, and for investigations of TCP for use in satellite networks.
In 2004, SUNET used NetBSD to set the Internet2 Land Speed Record. NetBSD was chosen "due to the scalability of the TCP code".
NetBSD is also used in Apple's AirPort Extreme and Time Capsule products, instead of their own OS X.
The operating system of the T-Mobile Sidekick LX 2009 smartphone is based on NetBSD.
The Minix operating system uses a mostly NetBSD userland as well as its pkgsrc packages infrastructure since version 3.2.
Parts of macOS were originally taken from NetBSD, such as the userspace command line tools. This was because they were already ported to PowerPC systems.

Licensing

All of the NetBSD kernel and most of the core userland source code is released under the terms of the BSD License. This essentially allows everyone to use, modify, redistribute or sell it as they wish, as long as they do not remove the copyright notice and license text. Thus, the development of products based on NetBSD is possible without having to make modifications to the source code public. In contrast, the GPL, which does not apply to NetBSD, stipulates that changes to source code of a product must be released to the product recipient when products derived from those changes are released.
On 20 June 2008, the NetBSD Foundation announced a transition to the two clause BSD license, citing concerns with UCB support of clause 3 and industry applicability of clause 4.
NetBSD also includes the GNU development tools and other packages, which are covered by the GPL and other open source licenses. As with other BSD projects, NetBSD separates those in its base source tree to make it easier to remove code that is under more restrictive licenses. As for packages, the installed software licenses may be controlled by modifying the list of allowed licenses in the pkgsrc configuration file.

Releases

The following table lists major NetBSD releases and their notable features in reverse chronological order. Minor and patch releases are not included.
Major releasesRelease dateNotable features and changes
14 February 2020
  • Support for AArch64 machines, including SBSA/SBBR, big.LITTLE, compatibility with 32-bit binaries, and up to 256 CPUs
  • Enhanced support for ARMv7-A, including UEFI bootloader, big.LITTLE, kernel mode setting for Allwinner and other SoCs, and device tree support
  • Updated DRM to Linux 4.4, support for Intel graphics up to and including Kaby Lake
  • Hardware accelerated virtualization for QEMU via NVMM
  • Improvements in the NPF firewall, updated ZFS, new and reworked drivers
  • Support for various new kernel and userland code sanitizers, and kernel ASLR. Audited network stack.
  • Removal of various old and unmaintained components, such as ISDN support
17 July 2018
  • Audio system reworked with an in-kernel mixer
  • USB stack reworked with support for USB 3 host controllers and data rates
  • PaX ASLR enabled by default on supported architectures
  • Hardened memory layout with fewer writable pages and PaX MPROTECT enforced by default on supported architectures
  • Support for reproducible builds, and userland built with position-independent code by default
  • Meltdown and Spectre vulnerability mitigations for Intel and AMD CPUs
  • Added a UEFI bootloader, NVMe driver, nouveau driver for Nvidia GPUs, support for more ARM boards including the Raspberry Pi 3
  • 8 October 2015
  • Add accelerated support for modern Intel and Radeon devices on x86 through a port of the Linux 3.15 DRM/KMS code.
  • Lua kernel scripting
  • blacklistd, a daemon that integrates with packet filters to dynamically protect network daemons from network break-in attempts.
  • NPF improvements such as JIT compilation and dynamic rules.
  • Multiprocessor ARM support
  • Support for many new ARM boards:
  • * Raspberry Pi 2
  • * ODROID-C1
  • * BeagleBoard, BeagleBone, BeagleBone Black
  • * Allwinner A20, A31:
  • * Freescale i.MX50, i.MX51:
  • * Xilinx Zynq:
  • Add support for Lemote Yeeloong Notebooks.
  • 17 October 2012
  • Support for thread-local storage, Logical Volume Manager functionality
  • Rewritten disk quota subsystem
  • New subsystems to handle flash devices and NAND controllers
  • An experimental CHFS file system designed for flash devices
  • Support for the Multiprotocol Label Switching protocol.
  • Introduce NetBSD Packet Filter – a new packet filter, designed with multi-core systems in mind, which can do TCP/IP traffic filtering, stateful inspection, and Network Address Translation
  • SMP support for Xen domU kernels, initial suspend/resume support for Xen domU, PCI pass-through support for Xen3, and addition of the balloon driver
  • Major rework of MIPS port adding support for Symmetric multiprocessing and 64-bit processors, DSP v2 ASE extension, various NetLogic/RMI processor models, Loongson family processors, and new SoC boards
  • Improved SMP on PowerPC port and added support for Book E Freescale MPC85xx processors
  • ARM has gained support for Cortex-A8 processors, various new SoCs, and initial support for Raspberry Pi
  • To address the year 2038 problem, time t was extended to 64-bit type on all NetBSD ports.
  • apropos rewritten to implement full text search for man pages
  • Access to driver-internal limit values added to sysmon_envsys, freshly utilised by new drivers like aibs
  • 29 April 2009
  • Rewritten threading subsystem based on a and rewritten scheduler implementation.
  • Support for kernel preemption, POSIX real-time scheduling extensions, processor-sets, and dynamic CPU sets for thread affinity
  • Added jemalloc memory allocator. A metadata journaling for FFS, known as WAPBL
  • Rewritten Loadable kernel module framework, which will replace old LKMs. Use of X.Org rather than XFree86 by default for i386 and amd64 ports, and introduction of drm/DRI for 3D hardware acceleration. Preliminary support for using Clang instead of GCC as the system compiler.
  • Added support for ASLR in the kernel and dynamic linker.
  • Rewritten envsys framework ; addition of 8 new Hardware Monitoring sensor drivers; new I²C attachment of the lm driver; additional hardware support in several sensor drivers
  • 19 December 2007
  • Added support for slab allocator, bioctl, iSCSI target, CARP, tmpfs, Explicit Congestion Notification, Xen 3, the Kernel Authorization framework, Veriexec and other security extensions, property list exchange between kernel/userland through ioctl with proplib, and a Bluetooth protocol suite.
  • 23 December 2005
  • Support for Xen 2.0
  • Support for filesystems > 2 terabytes added.
  • Pluggable Authentication Modules added.
  • OpenBSD Packet Filter was integrated as an alternative to IPFilter.
  • UFS directory hash support.
  • 9 December 2004
  • Addition of native POSIX threads and SMP support on i386 and other platforms.
  • AMD64 architecture added.
  • Support for UFS2 and SMBFS, addition of kqueue.
  • 14 September 2002
  • Unified Buffer Cache was introduced, which unifies the filesystem and virtual memory caches of file data.
  • Zero-copy support for TCP and UDP transmit path.
  • Ten new platforms supported.
  • New implementation of cross-building infrastructure.
  • Added support for multibyte LC_CTYPE locales.
  • 6 December 2000
  • IPv6 and IPsec were added to the network stack.
  • OpenSSL and OpenSSH imported.
  • New implementation of rc.d system start-up mechanism.
  • Start of migration to ELF-format binaries.
  • A ktruss utility for kernel tracing was added.
  • Six new platforms supported, including sparc64.
  • Added FFS soft updates and support for NTFS.
  • 12 May 1999
  • UVM, a rewritten virtual memory subsystem, was introduced.
  • Added RAIDframe, a software RAID implementation, and imported IPFilter.
  • Completion of the integration of all remaining 4.4BSD Lite-2 kernel improvements.
  • Ports to Power Macintosh and NeXTcube/station systems added.
  • Added full USB support.
  • 9 March 1998
  • XFree86 source tree was made a supported part of the distribution.
  • Support for ISA Plug and Play, PCMCIA, ATAPI and APM added.
  • ext2fs and FAT32 filesystems added.
  • The pkgsrc packages collection system was introduced.
  • 4 October 1996
  • Support for NFSv3, SCSI scanner and medium changer devices added.
  • NTP phase-locked loop added in kernel.
  • Ports for ARM and Sharp X68k systems added.
  • 26 November 1995
  • Ports for DEC Alpha, Atari TT/Falcon030 and MVME68k systems added.
  • Binary emulation facility added.
  • Generic audio subsystem introduced.
  • 26 October 1994
  • The first multi-platform release, supporting the PC, HP 9000 Series 300, Amiga, 68k Macintosh, Sun-4c series and the PC532.
  • The legally encumbered Net/2-derived source code was replaced with equivalent code from 4.4BSD-lite, in accordance with the USL v BSDi lawsuit settlement.
  • Addition of shared libraries and Kerberos 5.
  • 20 August 1993
  • Contained many enhancements and bug fixes.
  • This was still a PC-platform-only release, although by this time, work was underway to add support for other architectures.
  • Support for loadable kernel modules.
  • 20 April 1993
  • The first official release, derived from 386BSD 0.1 plus the version 0.2.2 unofficial patchkit, with several programs from the Net/2 release missing from 386BSD re-integrated, and various other improvements.
  • Logo

    The NetBSD "flag" logo, designed by Grant Bissett, was introduced in 2004 and is an abstraction of their older logo, designed by Shawn Mueller in 1994. Mueller's version was based on the famous World War II photograph Raising the Flag on Iwo Jima.

    The NetBSD Foundation

    The NetBSD Foundation is the legal entity that owns the intellectual property and trademarks associated with NetBSD, and on 22 January 2004, became a 5013 tax-exempt non-profit organization. The members of the foundation are developers who have CVS commit access. The NetBSD Foundation has a Board of Directors, elected by the voting of members for two years.

    Hosting

    Hosting for the project is provided primarily by Columbia University, and Western Washington University, fronted by a CDN provided by Fastly. Mirrors for the project are spread around the world and provided by volunteers and supporters of the project.