Buildroot: a deep dive into the core (ELCE 2014)

  • Published on
    27-Jun-2015

  • View
    196

  • Download
    1

Embed Size (px)

DESCRIPTION

Buildroot is a widely popular, easy to use and easy to extend embedded Linux build system used by a large number of companies and hobbyists to build small, highly customized Linux systems for embedded devices. Completely vendor neutral, offering more than 1200 packages, it is driven by a vibrant open-source community, with about 100 contributors to each release every three months. In this talk, we'll propose a deep dive into the Buildroot internals through a description of how the core of this build system works. By looking at how toolchains are integrated, how the package infrastructures are working, and how the entire build process is organized, this talk will help Buildroot users and developers understand better what their build system is doing, and how to extend it for their needs.

Transcript

  • 1. Embedded Linux Conference Europe 2014 Buildroot: a deep dive into the core Thomas Petazzoni Free Electrons thomas.petazzoni@free-electrons.com Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 1/42

2. Thomas Petazzoni CTO and Embedded Linux engineer at Free Electrons Embedded Linux and Android development: kernel and driver development, system integration, boot time and power consumption optimization, consulting, etc. Embedded Linux, Linux driver development, Android system and Yocto/OpenEmbedded training courses, with materials freely available under a Creative Commons license. http://free-electrons.com Contributions Kernel support for the Marvell Armada ARM SoCs from Marvell Major contributor to Buildroot, an open-source, simple and fast embedded Linux build system Living in Toulouse, south west of France Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 2/42 3. Agenda 1. Quick introduction about Buildroot 2. Source tree and output tree 3. Conguration system 4. From make to the generic package infrastructure 5. Specialized package infrastructures 6. Toolchain support 7. Root lesystem image generation 8. Overall build logic Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 3/42 4. Buildroot at a glance An embedded Linux build system, builds from source: cross-compilation toolchain root lesystem with many libraries/applications, cross-built kernel and bootloader images Fast, simple root lesystem in minutes Easy to use and understand: kcong and make Small root lesystem, default 2 MB More than 1200 packages available Generates lesystem images, not a distribution Vendor neutral Active community, regular releases Started in 2001, oldest still maintained build system http://buildroot.org Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 4/42 5. Demonstration A demonstration is worth many slides! Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 5/42 6. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ top-level Makefile, handles the conguration and general orchestration of the build Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 7. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ top-level Config.in, main/general options. Includes many other Config.in les Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 8. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ Config.in.* les dening the architecture variants (processor type, ABI, oating point, etc.) Config.in, Config.in.arm, Config.in.x86, Config.in.microblaze, etc. Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 9. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ packages for generating or using toolchains toolchain/ virtual package that depends on either toolchain-buildroot or toolchain-external toolchain-buildroot/ virtual package to build the internal toolchain toolchain-external/ package to handle external toolchains Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 10. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ skeleton/ the rootfs skeleton Config.in, options for system-wide features like init system, /dev handling, etc. Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 11. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ linux.mk, the Linux kernel package Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 12. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ all the userspace packages (1200+) busybox/, gcc/, qt5/, etc. pkg-generic.mk, core package infrastructure pkg-cmake.mk, pkg-autotools.mk, pkg-perl.mk, etc. Specialized package infrastructures Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 13. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ logic to generate lesystem images in various formats common.mk, common logic cpio/, ext2/, squashfs/, tar/, ubifs/, etc. Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 14. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ bootloader packages at91bootstrap3/, barebox/, grub/, syslinux/, uboot/, etc. Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 15. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ default conguration les for various platforms similar to kernel defcongs atmel_xplained_defconfig, beaglebone_defconfig, raspberrypi_defconfig, etc. Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 16. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ board-specic les (kernel conguration les, kernel patches, image ashing scripts, etc.) typically go together with a defcong in configs/ Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 17. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ misc utilities (kcong code, libtool patches, download helpers, and more.) Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 18. Source tree Makefile Config.in arch/ toolchain/ system/ linux/ package/ fs/ boot/ configs/ board/ support/ docs/ Buildroot documentation 90 pages PDF document Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 6/42 19. Output tree output/ build/ host/ staging/ target/ images/ graphs/ legal-info/ Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 20. Output tree output/ build/ host/ staging/ target/ images/ graphs/ legal-info/ Global output directory Can be customized for out-of-tree build by passing O= Variable: O (as passed on the command line) Variable: BASE_DIR (as an absolute path) Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 21. Output tree output/ build/ buildroot-config/ busybox-1.22.1/ host-pkgconf-0.8.9/ kmod-1.18/ build-time.log host/ staging/ target/ images/ graphs/ legal-info/ Where all source tarballs are extracted Where the build of each package takes place In addition to the package sources and object les, stamp les are created by Buildroot Variable: BUILD_DIR Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 22. Output tree output/ build/ host/ usr/lib usr/bin usr/sbin usr//sysroot/bin usr//sysroot/lib usr//sysroot/usr/lib usr//sysroot/usr/bin staging/ target/ images/ graphs/ legal-info/ Contains both the tools built for the host (cross-compiler, etc.) and the sysroot of the toolchain Variable: HOST_DIR Host tools are directly in host/usr The sysroot is in host//sysroot/usr Variable for the sysroot: STAGING_DIR Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 23. Output tree output/ build/ host/ staging/ target/ images/ graphs/ legal-info/ Just a symbolic link to the sysroot, i.e to host//sysroot/. Available for convenience Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 24. Output tree output/ build/ host/ staging/ target/ bin/ etc/ lib/ usr/bin/ usr/lib/ usr/share/ usr/sbin/ THIS_IS_NOT_YOUR_ROOT_ FILESYSTEM ... images/ graphs/ legal-info/ The target root lesystem Usual Linux hierarchy Not completely ready for the target: permissions, device les, etc. Buildroot does not run as root: all les are owned by the user running Buildroot, not setuid, etc. Used to generate the nal root lesystem images in images/ Variable: TARGET_DIR Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 25. Output tree output/ build/ host/ staging/ target/ images/ zImage armada-370-mirabox.dtb rootfs.tar rootfs.ubi graphs/ legal-info/ Contains the nal images: kernel image, bootloader image, root lesystem image(s) Variable: BINARIES_DIR Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 26. Output tree output/ build/ host/ staging/ target/ images/ graphs/ legal-info/ Visualization of Buildroot operation: dependencies between packages, time to build the dierent packages make graph-depends make graph-build Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 27. Output tree output/ build/ host/ staging/ target/ images/ graphs/ legal-info/ manifest.csv host-manifest.csv licenses.txt licenses/ sources/ ... Legal information: license of all packages, and their source code, plus a licensing manifest Useful for license compliance make legal-info Variable: LEGAL_INFO_DIR Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 7/42 28. Conguration system Uses, almost unchanged, the kcong code from the kernel, in support/kconfig (variable CONFIG) kcong tools are built in $(BUILD_DIR)/buildroot-config/ The main Config.in le, passed to menucong/xcong, is at the top-level of the Buildroot source tree Cong le saved as .config in the output directory (except for in-tree builds) .config included in Makefile cong values readily available as make variables. CONFIG_CONFIG_IN = Config.in CONFIG = support/kconfig BR2_CONFIG = $(CONFIG_DIR)/.config -include $(BR2_CONFIG) $(BUILD_DIR)/buildroot-config/%onf: mkdir -p $(@D)/lxdialog $(MAKE) ... -C $(CONFIG) -f Makefile.br $(@F) menuconfig: $(BUILD_DIR)/buildroot-config/mconf outputmakefile @mkdir -p $(BUILD_DIR)/buildroot-config @$(COMMON_CONFIG_ENV) $< $(CONFIG_CONFIG_IN) Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 8/42 29. Conguration hierarchy Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 9/42 30. Example of package Config.in package/httping/Cong.in comment "httping needs a toolchain w/ wchar" depends on !BR2_USE_WCHAR config BR2_PACKAGE_HTTPING bool "httping" depends on BR2_USE_WCHAR select BR2_PACKAGE_GETTEXT if BR2_NEEDS_GETTEXT help Httping is like 'ping' but for http-requests. ... http://www.vanheusden.com/httping/ if BR2_PACKAGE_HTTPING config BR2_PACKAGE_HTTPING_TFO bool "TCP Fast Open (TFO) support" endif All packages have a main option named BR2_PACKAGE_ Sub-options are used for additional tuning of the package depends on to depend on toolchain features or big features (e.g. X.org) select used for most library dependencies, to make them transparent to the user Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 10/42 31. When you run make... Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 11/42 32. Where is $(TARGETS) lled? Part of package/pkg-generic.mk # argument 1 is the lowercase package name # argument 2 is the uppercase package name, including a HOST_ prefix # for host packages define inner-generic-package ... $(2)_KCONFIG_VAR = BR2_PACKAGE_$(2) ... ifeq ($$($$($(2)_KCONFIG_VAR)),y) TARGETS += $(1) endif # $(2)_KCONFIG_VAR endef # inner-generic-package Adds the lowercase name of an enabled package as a make target to the $(TARGETS) variable package/pkg-generic.mk is really the core of the package infrastructure Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 12/42 33. Example of yavta.mk YAVTA_VERSION = 82ff2efdb9787737b9f21b6f4759f077c827b238 YAVTA_SITE = git://git.ideasonboard.org/yavta.git YAVTA_LICENSE = GPLv2+ YAVTA_LICENSE_FILES = COPYING.GPL define YAVTA_BUILD_CMDS $(MAKE) $(TARGET_CONFIGURE_OPTS) -C $(@D) endef define YAVTA_INSTALL_TARGET_CMDS $(INSTALL) -m 0755 -D $(@D)/yavta $(TARGET_DIR)/usr/bin/yavta endef $(eval $(generic-package)) A package is just a denition of variables starting with the package name Some variables are simple values: version, site, license, license les Some variables contain commands: build and installation commands Free Electrons - Embedded Linux, kernel, drivers and Android - Development, consulting, training and support. http://free-electrons.com 13/42 34. Example of zlib.mk (1/2) ZLIB_VERSION = 1.2.8 ZLIB_SOURCE = zlib-$(ZLIB_VERSION).tar.xz ZLIB_SITE = http://downloads.sourceforge.net/project/libpng/zlib/$(ZLIB_VERSION) ZLIB_LICENSE = zlib license ZLIB_LICENSE_FILES = README ZLIB_INSTALL_STAGING = YES ... define ZLIB_CONFIGURE_CMDS (cd $(@D); rm -rf config.cache;$(TARGET_CONFIGURE_ARGS)$(TARGET_CONFIGURE_OPTS)CFLAGS="$(TARGET_CFLAGS) $(ZLIB_PIC)"./configure$(ZLIB_SHARED)--prefix=/usr) endef define ZLIB_BUILD_CMDS $(M...