serenity/Ports
Daniel Bertalan e88ca09609 Ports: Upgrade LLVM to version 13.0.0
With this update, we now use our custom `serenity` Clang target, which
means that all system-specific compilation options (e.g. default PIE,
header search paths) will be handled automatically.

This port has been tested to build `Source/little` on all 4
toolchain-architecture pairs. Furthermore, `lib(std)c++` headers are
picked up correctly and our AK headers can be included without any
issues.

Due to recent kernel fixes related to memory-mapped files, the LLD
linker can now be used by default, so there's no need to also build the
GCC port alongside this.

Although our patches cover building libLLVM as a shared library, this is
currently not enabled by default, as DynamicLoader is very slow in
dealing with such a large number of relocations.
2021-11-28 09:38:57 -08:00
..
angband Ports: Enable SDL support in Angband 2021-11-01 11:34:25 +01:00
Another-World
bash
bass
bc
binutils
bison
brogue
byacc Ports: Update byacc to 20210808 2021-11-06 20:49:47 -07:00
bzip2
c-ray
carl
chester
cmake Ports: Remove the obsolete howto guide from cmake 2021-11-06 18:07:15 +03:30
cmatrix Ports/cmatrix: Fix hash and update version 2021-11-06 00:42:02 -07:00
composer
curl
dash
dialog
diffutils
dmidecode
doom
dosbox-staging
drascula
dreamweb
dropbear
dungeonrush
ed
emu2
epsilon
ffmpeg Ports: Fix typo in ffmpeg dependencies 2021-11-01 10:45:15 +01:00
figlet
flatbuffers
flex
fontconfig
fotaq
freeciv
freedink Ports: Add FreeDink port 2021-10-31 11:52:27 +01:00
freetype
frotz
gawk
gcc
genemu
gettext
git
glib Ports: Add a dependency on pcre to glib 2021-11-06 01:16:14 -07:00
glm
gmp
gnucobol Ports: gnucobol: Build with ncurses and without NLS 2021-11-01 10:44:57 +01:00
gnupg
gnuplot
gperf
grep
griffon
gsl
harfbuzz
hatari
imgcat
indent
jot
jq
klong
less
libarchive
libassuan
libatomic_ops
libexpat
libffi
libgcrypt
libgpg-error
libiconv
libicu
libjpeg
libksba
libmodplug
libogg
libopenal
libphysfs
libpng
libpuffy
libsixel
libsodium Ports: Use immutable tarballs for libsodium 2021-11-03 11:10:38 +01:00
libtheora Ports/libtheora: Change download link to mirror with TLS1.2 support 2021-11-04 17:14:33 +01:00
libtiff
libtool
libuuid
libuv Ports/libuv: Update libuv to version 1.42.0 and fix cmake argument 2021-11-14 16:20:55 +00:00
libvorbis
libxml2
libzip
links
llvm Ports: Upgrade LLVM to version 13.0.0 2021-11-28 09:38:57 -08:00
lua
lure
m4
make
mandoc
mawk
mbedtls
milkytracker
mpc
mpfr
mrsh
mruby
mysthous
nano
nasm
ncdu
ncurses Ports: Update to ncurses 6.3 2021-11-06 20:49:18 -07:00
neofetch
nesalizer
nethack
ninja
nippon
npth
ntbtls
nyancat
oksh Ports: Unbreak and update oksh 2021-11-08 01:36:54 +01:00
openssh
openssl
openttd
openttd-opengfx
openttd-opensfx
opentyrian
opentyrian-data
p7zip
patch Ports: Use GNU patch instead of the OpenBSD version 2021-11-10 14:48:39 +01:00
pcre Ports: Update pcre to 8.45 2021-11-06 12:40:19 +02:00
pcre2 Ports: Update pcre2 to 10.39 2021-11-06 00:32:36 -07:00
php
pkgconf
printf
pt2-clone
pv Ports: Add initial Pipe Viewer (pv) 1.6.20 port 2021-11-14 16:18:45 +00:00
python3
quake Ports: quake: Do no set PATH environment variable in package.sh 2021-11-02 23:04:22 +01:00
quake2
r0
radare2
readline
rsync
ruby
sam
scummvm Ports: Remove ScummVM's SVG patch 2021-11-18 21:10:30 +01:00
SDL2
SDL2-GNUBoy
SDL2_gfx
SDL2_image
SDL2_mixer
SDL2_net
SDL2_ttf
SDL_sound
SDLPoP
sed
sfinx
sl
soltys
sqlite
stpuzzles
stress-ng
Super-Mario
tcl
termcap
tinycc
tinyscheme
tr
vim Ports/vim: Add symlink 'vi' pointing to target 'vim' 2021-10-31 21:09:49 +01:00
vitetris
vlang
vttest
wget
xz
yasm
zlib Ports: Fix building zlib with Clang 2021-11-14 11:38:40 +00:00
zsh
zstd Ports: Patch Makefile to use normal soname flags on Mac 2021-11-03 11:22:50 +01:00
.gitignore
.hosted_defs.sh
.port_include.sh
AvailablePorts.md Ports: Upgrade LLVM to version 13.0.0 2021-11-28 09:38:57 -08:00
build_all.sh Ports: Don't add ports to the "built" list unless successful 2021-11-06 11:54:00 +01:00
build_installed.sh
README.md

Ports for SerenityOS

What's this?

Serenity has software patched to run on it. These shell scripts will allow you to build that sort of software, easily. Note that you must have already built Serenity, and be in a Serenity build environment.

Available ports

A list of all available ports can be found here.

Using ports scripts

Each port has a script called package.sh which defines a name and version, its dependencies, the required files that will be downloaded as well as configuration/compilation options, and some other things (see Writing ports scripts for details).

  • To install a certain port, cd into its directory and run ./package.sh
  • To install all available ports, run the build_all.sh script in this directory. Pass clean as first argument to remove old build files beforehand.
  • To reinstall all currently installed ports, run the build_installed.sh script in this directory. This is sometimes required when LibC changes, for example. Pass clean as first argument to remove old build files beforehand.

Installed ports are being tracked in Build/i686/Root/usr/Ports/packages.db (a simple text file). You can delete this file at any time, in fact it must be edited or removed when clearing the build directory as port dependencies may not be installed again otherwise.

Not giving an option is equivalent to installdepends, fetch, patch, configure, build and install, in that order. This is recommended for a regular install.

Options

The following options are available:

fetch

By default, download, verify, and extract the port's files.

patch

Apply the port's patches (patches/*.patch). A file .foo_applied is created in workdir upon success to ensure a certain patch is only applied once.

configure

By default, run the port's configscript (usually configure) with configopts.

build

By default, run make with the port's makeopts.

install

By default, run make install with the port's installopts.

shell

Open a shell in the $workdir with the build environment set.

installdepends

Install all ports from the port's depends list.

clean

By default, remove all .out files from the port's workdir.

clean_dist

By default, remove everything that's been downloaded from the port's files list.

clean_all

By default, clean and clean_dist combined.

uninstall

Remove the port's files from the Serenity build directory, if it has a plist file.

--auto

Same as no option, but mark the port as having been installed automatically. This is used for dependencies.

Writing ports scripts

The package.sh file is a simple Bash script that's required for each port. Patches and other files are optional. The most basic version of such a port script simply defines some well-known variables and looks like this:

#!/usr/bin/env -S bash ../.port_include.sh

port="foo"
version="1.2.3"
useconfigure="true"
files="https://example.com/foo-${version}.tar.gz foo-${version}.tar.gz"
depends="bar baz"

The script in the shebang, .port_include.sh, is where all the magic happens.

Variables

The following variables have special functionality:

auth_import_key

PGP key to import (from keyserver.ubuntu.com) when auth_type is sig.

auth_opts

Options passed to gpg --verify when auth_type is sig.

Usually used like this:

auth_opts="foo-${version}.tar.xz.asc foo-${version}.tar.xz"

auth_type

The type of file validation to use, can be one of:

  • md5: Use MD5 hashes defined in files
  • sha256: Use SHA256 hashes defined in files
  • sha1: Use SHA1 hashes defined in files
  • sig: Use PGP signatures (see auth_opts)

Defaults to md5, most ports use sig though as .asc files are widely available.

configopts

Options passed to the port's configscript in the default configure function.

--host=i686-pc-serenity is always passed, override the configure function if that's undesirable.

configscript

Name of the script that will be run in the default configure function when useconfigure is true.

Defaults to configure.

depends

A space-separated list of other SerenityOS ports the port depends on and which will be installed during the installdepends step.

files

A list of external files required by the port, one per line. The format of each line is as follows:

URL NAME HASH

Where URL is the URL from where the file will be downloaded (using curl), NAME is the output name of the downloaded file, and HASH is an optional MD5, SHA1, or SHA256 hash that will be used for verification when auth_type is set to either of those hash functions.

For example:

files="https://example.com/foo-${version}.tar.xz foo-${version}.tar.xz
https://example.com/foo-${version}.tar.xz.asc foo-${version}.tar.xz.asc"

If a file is a compressed tar archive, a gzip compressed file or a zip compressed file, it will be extracted.

If a file is an .asc file (PGP signature) it will be imported into gpg's keyring and can later be used for verification using auth_opts.

icon_file

The file to use for the port launcher icon. The icon file is assumed to have a 16x16 as well as a 32x32 layer.

installopts

Options passed to make install in the default install function.

DESTDIR="${SERENITY_INSTALL_ROOT}" ("${SERENITY_SOURCE_DIR}/Build/${SERENITY_ARCH}/Root") is always passed, override the install function if that's undesirable.

makeopts

Options passed to make in the default build function.

Defaults to -j$(nproc).

patchlevel

The value for patch's -p / --strip option, see man patch for details.

Defaults to 1.

port

The "package name" of the port, usually the same as the directory this script is placed in.

prefix

The location of the ports directory, only used for the package.db file for now. Don't override this in ports contributed to Serenity.

Defaults to $SERENITY_SOURCE_DIR/Ports.

useconfigure

The configure step will run pre_configure and configure when this is set to true, and simply skip them otherwise.

Defaults to false.

version

The version of the port. Written to package.db, and usually used with variable interpolation in files where the version is part of the filename.

workdir

The working directory used for executing other commands via run as well as cleanup. Usually the directory name of the upacked source archive.

Defaults to $port-$version.

Functions

The various steps of the port installation process are split into individual Bash functions, some of which can be overridden to provide custom behaviour, like this:

build() {
    run mybuildtool --foo --bar
}

The following can be overridden, the names should be self-explanatory as they mostly match the available options:

  • pre_fetch
  • post_fetch
  • pre_configure
  • configure.
  • build
  • install
  • post_install
  • clean
  • clean_dist
  • clean_all

A few (non-overridable) util functions are available as well:

run

Log the command and run it in the port's workdir.

run_nocd

Log the command and run it in the current working directory (i.e. Ports/$port).

run_replace_in_file

Replace something in a file (using a Perl regular expression), like this:

run_replace_in_file "s/define FOO 1/undef FOO/" config.h

How do I contribute?

You can either:

  • Add new ports - just get the software to build and add the necessary patches and package.sh script
  • Update an existing port: bumping its version, getting functionality to work that wasn't available so far etc. Make sure to update the patches accordingly.

Some videos of Andreas adding new ports can be found on YouTube, they might help you understand how this usually works: