serenity/Ports
Ali Mohammad Pur 5e1499d104 Everywhere: Rename {Deprecated => Byte}String
This commit un-deprecates DeprecatedString, and repurposes it as a byte
string.
As the null state has already been removed, there are no other
particularly hairy blockers in repurposing this type as a byte string
(what it _really_ is).

This commit is auto-generated:
  $ xs=$(ack -l \bDeprecatedString\b\|deprecated_string AK Userland \
    Meta Ports Ladybird Tests Kernel)
  $ perl -pie 's/\bDeprecatedString\b/ByteString/g;
    s/deprecated_string/byte_string/g' $xs
  $ clang-format --style=file -i \
    $(git diff --name-only | grep \.cpp\|\.h)
  $ gn format $(git ls-files '*.gn' '*.gni')
2023-12-17 18:25:10 +03:30
..
abseil
aclock
acpica-tools
alpine
angband
Another-World
aria2
awk
backward-cpp
bash
bass
bc
bdwgc
binutils
bison
bochs
boost
brogue
brotli
byacc
bzip2
bzip3
c-ares
c-ray
ca-certificates Meta: Update cacert.pem to 2023-12-12 2023-12-14 08:36:25 -07:00
carl
cavestory
cbonsai
ccache
cfunge
chester
chocolate-doom
chromaprint
citron
ClassiCube Ports/ClassiCube: Update ClassiCube to version 1.3.6 2023-10-20 23:24:03 +02:00
cmake
cmatrix
composer Ports/composer: Update to version 2.6.5 2023-11-03 11:57:27 +01:00
coreutils
cowsay
cpio
curl Ports: Update curl to 8.5.0 2023-12-07 00:14:36 +01:00
dash
deutex
devilutionX Ports/devilutionX: Remove SDL2_mixer dependency 2023-10-26 15:53:33 -06:00
dialog
diffutils
dmidecode
doom
dos2unix
dosbox-staging
dosfstools
double-conversion
doxygen
drascula
dreamweb
dropbear Ports/dropbear: Add support for TCP_NODELAY 2023-11-11 15:05:52 +01:00
dtc
dungeonrush
e2fsprogs
ed
edid-decode
editline
emu2
epsilon
expat
ffmpeg
figlet
file
findutils
fio
flac
flare-engine
flare-game
flatbuffers
flex
fontconfig
fotaq
freeciv
freedink
freetype
frotz
gawk
gcc
gdb
gemrb
genemu
genext2fs
gettext
giflib
git
glib Ports: Update glib to 2.78.0 2023-10-15 07:16:04 +02:00
glm
gltron
glu
gmp
gn
gnuapl
gnucobol
gnupg
gnuplot
gperf
grep
grepcidr
griffon
groff
gsl
guile
gzip
halflife
harfbuzz
hatari
hexedit
highway
imagemagick
imgcat Ports: Remove termcap 2023-12-14 16:43:37 +01:00
indent
isl
ja2
jakt Ports: Update Jakt to the latest commit 2023-12-03 14:11:23 +01:00
jdupes
jfduke3d
joe
jot
jq
julius
kakoune
klong
lame
lcms2
less
libarchive
libassuan
libatomic_ops
libenet
libexpat
libffi
libfftw3
libfftw3f
libfts
libgcrypt
libgd
libgpg-error
libiconv
libicu
libjodycode
libjpeg
libjxl
libksba
liblzf
libmad
libmikmod
libmodplug
libmpeg2
libmpg123
libogg
liboggz
libopenal
libopus
libphysfs
libpng
libpuffy
libsamplerate
libsixel
libslirp
libsndfile
libsodium
libssh2
libtheora
libtiff
libtool
libunistring
libuuid
libuv
libvorbis
libwebp
libxml2
libyaml
libzip
links
lite-xl
llvm Ports: Make the LLVM port install its ocaml bindings somewhere else 2023-12-03 14:11:23 +01:00
lowdown
lrzip
lua
luajit
luarocks
lure
lxt
lynx
lz4
lzo
lzop
m4
make
mandoc
mawk
mbedtls Ports/mbedtls: Update mbedtls to version 3.4.1 2023-10-12 23:30:22 +02:00
mc Ports: Update mc to 4.8.30 2023-10-15 07:16:04 +02:00
md4c
mednafen
mgba
milkytracker
mold
mpc Ports/mpc: Update mpc to version 1.3.1 2023-10-12 23:30:22 +02:00
mpfr Ports/mpfr: Update mpfr to version 4.2.1 2023-10-12 23:30:22 +02:00
mrsh
mruby
mysthous
nano
nasm
ncdu
ncurses Ports/ncurses: Update ncurses to version 6.4 2023-10-12 23:30:22 +02:00
neofetch
nesalizer
nethack
ninja Ports/ninja: Update ninja to version 1.11.1 2023-10-12 23:30:22 +02:00
nippon
nlohmann-json
nnn
npiet
npth
ntbtls Ports/ntbtls: Update ntbtls to version 0.3.1 2023-10-12 23:30:22 +02:00
nyancat
ObjFW Ports/ObjFW: Update ObjFW to version 8d19ba9 2023-10-12 23:30:22 +02:00
oksh
OpenJDK Everywhere: Rename {Deprecated => Byte}String 2023-12-17 18:25:10 +03:30
openrct2 Ports/openrct2: Update OpenRCT2 to version 0.4.5 2023-10-12 23:30:22 +02:00
openssh
openssl Ports/openssl: Update openssl to version 3.1.2 2023-10-12 23:30:22 +02:00
openttd
openttd-opengfx
openttd-opensfx
opentyrian
opfor
optipng
opusfile
p7zip
pacman
patch
pcre
pcre2 Ports/pcre2: Update pcre2 to version 10.42 2023-10-12 23:30:22 +02:00
perl5
pfetch
php Ports/php: Enable curl 2023-11-03 15:32:44 +01:00
pixman Ports/pixman: Update pixman to version 0.42.2 2023-10-12 23:30:22 +02:00
pkgconf Ports/pkgconf: Update pkgconf to version 2.0.2 2023-10-12 23:30:22 +02:00
poppler
potrace
powdertoy
prboom-plus
printf
protobuf
pt2-clone Ports/pt2-clone: Update pt2-clone to version 1.63 2023-10-12 23:30:22 +02:00
pv
python3 Ports: Remove termcap 2023-12-14 16:43:37 +01:00
qemu Ports/qemu: Update to 8.1.3 2023-12-14 16:43:37 +01:00
qoi Ports/qoi: Update qoi to version 351450e 2023-10-12 23:30:22 +02:00
qt6-qt5compat
qt6-qtbase
qt6-qtsvg
qt6-serenity
quake
quake2
quake3
r0 Ports/r0: Update r0 to version 0.9 2023-10-12 23:30:22 +02:00
radare2
readline Ports/readline: Update readline to version 8.2 2023-10-12 23:30:22 +02:00
RetroArch
RISCVEmu
rsync Ports/rsync: Update rsync to version 3.2.7 2023-10-12 23:30:22 +02:00
rubberband
ruby
rvvm
sam
scummvm
SDL2
SDL2-GNUBoy
SDL2_gfx
SDL2_image Ports/SDL2_image: Update SDL2_image to version 2.6.3 2023-10-12 23:30:22 +02:00
SDL2_mixer Ports/SDL2_mixer: Update SDL2_mixer to version 2.6.3 2023-10-12 23:30:22 +02:00
SDL2_net
SDL2_sound
SDL2_ttf Ports/SDL2_ttf: Update SDL2_ttf to version 2.20.2 2023-10-12 23:30:22 +02:00
sdl12-compat Ports/sdl12-compat: Update sdl12-compat to version 1.2.64 2023-10-12 23:30:22 +02:00
SDL_mixer
SDL_sound
SDLPoP
sed
serenity-theming
serious-sam-classic
sfinx
sl
soltys
sparsehash
speexdsp
sqlite Ports/sqlite: Update sqlite to version 3430000 2023-10-12 23:30:22 +02:00
ssmtp
stb
stockfish
stpuzzles
stress-ng Ports/stress-ng: Update stress-ng to version 0.16.04 2023-10-12 23:30:22 +02:00
Super-Mario
SuperTuxKart
tar
taskwarrior
tcl
thesilversearcher
tig Ports/tig: Update tig to version 2.5.8 2023-10-12 23:30:22 +02:00
timidity
tinycc
tinyscheme
tr
tree
tuxracer
vim
vitetris
vlang
vttest Ports/vttest: Update vttest to version 20230201 2023-10-12 23:30:22 +02:00
VVVVVV
wayland
wget Ports/wget: Update wget to version 1.21.4 2023-10-12 23:30:22 +02:00
which
wireguard-tools
x264 Ports/x264: Update x264 to version a8b68eb 2023-10-12 23:30:22 +02:00
x265
xash3d-fwgs
xorriso
xz Ports/xz: Update xz to version 5.4.4 2023-10-12 23:30:22 +02:00
yasm
zig
zlib
zsh
zstd Ports/zstd: Update zstd to version 1.5.5 2023-10-12 23:30:22 +02:00
.gitignore
.hosted_defs.sh
.port_include.sh
.strip_env.sh
AvailablePorts.md Ports/qemu: Update to 8.1.3 2023-12-14 16:43:37 +01:00
build_all.sh
build_installed.sh
README.md

Ports for SerenityOS

What's this?

Serenity has software patched to run on it. These shell scripts will allow you to build that sort of software, easily. Note that you must have already built Serenity, and be in a Serenity build environment.

Available ports

A list of all available ports can be found here.

External ports

Third party ports might need additional dependencies from another location. In this case, you can point the SERENITY_PORT_DIRS variable to a local ports directory.

For example:

export SERENITY_PORT_DIRS="/path/to/port/dir/:/other/path/"

Using ports scripts

Each port has a script called package.sh which defines a name and version, its dependencies, the required files that will be downloaded as well as configuration/compilation options, and some other things (see Writing ports scripts for details).

  • To install a certain port, cd into its directory and run ./package.sh
  • To install all available ports, run the build_all.sh script in this directory. Pass clean as first argument to remove old build files beforehand.
  • To reinstall all currently installed ports, run the build_installed.sh script in this directory. This is sometimes required when LibC changes, for example. Pass clean as first argument to remove old build files beforehand.

Installed ports are being tracked in Build/x86_64/Root/usr/Ports/installed.db (a simple text file). You can delete this file at any time, in fact it must be edited or removed when clearing the build directory as port dependencies may not be installed again otherwise.

Not giving an option is equivalent to installdepends, fetch, patch, configure, build and install, in that order. This is recommended for a regular install.

Options

The following options are available:

fetch

By default, download, verify, and extract the port's files.

patch

Apply the port's patches (patches/*.patch). A file .foo_applied is created in workdir upon success to ensure a certain patch is only applied once.

configure

By default, run the port's configscript (usually configure) with configopts.

build

By default, run make with the port's makeopts.

install

By default, run make install with the port's installopts.

shell

Open a shell in the $workdir with the build environment set.

installdepends

Install all ports from the port's depends list.

clean

By default, remove all .out files from the port's workdir.

clean_dist

By default, remove everything that's been downloaded from the port's files list.

clean_all

By default, clean and clean_dist combined.

uninstall

Remove the port's files from the Serenity build directory, if it has a plist file.

dev

Start a development session with guided patch importing. This mode has a bunch of nice features:

  • Drops the user in a git repository backed by another (local) git repository that acts as the "clean", patched version of the port that is ready to be built
  • The "remote" repository can be pushed to, pulled from and generally anything that you'd want to do with a remote repo.
  • After leaving the dev shell, all patches are updated and the user will be prompted whether they wish to generate a new patch readme file.

This mode takes an extra --no-depends option, that if given, will cause the dependency fetch and build steps to be skipped.

This mode can also assist in migrating old patches to new versions through a guided semi-automated process.

--auto

Same as no option, but mark the port as having been installed automatically. This is used for dependencies.

Writing ports scripts

The package.sh file is a simple Bash script that's required for each port. Patches and other files are optional. The most basic version of such a port script simply defines some well-known variables and looks like this:

#!/usr/bin/env -S bash ../.port_include.sh
port='foo'
version='1.2.3'
useconfigure='true'
files=(
    "https://example.com/foo-${version}.tar.gz#9acd50f9a2af37e471f761c3fe7b8dea5617e51dac802fe6c177b74abf0abb5a"
)
depends=(
    'bar'
    'baz'
)

The script in the shebang, .port_include.sh, is where all the magic happens.

Variables

The following variables have special functionality:

configopts

Options passed to the port's configscript in the default configure function.

--host=x86_64-pc-serenity is always passed, override the configure function if that's undesirable.

use_fresh_config_sub

Boolean option (false by default), will replace the config.sub pointed to by config_sub_path as part of the patching process if set to true.

config_sub_paths

Paths to the config.sub files used by autoconf, starting at $workdir. This is set to (config.sub) by default.

configscript

Name of the script that will be run in the default configure function when useconfigure is true.

Defaults to configure.

depends

An array of other SerenityOS ports the port depends on and which will be installed during the installdepends step.

For example:

depends=(
    'gettext'
    'ncurses'
)

files

An array of external files required by the port, one per line.

Simple downloads

The format of each entry is as follows:

URL#HASH

Where URL is the URL from where the file will be downloaded (using curl) and HASH is the SHA256 hash that will be used for verification.

For example:

files=(
    "https://example.com/foo-${version}.tar.xz#9acd50f9a2af37e471f761c3fe7b8dea5617e51dac802fe6c177b74abf0abb5a"
)

If a file is a compressed tar archive, a gzip compressed file or a zip compressed file, it will be extracted.

Git repositories

The format of each entry is as follows:

git+URL#REVISION

Where URL is the URL where the repository is located and REVISION can be any revision qualifier that is accepted by git fetch.

For example:

files=(
    'git+https://gn.googlesource.com/gn#fae280eabe5d31accc53100137459ece19a7a295'
)

icon_file

The file to use for the port launcher icon. The icon file is assumed to have a 16x16 as well as a 32x32 layer.

installopts

Options passed to make install in the default install function.

DESTDIR="${SERENITY_INSTALL_ROOT}" ("${SERENITY_SOURCE_DIR}/Build/${SERENITY_ARCH}/Root") is always passed, override the install function if that's undesirable.

makeopts

Options passed to make in the default build function.

Defaults to -j$(nproc).

patchlevel

The value for patch's -p / --strip option, see man patch for details.

Defaults to 1.

port

The "package name" of the port, usually the same as the directory this script is placed in.

prefix

The location of the ports directory, only used for the package.db file for now. Don't override this in ports contributed to Serenity.

Defaults to $SERENITY_SOURCE_DIR/Ports.

useconfigure

The configure step will run pre_configure and configure when this is set to true, and simply skip them otherwise.

Defaults to false.

version

The version of the port. Written to package.db, and usually used with variable interpolation in files where the version is part of the filename.

workdir

The working directory used for executing other commands via run as well as cleanup. Usually the directory name of the unpacked source archive.

Defaults to $port-$version.

Functions

The various steps of the port installation process are split into individual Bash functions, some of which can be overridden to provide custom behavior, like this:

build() {
    run mybuildtool --foo --bar
}

The following can be overridden, the names should be self-explanatory as they mostly match the available options:

  • pre_fetch
  • post_fetch
  • pre_patch
  • pre_configure
  • configure
  • post_configure
  • build
  • pre_install
  • install
  • post_install
  • clean
  • clean_dist
  • clean_all

A few (non-overridable) util functions are available as well:

run

Log the command and run it in the port's workdir.

run_nocd

Log the command and run it in the current working directory (i.e. Ports/$port).

run_replace_in_file

Replace something in a file (using a Perl regular expression), like this:

run_replace_in_file "s/define FOO 1/undef FOO/" config.h

How do I contribute?

You can either:

  • Add new ports - just get the software to build and add the necessary patches and package.sh script
  • Update an existing port: bumping its version, getting functionality to work that wasn't available so far etc. Make sure to update the patches accordingly.

Some videos of Andreas adding new ports can be found on YouTube, they might help you understand how this usually works: