chiark / gitweb /
Add nethack stub to disabled-packages
[termux-packages] / README.md
CommitLineData
4edf9992
FF
1Termux packages
2===============
006983b2 3[![Join the chat at https://gitter.im/termux/termux](https://badges.gitter.im/termux/termux.svg)](https://gitter.im/termux/termux)
5b9b57e3 4
798619b9
FF
5This project contains scripts and patches to cross compile and package packages for
6the [Termux](http://termux.com/) Android application.
7
a7dfa85f
FF
8The scripts and patches to build each package is licensed under the same license as
9the actual package (so the patches and scripts to build bash are licensed under
10the same license as bash, while the patches and scripts to build python are licensed
11under the same license as python, etc).
12
6dab2062 13NOTE: This is in a rough state - be prepared for some work and frustrations, and give
1773070c
FF
14feedback if you find incorrect our outdated things!
15
16Initial setup
17=============
3c323c69
FF
18Packages are normally built using Ubuntu 16.04. Most packages should build also under
19other Linux distributions (or even on OS X), but those environments will need manual setup
20adapted from the below setup for Ubuntu:
1773070c 21
3c323c69 22* Run `scripts/ubuntu-setup.sh` to install required packages and setup the `/data/` folder (see below).
1773070c
FF
23
24* Install the Android SDK at `$HOME/lib/android-sdk`. Override this by setting the environment
25variable `$ANDROID_HOME` to point at another location.
26
c30d3822 27* Install the Android NDK, version r11, at `$HOME/lib/android-ndk`. Override this by setting
1773070c
FF
28the environment variable `$NDK` to point at another location.
29
3c323c69
FF
30Alternatively a Dockerfile is provided which sets up a pristine image suitable for building
31packages. To build the docker image, run the following command:
5e8045c9 32
3c323c69 33 docker build -t termux .
5e8045c9 34
3c323c69 35After build is successful, you can open an interactive prompt inside the container using:
5e8045c9 36
3c323c69 37 docker run -ti termux bash
798619b9 38
9ecaa95d
FF
39Building a package
40==================
798619b9
FF
41In a non-rooted Android device an app such as Termux may not write to system locations,
42which is why every package is installed inside the private file area of the Termux app:
3b8f4313
FF
43
44 PREFIX=/data/data/com.termux/files/usr
798619b9 45
3c323c69
FF
46For simplicity while developing and building, the build scripts here uses a /data
47folder that is reserved for use on the host builder and install everything there.
798619b9 48
3c323c69
FF
49The basic flow is then to run `./build-package.sh $PKG`, which:
50* Sets up a patched stand-alone Android NDK toolchain if necessary.
9ecaa95d
FF
51
52* Reads packages/$PKG/build.sh to find out where to find the source code of the package and how to build it.
53
3c323c69 54* Applies all patches in packages/$PKG/\*.patch.
9ecaa95d 55
3c323c69 56* Builds the package and installs it to `$PREFIX`.
9ecaa95d 57
3c323c69 58* Creates a dpkg package file for distribution in `$HOME/termux/_deb`.
1773070c 59
798619b9
FF
60Reading and following build-package.sh is the best way to understand what's going on here.
61
9ecaa95d
FF
62
63Additional utilities
64====================
65* build-all.sh: used for building all packages in the correct order (using buildorder.py)
66
67* check-pie.sh: Used for verifying that all binaries are using PIE, which is required for Android 5+
68
69* detect-hardlinks.sh: Used for finding if any packages uses hardlinks, which does not work on Android M
70
71* check-versions.sh: used for checking for package updates
72
73* clean-rebuild-all.sh: used for doing a clean rebuild of all packages (takes a couple of hours)
74
75* list-packages.sh: used for listing all packages with a one-line summary
798619b9
FF
76
77
78Resources about cross-compiling packages
79========================================
80* [Linux From Scratch](http://www.linuxfromscratch.org/blfs/view/svn/index.html)
81
82* [Beyond Linux From Scratch](http://www.linuxfromscratch.org/blfs/view/svn/)
83
84* [Cross-Compiled Linux From Scratch](http://cross-lfs.org/view/svn/x86_64-64/)
85
86* [OpenWrt](https://openwrt.org/), an embedded Linx distribution, contains [patches and build scripts](https://dev.openwrt.org/browser/packages)
87
88* http://dan.drown.org/android contains [patches for cross-compiling to Android](http://dan.drown.org/android/src/) as well as [work notes](http://dan.drown.org/android/worknotes.html), including a modified dynamic linker to avoid messing with LD_LIBRARY_PATH.
89
90* [CCTools](http://cctools.info/index.php?title=Main_Page) is an Android native IDE containing [patches for several programs](https://code.google.com/p/cctools/source/browse/#svn%2Ftrunk%2Fcctools-repo%2Fpatches) and [a bug tracker](https://code.google.com/p/cctools/issues/list).
91
92* [BotBrew](http://botbrew.com/) was a package manager for rooted devices with [sources on github](https://github.com/jyio/botbrew). Based on opkg and was transitioning to apt.
93
94* [Kivy recipes](https://github.com/kivy/python-for-android/tree/master/recipes) contains recipes for building packages for Android.
95
96
97Common porting problems
98=======================
99* The Android bionic libc does not have iconv and gettext/libintl functionality built in. A package from the NDK, libandroid-support,
100contains these and may be used by all packages.
101
102* "error: z: no archive symbol table (run ranlib)" usually means that the build machines libz is used instead of the one for cross compilation, due to the builder library -L path being setup incorrectly
103
104* rindex(3) is defined in <strings.h> but does not exist in NDK, but strrchr(3) from <string.h> is preferred anyway
105
106* <sys/termios.h> does not exist, but <termios.h> is the standard location.
107
108* <sys/fcntl.h> does not exist, but <fcntl.h> is the standard location.
109
3b8f4313 110* glob(3) system function (glob.h) - not in bionic, but use the `libandroid-glob` package
798619b9 111
798619b9
FF
112* cmake and cross compiling: http://www.cmake.org/Wiki/CMake_Cross_Compiling
113 CMAKE_FIND_ROOT_PATH=$TERMUX_PREFIX to search there.
114 CMAKE_FIND_ROOT_PATH_MODE_LIBRARY=ONLY and
115 CMAKE_FIND_ROOT_PATH_MODE_INCLUDE=ONLY
116 for only searching there and don't fall back to build machines
117
118* Android is removing sys/timeb.h because it was removed in POSIX 2008, but ftime(3) can be replaced with gettimeofday(2)
119
120* mempcpy(3) is a GNU extension. We have added it to <string.h> provided TERMUX_EXPOSE_MEMPCPY is defined,
121 so use something like CFLAGS+=" -DTERMUX_EXPOSE_MEMPCPY=1" for packages expecting that function to exist.
122
123
124dlopen() and RTLD_* flags
125=================================
29db5b35 126<dlfcn.h> originally declares
798619b9 127
9ecaa95d
FF
128 enum { RTLD_NOW=0, RTLD_LAZY=1, RTLD_LOCAL=0, RTLD_GLOBAL=2, RTLD_NOLOAD=4}; // 32-bit
129 enum { RTLD_NOW=2, RTLD_LAZY=1, RTLD_LOCAL=0, RTLD_GLOBAL=0x00100, RTLD_NOLOAD=4}; // 64-bit
798619b9
FF
130
131These differs from glibc ones in that
132
29db5b35
FF
1331. They are not preprocessor #define:s so cannot be checked for with `#ifdef RTLD_GLOBAL`. Termux patches this to
134 #define values for compatibility with several packages.
798619b9 1352. They differ in value from glibc ones, so cannot be hardcoded in files (DLFCN.py in python does this)
29db5b35 1363. They are missing some values (`RTLD_BINDING_MASK`, `RTLD_NOLOAD`, ...)
798619b9
FF
137
138
139RPATH, LD_LIBRARY_PATH AND RUNPATH
140==================================
141On desktop linux the linker searches for shared libraries in:
1ddf1728 142
798619b9
FF
1431. RPATH - a list of directories which is linked into the executable, supported on most UNIX systems. It is ignored if RUNPATH is present.
1442. LD_LIBRARY_PATH - an environment variable which holds a list of directories
1ddf1728
FF
1453. RUNPATH - same as RPATH, but searched after LD_LIBRARY_PATH, supported only on most recent UNIX systems
146
147The Android linker (/system/bin/linker) does not support RPATH or RUNPATH, so we set LD_LIBRARY_PATH=$USR/lib and try to avoid building useless rpath entries with --disable-rpath configure flags. Another option to avoid depending on LD_LIBRARY_PATH would be supplying a custom linker - this is not done due to the overhead of maintaining a custom linker.
798619b9
FF
148
149
150Warnings about unused DT entries
151================================
152Starting from 5.1 the Android linker warns about VERNEED (0x6FFFFFFE) and VERNEEDNUM (0x6FFFFFFF) ELF dynamic sections:
9ecaa95d
FF
153
154 WARNING: linker: $BINARY: unused DT entry: type 0x6ffffffe arg ...
155 WARNING: linker: $BINARY: unused DT entry: type 0x6fffffff arg ...
798619b9 156These may come from version scripts in a Makefile such as:
9ecaa95d
FF
157
158 -Wl,--version-script=$(top_srcdir)/proc/libprocps.sym
798619b9 159The termux-elf-cleaner utilty is run from build-package.sh and should normally take care of that problem.