Files
source-stack/INCLUDED_LIBRARIES.md
T
GuofangandClaude Opus 5.5 aa85a6f77b Build Apache Arrow and Parquet from source in debian13 image
Add pinned xsimd 14.2.0, Apache Thrift v0.22.0 (C++ library only),
Snappy 1.2.2, LZ4 v1.10.0, and Apache Arrow 25.0.1 with Parquet as
static PIC builds. Arrow uses ARROW_DEPENDENCY_SOURCE=SYSTEM so no
dependencies are fetched implicitly, disables the bundled jemalloc and
mimalloc allocators, and enables Parquet encryption via OpenSSL.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01M5XtQocmT1zExJBt4oh3YK
2026-09-24 15:17:12 +08:00

59 lines
2.9 KiB
Markdown

# Included libraries
| Library | Version |
| --- | --- |
| Boost | `1.83.0` |
| OpenSSL | `3.0.15` |
| libevent | `release-2.1.12-stable` |
| Zstd | `1.5.7` |
| zlib | `1.3.1` |
| Protobuf | `v3.21.12` |
| log4cplus | `REL_2_0_5` |
| fmt | `12.2.0` |
| spdlog | `v1.17.0` |
| magic_enum | `v0.9.8` |
| fast_float | `v8.2.10` |
| tsl::sparse_map | `v0.7.0` |
| gflags | `v2.3.1` |
| glog | `v0.7.1` |
| liburing | `2.15` |
| LibAIO | `0.3.113` |
| LibDwarf | `v2.3.2` |
| libsodium | `1.0.20` |
| xxHash | `v0.8.3` |
| googletest | `v1.17.0` |
| numactl | `v2.0.19` |
| Folly | `v2026.08.03.00` |
| Fizz | `v2026.08.03.00` |
| Wangle | `v2026.08.03.00` |
| mvfst | `v2026.08.03.00` |
| fbthrift | `v2026.08.03.00` |
| CacheLib | `v2026.08.03.00` |
| util-linux libuuid | `2.42.2` |
| ZeroMQ | `4.3.5` |
| CZMQ | `4.2.1` |
| JsonCpp | `1.9.8` |
| librdkafka | `2.15.0` |
| json-c | `0.19` |
| RapidJSON | `1.1.0` |
| curl | `8.21.0` |
| hiredis | `1.4.1` |
| GMP | `6.3.0` |
| Nettle | `3.10.2` |
| GnuTLS | `3.8.13` |
| libmaxminddb | `1.13.3` |
| libyaml | `0.2.5` |
| libxml2 | `2.15.3` |
| libproxyprotocol | `v1.3.3` |
| xsimd | `14.2.0` |
| Apache Thrift | `v0.22.0` |
| Snappy | `1.2.2` |
| LZ4 | `v1.10.0` |
| Apache Arrow / Parquet | `25.0.1` |
The image includes position-independent static builds of these libraries. Protobuf and libxml2 enable zlib support, and LibDwarf enables compressed debug section support using zlib and Zstd. ZeroMQ enables CURVE security using static libsodium. CZMQ enables UUID support using static util-linux libuuid while disabling undeclared optional integrations. librdkafka includes SSL, zlib, Zstd, and bundled LZ4 support while disabling undeclared optional integrations. spdlog uses external fmt, glog uses gflags, and all Meta libraries share the same release tag. Apache Arrow is built with Parquet (including OpenSSL-based Parquet encryption) and Snappy, LZ4, zlib, and Zstd compression using only the pinned system dependencies above (`ARROW_DEPENDENCY_SOURCE=SYSTEM`), with the bundled jemalloc and mimalloc allocators disabled. Apache Thrift only builds its C++ library, and its headers sit next to fbthrift's under `include/thrift` without overlapping.
**Pending on rocky9 and alpine3.24:** xsimd, Apache Thrift, Snappy, LZ4, and Apache Arrow / Parquet are currently built only in the `debian13` image.
**Alpine-only exception:** the `alpine3.24` image does not build Folly, Fizz, Wangle, mvfst, fbthrift, or CacheLib. These aren't on Meta's supported-OS list, and Folly's portability layer reaches for glibc-only macros/symbols with no musl branch (e.g. `off64_t`/`lseek64`/`pread64` in `folly/portability/Unistd.h`, `__ELF_NATIVE_CLASS` in `folly/debugging/symbolizer/Elf.cpp`), so patching each one as it surfaces risks introducing subtle bugs in code this project doesn't own. `debian13` and `rocky9` are glibc-based and build the full list above, Meta libraries included.