Commit graph

6211 commits

Author SHA1 Message Date
Graham Christensen c2b898da76 treewide: drop -l$NIX_BUILD_CORES
Passing `-l$NIX_BUILD_CORES` improperly limits the overall system load.

For a build machine which is configured to run `$B` builds where each
build gets `total cores / B` cores (`$C`), passing `-l $C` to make will
improperly limit the load to `$C` instead of `$B * $C`.

This effect becomes quite pronounced on machines with 80 cores, with
40 simultaneous builds and a cores limit of 2. On a machine with this
configuration, Nix will run 40 builds and make will limit the overall
system load to approximately 2. A build machine with this many cores
can happily run with a load approaching 80.

A non-solution is to oversubscribe the machine, by picking a larger
`$C`. However, there is no way to divide the number of cores in a way
which fairly subdivides the available cores when `$B` is greater than
1.

There has been exploration of passing a jobserver in to the sandbox,
or sharing a jobserver between all the builds. This is one option, but
relatively complicated and only supports make. Lots of other software
uses its own implementation of `-j` and doesn't support either `-l` or
the Make jobserver.

For the case of an interactive user machine, the user should limit
overall system load using `$B`, `$C`, and optionally systemd's
cpu/network/io limiting features.

Making this change should significantly improve the utilization of our
build farm, and improve the throughput of Hydra.
2022-09-22 16:01:23 -04:00
github-actions[bot] 2773f22a43
Merge staging-next into staging 2022-09-21 18:02:00 +00:00
Sandro fe374a142a
Merge pull request #191779 from trofi/SDL2_mixer-add-dev 2022-09-21 11:18:29 +02:00
Sergei Trofimovich 5f257ad2b2
Merge pull request #191782 from trofi/opusfile-add-dev
opusfile: add "dev" output
2022-09-21 09:13:21 +01:00
Sergei Trofimovich 83b01dd4ec SDL2_mixer: add "dev" output
`SDL2_mixer` is a a popular game dependency. Split it's `dev` output to
separate store path to reduce runtime closure size.

While at it amend a few games's include paths.
2022-09-21 07:36:32 +01:00
github-actions[bot] 31b235f73b
Merge master into haskell-updates 2022-09-21 00:18:17 +00:00
maralorn e678b769bc hedgewars: disable on darwin 2022-09-21 00:48:00 +02:00
Jonas Heinrich 5af7a11791
Merge pull request #191516 from r-ryantm/auto-update/hyperrogue
hyperrogue: 12.0u -> 12.1a
2022-09-20 14:02:07 +02:00
Sandro d7026008c4
Merge pull request #191810 from trofi/freedroifrpg-leaner-closure 2022-09-20 12:07:54 +02:00
Sergei Trofimovich 02ba9a3d60 freedroidrpg: remove build-time flags embedding into binary
Noticed extra -dev dependencies in the runtime closure.

Before the change:

    $ nix path-info -rsSh $(nix-build -A freedroidrpg) | nl | tail -n1 | unnix
    158  /<<NIX>>/freedroidrpg-0.16.1 228.2M  808.1M

After the change:

    $ nix path-info -rsSh $(nix-build -A freedroidrpg) | nl | tail -n1 | unnix
    141  /<<NIX>>/freedroidrpg-0.16.1 228.2M  450.7M
2022-09-19 18:02:42 +01:00
Jonas Heinrich 097c771cc3
Merge pull request #191527 from r-ryantm/auto-update/pokete
pokete: 0.8.2 -> 0.9.0
2022-09-19 15:19:36 +02:00
Christian Kögler 56d93547f0
Merge pull request #189833 from atemp/emp_ddnet_16.3
ddnet: 16.3.1 -> 16.3.2
2022-09-18 16:23:03 +02:00
Christian Kögler 3682990157
Merge pull request #190042 from jtrees/add-everspace-desktop-file
everspace: add desktop file
2022-09-18 15:56:43 +02:00
R. Ryantm 0502d6ef51 hyperrogue: 12.0u -> 12.1a 2022-09-18 12:32:24 +00:00
Bobby Rong 0ca02e3f3b
Merge pull request #191096 from raphaelr/cataclysm-dda-fix-build
cataclysm-dda: fix build
2022-09-18 19:58:16 +08:00
Sergei Trofimovich 40368cccd2 opusfile: add "dev" output
`opusfile` is a a popular game dependency via `SDL2_mixer`. Split it's
`dev` output to separate store path to reduce runtime closure size.

While at it amend games's include paths.
2022-09-18 12:02:24 +01:00
Christian Kögler e5e4c3cb0a
Merge pull request #191600 from peterhoeg/u/sdl_compat
SDL_compat: 1.2.52 -> 1.2.56
2022-09-18 11:45:35 +02:00
R. Ryantm 3fda0f64a9 legendary-gl: 0.20.28 -> 0.20.29 2022-09-17 17:21:30 +08:00
Peter Hoeg 2472a4484e openxcom: fix missing dependency 2022-09-17 11:20:55 +08:00
Sergei Trofimovich bd1afa8a6d
Merge pull request #189729 from azahi/vcmi
vcmi: init at 1.0.0
2022-09-16 21:38:36 +01:00
R. Ryantm 76ffba2883 pokete: 0.8.2 -> 0.9.0 2022-09-16 16:42:39 +00:00
Azat Bahawi 02646c661e
vcmi: init at 1.0.0 2022-09-15 22:08:34 +03:00
Raphael Robatsch 69c8907545 cataclysm-dda: fix build 2022-09-13 19:55:22 +02:00
Franz Pletz 474faf3a39
Merge pull request #190983 from McSinyx/hedgewars-rolling 2022-09-13 18:24:06 +02:00
Jonas Heinrich 967417d810
Merge pull request #190937 from r-ryantm/auto-update/fheroes2
fheroes2: 0.9.18 -> 0.9.19
2022-09-13 09:25:23 +02:00
Johannes Maier 9c1bc56fdd angband: add kenran to maintainers 2022-09-13 08:49:21 +02:00
Nguyễn Gia Phong 0db05edd09
hedgewars: 1.0.0 -> 1.0.2 2022-09-13 13:32:22 +09:00
Heinz Deinhart f906897d4b
ddnet: 16.3.1 -> 16.3.2 2022-09-12 23:22:05 +02:00
R. Ryantm 1688921199 fheroes2: 0.9.18 -> 0.9.19 2022-09-12 14:36:12 +00:00
Vladimír Čunát b1d87c0318
Merge #190667: treewide: pin failing packages to openssl_1_1
...into staging-next
2022-09-12 07:38:41 +02:00
Ivv 44ef157f55
Merge pull request #187359 from IvarWithoutBones/dotnetmodule-updatescripts
treewide: migrate buildDotnetModule update scripts to use fetch-deps
2022-09-11 21:40:06 +02:00
Domen Kožar 2fa6e5253e
Merge pull request #185573 from mikroskeem/fix-quakespasm-darwin
quakespasm: fix darwin build
2022-09-11 16:59:26 +01:00
Anthony Roussel ceb1673ca7
shticker-book-unwritten: pin to openssl_1_1 2022-09-11 02:34:56 +02:00
Ivar Scholten 12b912258e
osu-lazer: migrate lockfile generation to fetch-deps 2022-09-11 01:06:34 +02:00
Sandro 1ea4b12ea9
Merge pull request #190631 from r-ryantm/auto-update/polymc 2022-09-10 20:14:21 +02:00
R. Ryantm 8231563212 polymc: 1.4.1 -> 1.4.2 2022-09-10 05:31:13 +00:00
Lassulus 19e2aba59e
Merge pull request #187713 from ThibaultLemaire/fix-gzdoom-kdialog-not-found 2022-09-09 20:50:22 +02:00
Jonas Heinrich 35d1749a8b
Merge pull request #190345 from r-ryantm/auto-update/openttd-nml
openttd-nml: 0.6.1 -> 0.7.0
2022-09-09 12:56:39 +02:00
rian aa4f7078b9
classicube: init at 1.3.2 (#189491)
Co-authored-by: Sandro <sandro.jaeckel@gmail.com>
2022-09-09 11:45:59 +02:00
Daniel McCarney 9d9d2f76c4 blightmud: 3.6.2 -> 4.0.0
Updates blightmud derivation to v4.0.0. See the upstream project[0] for
full release notes.

[0]: https://github.com/Blightmud/Blightmud/releases/tag/v4.0.0
2022-09-08 17:04:22 -04:00
R. Ryantm 366fc43b01 openttd-nml: 0.6.1 -> 0.7.0 2022-09-08 14:12:10 +00:00
Joshua Trees 593ab7df22 everspace: add desktop file 2022-09-06 21:23:03 +02:00
Jonas Heinrich ab265225e8
Merge pull request #189962 from 0x4A6F/master-freenukum
freenukum: 0.3.5 -> 0.4.0
2022-09-06 20:22:01 +02:00
Bernardo Meurer 0d390d20a4
Merge pull request #189961 from zhaofengli/steam-controller-hotplug
steam: Disable udev-based joystick discovery for SDL2
2022-09-06 14:22:00 -03:00
0x4A6F 8173ccd23c
freenukum: 0.3.5 -> 0.4.0 2022-09-06 18:21:39 +02:00
Zhaofeng Li b84625ee73 steam: Disable udev-based joystick discovery for SDL2
Fixes #101281.
2022-09-05 23:56:03 -06:00
Jonas Heinrich 209e666684
Merge pull request #173148 from cpu/cpu-blightmud-3.6.1
blightmud: 3.5.0 -> 3.6.2
2022-09-05 09:19:05 +02:00
Jonas Heinrich 43dadd3e40
Merge pull request #177225 from jyooru/update/lunar-client/2.10.1
lunar-client: 2.10.0 -> 2.10.1
2022-09-04 23:27:25 +02:00
Jonas Heinrich e86a16dbc6
Merge pull request #179571 from kierdavis/freesweep-1.0.2
freesweep: 1.0.1 -> 1.0.2
2022-09-04 23:07:43 +02:00
Jonas Heinrich 65d809ffec
Merge pull request #187795 from atemp/emp_ddnet_16.3
ddnet: 16.2.2 -> 16.3.1
2022-09-04 19:14:01 +02:00