NixOS/infra
1
0
Fork 0
mirror of https://github.com/NixOS/infra.git synced 2026-03-20 05:45:53 +00:00
Code Issues Projects Releases Packages Wiki Activity
Page: Hydra's Packet Builders
Pages
Debugging Channel Updates Haumea: znapzend configuration Home Hydra's Packet Builders Hydra Accounts Packet.com accounts RFC39 Tombstoning a room on Matrix channels.nixos.org (why where how) nixos.org (why where how) pgbadger releases.nixos.org (why what how)
Hydra's Packet Builders
Graham Christensen edited this page 2019-09-29 18:23:20 -04:00
Table of Contents

with the exception of one, packet-t2a-2, which is not managed this way

All of the hydra builders on Packet are stateless, netbooted machines.

How they're updated

The builders are regenerated every day at 00:00UTC at https://buildkite.com/grahamc/packet-nix-builder. The builders will also be regenerated and rebooted after a push to the master branch.

The source for the builders lives at https://github.com/grahamc/packet-nix-builder. The build uses the current stable version of NixOS.

Once the build has completed, a rolling-reboot script reboots one machine at a time, waiting for its ssh port to come back up.

How they work

This boot process erases all of the disks and creates a single ZFS stripe across all of them. No state is preserved between boots.

On the hydra server, hydra-packet-importer queries Packet's API for machines with the hydra tag and adds them to the Hydra machines file. This happens every few minutes.

Dealing with Failure

It is safe to, at any time, reboot any of the machines. When they come back up, they will have empty disks and no state, and will hopefully come up just fine.

CI