336ca9d88c
tests / pest (push) Failing after 7m52s
Details
tests / assets (push) Successful in 20s
Details
tests / release (push) Has been skipped
Details
Nine defects in the host pipeline, every one of which either stopped an
install or let a host reach `active` while it could not do its job.
The install-stoppers:
- InstallProxmoxVe hard-coded `bookworm`. A server ordered today boots
Debian 13 trixie, so it added the PVE 8 repo and keyring to a trixie
base. The codename now comes from /etc/os-release, the suite and keyring
are looked up per release, and an unknown one fails naming what it found
instead of guessing. Keys land in /usr/share/keyrings with Signed-By
rather than in the deprecated trusted.gpg.d, where they would vouch for
every other repository on the machine too.
- keyLogin() dialled wg_ip whenever it was filled, but wg_ip is persisted
inside the allocation lock BEFORE the handshake is ever proven. Attempt
1 reserved the address and failed at the handshake; every later attempt,
including a console Retry, died connecting to a tunnel that did not work
— before reaching the only code that could repair wg0.conf. Recovery
meant nulling hosts.wg_ip by hand. SSH now uses the tunnel only once the
`wg_peer` breadcrumb proves a handshake succeeded, which also rescues
the same shape in RebootIntoPveKernel, ConfigureProxmox,
CreateAutomationToken and SecureHostFirewall. Not a hole: 22 on the
public IP is open until SecureHostFirewall runs, that step runs last,
and by then the tunnel is necessarily proven. And nothing validated the
hub key/endpoint, so renderConfig() would emit `PublicKey = ` — now
refused before anything is installed, allocated or written.
- `systemctl enable --now wg-quick@wg0 || wg-quick up wg0` brought the
interface up without the enablement, so the tunnel did not come back
after the step-6 reboot; on the next attempt both halves failed with
"wg0 already exists" and the step retried forever on a working tunnel.
The three states are handled separately now, and a changed wg0.conf is
actually applied instead of only written.
- RebootIntoPveKernel removed the Debian kernel with `|| true`, ignored
update-grub's exit status, and rebooted. A /boot that filled up during
the full-upgrade could leave a machine only the provider's console can
reach. The pve kernel image, its initramfs and update-grub's exit status
are all proven first; anything missing fails loudly and does not reboot.
- ConfigureProxmox ran `ip link show vmbr0` and threw the result away
(its comment claimed it recorded the absence; it recorded nothing), then
repeated a rm -f, and always advanced. Proxmox on top of Debian does not
create vmbr0, so onboarding reported `active` with no bridge. It now
fails with the default route in the message and deliberately does not
build the bridge over the primary NIC from a remote shell.
The things that were quietly inert:
- Proxmox applies a guest's firewall rules only while the firewall is
enabled at datacenter level, and it ships disabled — so applyFirewall()'s
"80/443 only" rules were inert on every customer VM. Enabling it blindly
is the opposite trap (input policy defaults to DROP, node firewall
defaults to on, and its management ipset is seeded from the PUBLIC
subnet, not the tunnel), so: policy ACCEPT and the node firewall off
first, master switch last, read back to confirm. nftables stays the one
owner of the host's input policy.
- role_privs lacked Sys.Modify, which POST /cluster/backup requires
(pve-manager's PVE/API2/Backup.pm), so RegisterBackup 403'd and failed
EVERY customer run. And `pveum role add … || true` only ever applied the
privilege list on the run that created the role — it converges now, above
the token short-circuit so a replay reaches it.
- The nftables ruleset dropped all ICMP and ICMPv6. On a real host that
breaks IPv6 outright once the neighbour cache expires and black-holes
large transfers through PMTUD. Both families accept the types they need,
policy drop stays, and a DHCP client reply is allowed so a rebind cannot
lose the IPv4 address.
- api_token_ref used the `encrypted` cast, i.e. APP_KEY, against
SecretVault's own written rule. One rotation would have made every host's
Proxmox token undecryptable at once. Moved onto SecretCipher with a
migration that leaves any value it cannot read exactly as it is and says
so, rather than destroying a credential that exists nowhere else.
- Every plan version points at template_vmid 9000 and nothing created or
verified it, so the first paid order died in CloneVirtualMachine after
the customer had paid. VerifyVmTemplate reports that during onboarding
instead. It does not build a template: what goes into the golden image is
a product decision.
Three tests that proved nothing, fixed: `ran(…emergency-open-firewall.sh)`
only ever matched the `chmod 700` above it, because putFile() is not
recorded — the script's contents are now asserted, including that nothing
in it reopens the firewall on a timer or in the background. The port policy
was tested one-sidedly, so a mutation adding `tcp dport { 8006 } accept`
passed the suite; the ruleset is now read as a list of what it opens to an
unrestricted source. And the end-to-end test says in writing that it proves
sequencing only.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
|
||
|---|---|---|
| .. | ||
| 0001_01_01_000000_create_users_table.php | ||
| 0001_01_01_000001_create_cache_table.php | ||
| 0001_01_01_000002_create_jobs_table.php | ||
| 2026_07_24_224530_add_two_factor_columns_to_users_table.php | ||
| 2026_07_24_224531_create_passkeys_table.php | ||
| 2026_07_25_062321_add_is_admin_to_users_table.php | ||
| 2026_07_25_070001_create_hosts_table.php | ||
| 2026_07_25_070002_create_provisioning_runs_table.php | ||
| 2026_07_25_070003_create_provisioning_step_events_table.php | ||
| 2026_07_25_070004_create_run_resources_table.php | ||
| 2026_07_25_070005_add_unique_wg_ip_to_hosts_table.php | ||
| 2026_07_25_070006_add_unique_public_ip_to_hosts_table.php | ||
| 2026_07_25_080001_create_customers_table.php | ||
| 2026_07_25_080002_create_orders_table.php | ||
| 2026_07_25_080003_create_instances_table.php | ||
| 2026_07_25_080004_create_dns_records_table.php | ||
| 2026_07_25_080005_create_backups_table.php | ||
| 2026_07_25_080006_create_monitoring_targets_table.php | ||
| 2026_07_25_080007_create_onboarding_tasks_table.php | ||
| 2026_07_25_080008_add_node_to_hosts_table.php | ||
| 2026_07_25_080009_add_guest_ip_to_instances_table.php | ||
| 2026_07_25_080010_add_unique_email_to_customers_table.php | ||
| 2026_07_25_090001_create_datacenters_table.php | ||
| 2026_07_25_090002_add_type_to_orders_table.php | ||
| 2026_07_25_090003_add_user_id_to_customers_table.php | ||
| 2026_07_25_090004_make_customer_identity_unique.php | ||
| 2026_07_25_090005_add_profile_and_branding_to_customers.php | ||
| 2026_07_25_090006_add_cancellation_to_instances.php | ||
| 2026_07_25_090007_create_seats_table.php | ||
| 2026_07_25_090008_add_datacenter_fk_to_hosts.php | ||
| 2026_07_25_133845_create_permission_tables.php | ||
| 2026_07_25_133900_seed_roles_and_permissions.php | ||
| 2026_07_25_140001_create_maintenance_windows.php | ||
| 2026_07_25_140002_add_claimed_at_to_maintenance_notifications.php | ||
| 2026_07_25_200000_create_vpn_peers_table.php | ||
| 2026_07_25_200001_add_vpn_manage_capability.php | ||
| 2026_07_25_210000_add_ownership_to_vpn_peers.php | ||
| 2026_07_25_210001_split_vpn_capabilities.php | ||
| 2026_07_25_220000_create_app_settings_table.php | ||
| 2026_07_25_220001_add_site_manage_capability.php | ||
| 2026_07_25_230000_create_instance_traffic_table.php | ||
| 2026_07_25_230001_add_traffic_addons_to_instances.php | ||
| 2026_07_25_240000_add_dns_name_to_hosts_table.php | ||
| 2026_07_26_000000_add_instance_admin_capability.php | ||
| 2026_07_26_010000_add_vat_verification_to_customers.php | ||
| 2026_07_26_010001_bind_vat_verification_to_value.php | ||
| 2026_07_26_020000_create_subscriptions_table.php | ||
| 2026_07_26_020001_add_tier_to_subscriptions.php | ||
| 2026_07_26_030000_link_subscriptions_to_orders.php | ||
| 2026_07_26_040000_create_plan_catalogue_tables.php | ||
| 2026_07_26_040001_link_subscriptions_to_plan_versions.php | ||
| 2026_07_26_040002_add_plan_version_to_orders.php | ||
| 2026_07_26_050000_add_plans_manage_capability.php | ||
| 2026_07_26_060000_create_subscription_addons_table.php | ||
| 2026_07_26_060001_create_subscription_records_table.php | ||
| 2026_07_26_070000_link_subscriptions_to_stripe.php | ||
| 2026_07_26_070001_one_register_entry_per_billing_event.php | ||
| 2026_07_26_070002_track_last_applied_stripe_event.php | ||
| 2026_07_26_070003_create_stripe_pending_events_table.php | ||
| 2026_07_27_040000_record_when_monitoring_last_answered.php | ||
| 2026_07_27_060000_create_app_secrets_table.php | ||
| 2026_07_27_060100_add_secrets_capability.php | ||
| 2026_07_27_150000_create_instance_metrics_table.php | ||
| 2026_07_27_160000_add_checks_to_instance_metrics.php | ||
| 2026_07_27_180000_create_support_requests_table.php | ||
| 2026_07_28_090000_create_mailboxes_table.php | ||
| 2026_07_28_095000_add_authenticates_to_mailboxes_table.php | ||
| 2026_07_28_100000_seed_mailboxes_from_environment.php | ||
| 2026_07_28_110000_add_mail_manage_permission.php | ||
| 2026_07_29_090000_create_operators_table.php | ||
| 2026_07_29_100000_move_rbac_to_operator_guard.php | ||
| 2026_07_29_110000_add_facility_to_datacenters_table.php | ||
| 2026_07_29_120000_add_admin_password_to_instances_table.php | ||
| 2026_07_29_120000_create_sessions_and_device_tables.php | ||
| 2026_07_29_130000_create_invoice_tables.php | ||
| 2026_07_29_140000_add_export_state_to_invoices.php | ||
| 2026_07_29_150000_create_export_targets.php | ||
| 2026_07_29_170000_add_layout_and_retention_to_export_targets.php | ||
| 2026_07_29_180000_add_grant_provenance_to_subscriptions.php | ||
| 2026_07_29_180001_add_grant_provenance_to_subscription_addons.php | ||
| 2026_07_29_180002_add_grant_plans_capability.php | ||
| 2026_07_29_200000_create_status_history.php | ||
| 2026_07_29_210000_add_recommended_flag_to_plan_families.php | ||
| 2026_07_29_210001_add_marketing_copy_to_plan_families.php | ||
| 2026_07_29_220000_add_domain_verification_to_instances.php | ||
| 2026_07_29_230000_add_address_state_to_instances.php | ||
| 2026_07_29_230000_move_instances_to_their_own_zone.php | ||
| 2026_07_29_240000_add_pending_restart_to_instances.php | ||
| 2026_07_29_250000_add_instance_restart_capability.php | ||
| 2026_07_29_260000_add_applied_quota_to_instances.php | ||
| 2026_07_29_270000_link_invoices_to_the_period_they_bill.php | ||
| 2026_07_29_280000_track_the_stripe_price_a_contract_is_billed_at.php | ||
| 2026_07_29_290000_bill_modules_through_stripe.php | ||
| 2026_07_29_300000_record_whether_a_customer_is_a_consumer.php | ||
| 2026_07_29_300001_add_the_withdrawal_window_to_contracts.php | ||
| 2026_07_30_100000_record_every_mail_that_left_the_system.php | ||
| 2026_07_30_110000_charge_the_price_that_is_advertised.php | ||
| 2026_07_30_200000_read_the_support_mailbox_into_the_console.php | ||
| 2026_07_31_100000_write_the_answers_once_and_reuse_them.php | ||
| 2026_07_31_120000_seed_the_answers_that_are_always_needed.php | ||
| 2026_07_31_140000_record_a_cancellation_on_the_contract_too.php | ||
| 2026_07_31_160000_move_host_api_tokens_onto_the_secrets_key.php | ||