Files
proxmox/docs/04-configuration/verification-evidence/APPLIED_FIXES_20260207.md
defiQUG fbda1b4beb
Some checks failed
Deploy to Phoenix / deploy (push) Has been cancelled
docs: Ledger Live integration, contract deploy learnings, NEXT_STEPS updates
- ADD_CHAIN138_TO_LEDGER_LIVE: Ledger form done; public code review repo bis-innovations/LedgerLive; init/push commands
- CONTRACT_DEPLOYMENT_RUNBOOK: Chain 138 gas price 1 gwei, 36-addr check, TransactionMirror workaround
- CONTRACT_*: AddressMapper, MirrorManager deployed 2026-02-12; 36-address on-chain check
- NEXT_STEPS_FOR_YOU: Ledger done; steps completable now (no LAN); run-completable-tasks-from-anywhere
- MASTER_INDEX, OPERATOR_OPTIONAL, SMART_CONTRACTS_INVENTORY_SIMPLE: updates
- LEDGER_BLOCKCHAIN_INTEGRATION_COMPLETE: bis-innovations/LedgerLive reference

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-12 15:46:57 -08:00

5.3 KiB
Raw Permalink Blame History

Fixes Applied — 2026-02-07

Run: Applied all automatable fixes from FULL_FIXES_PREPARED.md.
Reference: FULL_FIXES_PREPARED.md.


Applied (automated)

# Fix Result
1 Validators + tx-poolscripts/fix-all-validators-and-txpool.sh All 5 validators (10001004) config updated and besu-validator restarted on r630-01 and ml110.
2 Stuck txscripts/skip-stuck-transactions.sh Ran; next nonce 13178 confirmed. Use --nonce 13178 for next deployer tx.
3 Env permissionsscripts/security/secure-env-permissions.sh chmod 600 applied to .env files.
4 NPMplus certs (first only)FIRST_ONLY=1 request script Ran; 0 hosts needed cert (all had certs or no DNS cred).
5 NPMplus backupscripts/verify/backup-npmplus.sh Backup created: backups/npmplus/backup-20260207_094351.tar.gz.
6 Full verificationscripts/verify/run-full-verification.sh All 6 steps passed (~124s). Evidence in verification-evidence/.

Fixed via SSH (2026-02-07)

# Fix Result
3 (Sentry 1504) Install Besu + config, start besu-sentry on ml110 Done. Standalone install script run in 1504; config-sentry.toml and genesis from 1500 pushed; besu-sentry.service active.
4 (RPC 2301) Install Besu + config, start besu-rpc on ml110 Done. Standalone install (NODE_TYPE=rpc) run in 2301; config-rpc.toml and genesis from 2101 pushed; besu-rpc.service started (activating → will become active as node syncs).

Script used: scripts/install-besu-in-ct-standalone.sh (no external build.func; run with NODE_TYPE=sentry or NODE_TYPE=rpc inside CT).


Manual only (cannot automate)

# Fix Action
5 UDM Pro port forward In UniFi: add 76.53.10.38 → 192.168.11.169 (80, 81, 443). See UDM_PRO_NPMPLUS_ALLTRA_HYBX_PORT_FORWARD.md.
6 Alltra/HYBX 502 From LAN: verify backends (curl to 192.168.11.172, 192.168.11.246, 192.168.11.177, 192.168.11.251). Then fix NPMplus proxy hosts or deploy VMIDs 25002502, 25032505, 5201, 5202.
912 Optional Explorer SSL, cert 134, shellcheck (install then run), remaining NPMplus certs — per FULL_FIXES_PREPARED §7.

Post-apply status

  • Blockchain health: Block production still stalled (only 1/5 validators active in health check). Validators were restarted; allow a few minutes and re-run scripts/monitoring/monitor-blockchain-health.sh.
  • Stuck tx: Use nonce 13178 for next transaction from deployer 0x4A66...1C8.
  • Alltra/HYBX backends: Curl from this run (off-LAN) did not reach 192.168.11.172 / 192.168.11.246 / Cacti IPs; verify from a host on 192.168.11.x.
  • Shellcheck: Not installed; optional. Install with apt install shellcheck or brew install shellcheck, then run scripts/verify/run-shellcheck.sh --optional.

Verification evidence (this run)

  • Full verification: verification-evidence/ (dns-, udm-pro-, npmplus-, backend-vms-, e2e-* 20260207_094*).
  • Source-of-truth: INGRESS_SOURCE_OF_TRUTH.json.

Node lists deploy and restarts (2026-02-07)

  • Deploy: ./scripts/deploy-besu-node-lists-to-all.sh — canonical config/besu-node-lists/static-nodes.json and permissions-nodes.toml pushed to 11 nodes (10001004, 15001502, 1504, 2101, 2301, 2400). Skipped: 1503, 2201, 2303, 2401 (not running).
  • Restarts: Besu services restarted on all 11 nodes so they reload the node lists (validators: besu-validator; sentries: besu-sentry; RPCs: besu-rpc).
  • Docs: BESU_NODES_FILE_REFERENCE.md updated with production RPC table (2101, 2102, 2201, 2301, 2303, 2400, 2401) and 1504; pointer to config/besu-node-lists/ and deploy script.
  • 1504 enode: Not collected (admin_nodeInfo to 1504:8545 did not respond; add when sentry exposes RPC or use nodekey). When available, add to config/besu-node-lists/ and re-run deploy.
  • 2102 (RPC Core-2): Container created; Besu RPC installed; config fixed (genesis/permissions/static-nodes → /etc/besu, removed rpc-ws-origins and tx-pool-min-score). 2102 enode added to config/besu-node-lists/static-nodes.json and permissions-nodes.toml; deploy run; Besu restarted on all nodes to reload lists. SFValley2 tunnel (Zero Trust, connector, hostname, NPMplus, DNS) remains manual — see RPC_CORE_2_NATHAN_SFVALLEY2_TUNNEL.md.

Status update (continue — 2026-02-07)

  • Blockchain health: Validator 1000 is active; 10011004 still activating. Block production still stalled (1/5 validators in quorum). Re-run scripts/monitoring/monitor-blockchain-health.sh after more time.
  • Sentry/RPC: 15001502, 1504; 2101, 2102, 2301, 2400 — node lists deployed (including 2102 enode) and Besu restarted. 1503, 2201, 2303, 2401 skipped (containers not running).
  • Runbook added: INSTALL_BESU_1504_2301_RUNBOOK.md — steps to install Besu in 1504 and 2301 from host (push install script + configs, then start services).