# Tasks to Complete — Get Everything Fixed and Running **Last Updated:** 2026-02-08 **Purpose:** Single ordered list of tasks to complete and get the deployment fixed and running correctly. Implement automated steps from repo root; run LAN/manual steps from a host with access. --- ## Task list (in order) ### 1. Config and validation (run from repo root) | # | Task | Command | Notes | |---|------|---------|--------| | 1.1 | Dependencies | `bash scripts/verify/check-dependencies.sh` | Optional tools may be missing; non-fatal. | | 1.2 | Config validation | `bash scripts/validation/validate-config-files.sh` | Must pass. | | 1.3 | Run all validation | `bash scripts/verify/run-all-validation.sh --skip-genesis` | Skips genesis if RPC unreachable. | ### 2. Block production (run from repo root; requires SSH to .10 and .11) | # | Task | Command | Notes | |---|------|---------|--------| | 2.1 | Permissioning TOML (validators) | `bash scripts/fix-validator-permissioning-toml.sh` | Deploys permissions-nodes.toml to 1000–1004; run if validators crash on permissioning. | | 2.2 | Validator tx-pool + restart | `bash scripts/fix-all-validators-and-txpool.sh` | Layered tx-pool, restarts besu-validator on 1000–1004. | | 2.3 | Verify block production | `bash scripts/monitoring/monitor-blockchain-health.sh` | Expect “Blocks being produced” and ≥4/5 validators active. | ### 3. E2E and explorer (run from repo root; RPC/Blockscout need LAN for full pass) | # | Task | Command | Notes | |---|------|---------|--------| | 3.1 | E2E routing | `E2E_SUCCESS_IF_ONLY_RPC_BLOCKED=1 bash scripts/verify/verify-end-to-end-routing.sh` | May skip RPC/Blockscout off-LAN. | | 3.2 | Explorer + block check | `bash scripts/verify/verify-explorer-and-block-production.sh` | Block production check needs LAN. | ### 4. One-shot: run all automated next steps | # | Task | Command | Notes | |---|------|---------|--------| | 4.1 | Run all next steps | `bash scripts/run-all-next-steps.sh` | Runs 1.1–1.3, 3.1–3.2, bridge dry-run, security dry-run, cron --show; writes report to `docs/04-configuration/verification-evidence/NEXT_STEPS_RUN_.md`. | ### 5. Run from LAN (when you have SSH and RPC access) | # | Task | Command | Notes | |---|------|---------|--------| | 5.1 | Block production (full) | `bash scripts/fix-validator-permissioning-toml.sh` then `bash scripts/fix-all-validators-and-txpool.sh` then `bash scripts/monitoring/monitor-blockchain-health.sh` | Ensures validators use TOML and restarts them; verify blocks. | | 5.2 | Bridge (real send) | `bash scripts/bridge/run-send-cross-chain.sh 0.01` | Requires PRIVATE_KEY and RPC from LAN. | | 5.3 | Security apply | `bash scripts/security/run-security-on-proxmox-hosts.sh --apply` | SSH key auth + firewall 8006 on .10, .11, .12. | | 5.4 | Deploy contracts | `cd smom-dbis-138 && source .env && bash scripts/deployment/deploy-all-contracts.sh` | RPC 192.168.11.211:8545 must be reachable. | | 5.5 | Verify contracts (Blockscout) | `./scripts/verify/run-contract-verification-with-proxy.sh` | Blockscout at 192.168.11.140:4000 must be reachable. | | 5.6 | NPMplus backup | `bash scripts/verify/backup-npmplus.sh` | NPMplus API at 192.168.11.167:81. | ### 6. Manual / UI | # | Task | Where | |---|------|--------| | 6.1 | 2506–2508 JWT and identity | [CHAIN138_JWT_AUTH_REQUIREMENTS.md](../04-configuration/CHAIN138_JWT_AUTH_REQUIREMENTS.md); `scripts/generate-jwt-token-for-container.sh` | | 6.2 | Explorer SSL | NPMplus https://192.168.11.167:81 → SSL → Let's Encrypt for explorer.d-bis.org | | 6.3 | NPMplus cert (e.g. 134) | NPMplus → SSL Certificates → re-request/re-save as needed | | 6.4 | Wave 2 & 3 | [WAVE2_WAVE3_OPERATOR_CHECKLIST.md](WAVE2_WAVE3_OPERATOR_CHECKLIST.md) | --- ## Quick “fix and run” sequence (from LAN) ```bash cd /path/to/proxmox # 1. Validators and block production bash scripts/fix-validator-permissioning-toml.sh bash scripts/fix-all-validators-and-txpool.sh bash scripts/monitoring/monitor-blockchain-health.sh # 2. Full automated checks + report bash scripts/run-all-next-steps.sh ``` --- --- ## Implementation summary (2026-02-08) | Task | Status | Notes | |------|--------|--------| | 1.1–1.3 Config & validation | ✅ Done | check-dependencies, validate-config-files, run-all-validation --skip-genesis passed. | | 2.1 Permissioning TOML | ✅ Done | fix-validator-permissioning-toml.sh — all 5 validators updated and restarted. | | 2.2 Validator tx-pool + restart | ✅ Done | fix-all-validators-and-txpool.sh — all 5 restarted. | | 2.3 Block production verify | ⚠️ Partial | All 5 validators **active**; block number was stable at 1879594. If blocks still don’t advance after 5–10 min: 1 pending tx (nonce 13178) — see [STUCK_TX_AND_BLOCK_STATUS_20260207.md](../08-monitoring/STUCK_TX_AND_BLOCK_STATUS_20260207.md), use next nonce for next send or `scripts/skip-stuck-transactions.sh`. | | 4.1 Run all next steps | ✅ Done | Report: [NEXT_STEPS_RUN_20260208_100911.md](../04-configuration/verification-evidence/NEXT_STEPS_RUN_20260208_100911.md). E2E OK; explorer+block skipped off-LAN; bridge dry-run OK; security dry-run OK. | **Remaining (run from LAN / manual):** 5.1–5.6 (bridge real, security --apply, deploy/verify contracts, NPMplus backup), 6.1–6.4 (JWT, Explorer SSL, NPMplus cert, Wave 2 & 3). **Remaining tasks run (2026-02-08):** See [REMAINING_TASKS_RUN_20260208.md](../04-configuration/verification-evidence/REMAINING_TASKS_RUN_20260208.md). Summary: 5.1 monitor run; 5.2 bridge real failed (gas revert); 5.3 security --apply done; 5.4 deploy partial (tx errors: stuck nonce); 5.5 verify skipped (Blockscout unreachable); 5.6 NPMplus backup done. 6.1–6.4 manual/UI only. --- ## References - [BLOCK_PRODUCTION_FIX_RUNBOOK.md](../08-monitoring/BLOCK_PRODUCTION_FIX_RUNBOOK.md) - [VALIDATION_REVIEW_20260208.md](../04-configuration/verification-evidence/VALIDATION_REVIEW_20260208.md) - [NEXT_STEPS_OPERATOR.md](NEXT_STEPS_OPERATOR.md) - [OPERATIONAL_RUNBOOKS.md](../03-deployment/OPERATIONAL_RUNBOOKS.md) - [STUCK_TX_AND_BLOCK_STATUS_20260207.md](../08-monitoring/STUCK_TX_AND_BLOCK_STATUS_20260207.md)