Apply Composer changes: comprehensive API updates, migrations, middleware, and infrastructure improvements

- Add comprehensive database migrations (001-024) for schema evolution
- Enhance API schema with expanded type definitions and resolvers
- Add new middleware: audit logging, rate limiting, MFA enforcement, security, tenant auth
- Implement new services: AI optimization, billing, blockchain, compliance, marketplace
- Add adapter layer for cloud integrations (Cloudflare, Kubernetes, Proxmox, storage)
- Update Crossplane provider with enhanced VM management capabilities
- Add comprehensive test suite for API endpoints and services
- Update frontend components with improved GraphQL subscriptions and real-time updates
- Enhance security configurations and headers (CSP, CORS, etc.)
- Update documentation and configuration files
- Add new CI/CD workflows and validation scripts
- Implement design system improvements and UI enhancements

scripts/README.md

@@ -11,6 +11,8 @@ scripts/
 ├── setup-proxmox-agents.sh      # Proxmox site agent setup
 ├── configure-cloudflare.sh      # Cloudflare tunnel configuration
 ├── validate.sh                  # Post-install validation
+├── enable-guest-agent-existing-vms.sh  # Enable guest agent on all VMs
+├── verify-guest-agent.sh        # Verify guest agent status on all VMs
 └── ansible/                     # Ansible playbooks
     ├── site-playbook.yml        # Multi-site deployment
     ├── inventory.example        # Inventory template
@@ -29,7 +31,7 @@ scripts/
 ./install-components.sh
 
 # 3. Setup Proxmox agents (run on each Proxmox node)
-./setup-proxmox-agents.sh --site us-east-1 --node pve1
+./setup-proxmox-agents.sh --site us-sfvalley --node ML110-01
 
 # 4. Configure Cloudflare tunnels
 ./configure-cloudflare.sh
@@ -81,6 +83,92 @@ Installs all control plane components:
 Configures Proxmox nodes:
 - cloudflared installation
 - Prometheus exporter installation
+
+### enable-guest-agent-existing-vms.sh
+Enables QEMU guest agent on all existing VMs:
+- Automatically discovers all nodes on each Proxmox site
+- Discovers all VMs on each node
+- Checks if guest agent is already enabled
+- Enables guest agent on VMs that need it
+- Provides summary statistics
+
+**Usage:**
+```bash
+./scripts/enable-guest-agent-existing-vms.sh
+```
+
+**Features:**
+- Dynamic node and VM discovery (no hardcoded VMIDs)
+- Supports API token and password authentication
+- Skips VMs that already have guest agent enabled
+- Provides detailed progress and summary reports
+
+### verify-guest-agent.sh
+Verifies guest agent status on all VMs:
+- Lists all VMs with their guest agent status
+- Shows which VMs have guest agent enabled/disabled
+- Provides per-node and per-site summaries
+
+**Usage:**
+```bash
+./scripts/verify-guest-agent.sh
+```
+
+**Note:** New VMs created with the updated Crossplane provider automatically have guest agent enabled in Proxmox configuration (`agent=1`). The guest agent package is also automatically installed via cloud-init userData.
+
+### setup-dns-records.sh
+Creates DNS records for Proxmox instances via Cloudflare API:
+- A records for primary FQDNs
+- CNAME records for API and metrics endpoints
+- Automated record creation and verification
+
+### create-proxmox-secret.sh
+Creates Kubernetes secrets for Proxmox credentials:
+- Interactive credential input
+- Secret creation in crossplane-system namespace
+- Verification of secret creation
+
+### verify-provider-deployment.sh
+Verifies Crossplane provider deployment:
+- CRD existence check
+- Provider deployment status
+- Pod health and logs
+- ProviderConfig status
+- Credentials secret verification
+
+### test-proxmox-connectivity.sh
+Tests Proxmox instance connectivity:
+- DNS resolution testing
+- HTTP connectivity testing
+- Authentication testing (with credentials)
+- Version information retrieval
+
+### deploy-crossplane-provider.sh
+Automated deployment of Crossplane provider:
+- Builds provider (optional)
+- Installs CRDs
+- Deploys provider to Kubernetes
+- Verifies deployment status
+
+### deploy-test-vms.sh
+Deploys test VMs to both Proxmox instances:
+- Deploys VM to Instance 1 (ML110-01)
+- Deploys VM to Instance 2 (R630-01)
+- Waits for VM creation
+- Displays VM status
+
+### setup-monitoring.sh
+Sets up Prometheus and Grafana for Proxmox:
+- Creates ServiceMonitor for Prometheus
+- Configures scrape targets
+- Creates alert rules
+- Imports Grafana dashboards
+
+### quick-deploy.sh
+Interactive quick deployment script:
+- Guides through all deployment steps
+- Runs all deployment scripts in sequence
+- Interactive prompts for each step
 - Custom agent installation
 - Service configuration