Sankofa/docs/hardware_bom.md

# Sankofa Phoenix: Hardware Bill of Materials (BOM)

## Overview

This document provides detailed hardware specifications for Sankofa Phoenix infrastructure across all tiers: Core Datacenters, Regional Datacenters, and Edge Sites. The BOM includes blockchain infrastructure, compute, storage, and networking components.

## Tier 1: Core Datacenters

### Blockchain Validator Nodes

**Quantity**: 3-5 nodes per core datacenter (10-15 datacenters = 30-75 nodes total)

**Specifications**:
- **CPU**: AMD EPYC 7763 (64 cores) or Intel Xeon Platinum 8380 (40 cores)
- **RAM**: 128GB DDR4 ECC (expandable to 256GB)
- **Storage**: 
  - 2x 4TB NVMe SSD (RAID 1) for blockchain state
  - 1x 1TB NVMe SSD for OS and applications
- **Network**: 2x 25GbE network adapters
- **HSM**: Hardware Security Module for key storage (e.g., Thales Luna Network HSM)
- **Power**: 500W-750W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $15,000-$25,000 per node

### Kubernetes Control Plane Nodes

**Quantity**: 3 master + 5 worker nodes per core datacenter

**Master Node Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 64GB DDR4 ECC
- **Storage**: 2x 1TB NVMe SSD (RAID 1)
- **Network**: 2x 25GbE network adapters
- **Power**: 400W-600W per node
- **Form Factor**: 1U rack server

**Worker Node Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC (expandable to 256GB)
- **Storage**: 2x 2TB NVMe SSD (RAID 1)
- **Network**: 2x 25GbE network adapters
- **GPU**: Optional NVIDIA A100 (40GB) for AI/ML workloads
- **Power**: 500W-750W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $8,000-$12,000 per master node, $12,000-$18,000 per worker node

### Database Cluster Nodes

**Quantity**: 3-node PostgreSQL cluster per core datacenter

**Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 256GB DDR4 ECC (expandable to 512GB)
- **Storage**: 
  - 2x 4TB NVMe SSD (RAID 1) for database
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 600W-800W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $18,000-$25,000 per node

### Message Queue Cluster Nodes

**Quantity**: 3-node Kafka/Redpanda cluster per core datacenter

**Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC
- **Storage**: 
  - 4x 4TB NVMe SSD (RAID 10) for message storage
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 600W-800W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $15,000-$20,000 per node

### Storage Infrastructure

**Distributed Storage (Ceph)**:
- **Storage Nodes**: 6-12 nodes per core datacenter
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC
- **Storage**: 
  - 12x 16TB HDD (SATA) for object storage
  - 2x 2TB NVMe SSD for cache/metadata
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 800W-1000W per node
- **Form Factor**: 4U rack server

**Estimated Cost**: $20,000-$30,000 per storage node

**Object Storage (MinIO)**:
- **Storage Nodes**: 4-8 nodes per core datacenter
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC
- **Storage**: 
  - 12x 16TB HDD (SATA) for object storage
  - 2x 2TB NVMe SSD for cache
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 800W-1000W per node
- **Form Factor**: 4U rack server

**Estimated Cost**: $20,000-$30,000 per storage node

### Network Infrastructure

**Core Switches**:
- **Quantity**: 2-4 per core datacenter (redundancy)
- **Specifications**: 100GbE spine switches (48-64 ports)
- **Examples**: Arista 7280SR3, Cisco Nexus 9300, Juniper QFX5200
- **Estimated Cost**: $50,000-$100,000 per switch

**Leaf Switches**:
- **Quantity**: 8-16 per core datacenter
- **Specifications**: 25GbE/100GbE leaf switches (48 ports)
- **Examples**: Arista 7050SX3, Cisco Nexus 9300, Juniper QFX5100
- **Estimated Cost**: $15,000-$30,000 per switch

**Firewalls**:
- **Quantity**: 2-4 per core datacenter (redundancy)
- **Specifications**: Next-generation firewalls with 100Gbps throughput
- **Examples**: Palo Alto PA-7000, Fortinet FortiGate 6000, Check Point 16000
- **Estimated Cost**: $100,000-$200,000 per firewall

**Load Balancers**:
- **Quantity**: 2-4 per core datacenter (redundancy)
- **Specifications**: Application delivery controllers with 100Gbps throughput
- **Examples**: F5 BIG-IP, Citrix ADC, A10 Networks
- **Estimated Cost**: $50,000-$150,000 per load balancer

### Power and Cooling

**UPS Systems**:
- **Quantity**: 2-4 per core datacenter (redundancy)
- **Specifications**: 2-5MW UPS systems with N+1 redundancy
- **Estimated Cost**: $500,000-$1,000,000 per UPS system

**Generators**:
- **Quantity**: 2-4 per core datacenter (redundancy)
- **Specifications**: 2-5MW diesel generators with 72-hour fuel capacity
- **Estimated Cost**: $300,000-$600,000 per generator

**Cooling Systems**:
- **Quantity**: Multiple units per core datacenter
- **Specifications**: Precision cooling with hot aisle/cold aisle containment
- **Estimated Cost**: $200,000-$500,000 per cooling system

### Total Core Datacenter Hardware Cost

**Per Core Datacenter**: $5M-$10M (initial investment)
**Total (10-15 datacenters)**: $50M-$150M

## Tier 2: Regional Datacenters

### Blockchain Read Replica Nodes

**Quantity**: 2-3 nodes per regional datacenter (50-75 datacenters = 100-225 nodes total)

**Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 64GB DDR4 ECC
- **Storage**: 
  - 2x 2TB NVMe SSD (RAID 1) for blockchain state cache
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 400W-600W per node
- **Form Factor**: 1U rack server

**Estimated Cost**: $8,000-$12,000 per node

### Kubernetes Cluster Nodes

**Quantity**: 3 master + 3 worker nodes per regional datacenter

**Master Node Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 64GB DDR4 ECC
- **Storage**: 2x 1TB NVMe SSD (RAID 1)
- **Network**: 2x 25GbE network adapters
- **Power**: 400W-600W per node
- **Form Factor**: 1U rack server

**Worker Node Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC
- **Storage**: 2x 2TB NVMe SSD (RAID 1)
- **Network**: 2x 25GbE network adapters
- **Power**: 500W-750W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $8,000-$12,000 per master node, $12,000-$18,000 per worker node

### Regional Database Replicas

**Quantity**: 2-node PostgreSQL replica cluster per regional datacenter

**Specifications**:
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC
- **Storage**: 
  - 2x 2TB NVMe SSD (RAID 1) for database
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 500W-700W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $12,000-$18,000 per node

### Storage Infrastructure

**Primary Storage**:
- **Storage Nodes**: 2-4 nodes per regional datacenter
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC
- **Storage**: 
  - 8x 8TB HDD (SATA) for primary storage
  - 2x 2TB NVMe SSD for cache
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 600W-800W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $12,000-$18,000 per storage node

**Object Storage**:
- **Storage Nodes**: 2-4 nodes per regional datacenter
- **CPU**: AMD EPYC 7543 (32 cores) or Intel Xeon Gold 6338 (32 cores)
- **RAM**: 128GB DDR4 ECC
- **Storage**: 
  - 8x 8TB HDD (SATA) for object storage
  - 2x 2TB NVMe SSD for cache
  - 1x 1TB NVMe SSD for OS
- **Network**: 2x 25GbE network adapters
- **Power**: 600W-800W per node
- **Form Factor**: 2U rack server

**Estimated Cost**: $12,000-$18,000 per storage node

### Network Infrastructure

**Switches**:
- **Quantity**: 4-8 per regional datacenter
- **Specifications**: 25GbE/100GbE switches (48 ports)
- **Estimated Cost**: $15,000-$30,000 per switch

**Firewalls**:
- **Quantity**: 2 per regional datacenter (redundancy)
- **Specifications**: Next-generation firewalls with 40Gbps throughput
- **Estimated Cost**: $30,000-$60,000 per firewall

**Load Balancers**:
- **Quantity**: 2 per regional datacenter (redundancy)
- **Specifications**: Application delivery controllers with 40Gbps throughput
- **Estimated Cost**: $20,000-$50,000 per load balancer

### Power and Cooling

**UPS Systems**:
- **Quantity**: 2 per regional datacenter (redundancy)
- **Specifications**: 500kW-2MW UPS systems with N+1 redundancy
- **Estimated Cost**: $100,000-$300,000 per UPS system

**Generators**:
- **Quantity**: 2 per regional datacenter (redundancy)
- **Specifications**: 500kW-2MW diesel generators with 48-hour fuel capacity
- **Estimated Cost**: $80,000-$200,000 per generator

**Cooling Systems**:
- **Quantity**: Multiple units per regional datacenter
- **Specifications**: Precision cooling systems
- **Estimated Cost**: $50,000-$150,000 per cooling system

### Total Regional Datacenter Hardware Cost

**Per Regional Datacenter**: $500K-$2M (initial investment)
**Total (50-75 datacenters)**: $25M-$150M

## Tier 3: Edge Sites

**Note**: Edge sites follow existing edge implementation hardware specifications. See edge implementation documentation for detailed BOM.

**Additional Hardware for Blockchain Integration**:
- **Blockchain Light Client**: 
  - Minimal hardware requirements
  - Can run on existing edge infrastructure
  - No additional hardware cost

## Network Connectivity

### Inter-Datacenter Links

**Core to Core**:
- **Bandwidth**: 100Gbps+ per link
- **Redundancy**: Multiple redundant paths
- **Type**: Dark fiber or high-bandwidth leased lines
- **Estimated Cost**: $50,000-$200,000 per link per year

**Core to Regional**:
- **Bandwidth**: 10-40Gbps per link
- **Redundancy**: Redundant paths
- **Type**: Leased lines or MPLS
- **Estimated Cost**: $20,000-$100,000 per link per year

**Regional to Edge**:
- **Bandwidth**: 1-10Gbps per link
- **Redundancy**: Internet with redundancy
- **Type**: Internet connectivity with Cloudflare Tunnels
- **Estimated Cost**: $5,000-$20,000 per link per year

## Software and Licensing

### Blockchain Platform
- **Hyperledger Besu**: Open source (no license cost)
- **Quorum**: Open source (no license cost)
- **Support**: Optional commercial support contracts

### Operating Systems
- **Linux**: Ubuntu Server LTS or RHEL (open source or subscription)
- **Estimated Cost**: $0-$500 per server per year

### Virtualization and Containerization
- **Kubernetes**: Open source (no license cost)
- **Proxmox VE**: Open source (optional support subscription)
- **Estimated Cost**: $0-$1,000 per cluster per year

### Database Software
- **PostgreSQL**: Open source (no license cost)
- **Support**: Optional commercial support contracts

### Monitoring and Management
- **Prometheus/Grafana**: Open source (no license cost)
- **Loki**: Open source (no license cost)
- **Commercial Monitoring**: Optional (e.g., Datadog, New Relic)
- **Estimated Cost**: $0-$50,000 per datacenter per year

### Security Software
- **HSM Software**: Included with HSM hardware
- **Firewall Software**: Included with firewall hardware
- **Security Tools**: Open source and commercial options
- **Estimated Cost**: $10,000-$50,000 per datacenter per year

## Total Project Hardware Cost Estimate

### Phase 1 (Foundation)
- **3 Core Datacenters**: $15M-$30M
- **10 Regional Datacenters**: $5M-$20M
- **Network Connectivity**: $2M-$5M
- **Total Phase 1**: $22M-$55M

### Phase 2 (Expansion)
- **Additional 3-5 Core Datacenters**: $15M-$50M
- **Additional 20 Regional Datacenters**: $10M-$40M
- **Network Connectivity**: $5M-$15M
- **Total Phase 2**: $30M-$105M

### Phase 3 (Scale)
- **Remaining Core Datacenters**: $20M-$70M
- **Remaining Regional Datacenters**: $10M-$90M
- **Network Connectivity**: $10M-$30M
- **Total Phase 3**: $40M-$190M

### Grand Total
**Total Hardware Investment**: $92M-$350M (over 36 months)

## Ongoing Operational Costs

### Power and Cooling
- **Core Datacenter**: $500K-$2M per year per datacenter
- **Regional Datacenter**: $100K-$500K per year per datacenter
- **Edge Site**: $10K-$50K per year per site

### Network Connectivity
- **Inter-Datacenter Links**: $50K-$200K per link per year
- **Internet Connectivity**: $10K-$50K per site per year

### Maintenance and Support
- **Hardware Maintenance**: 10-15% of hardware cost per year
- **Software Support**: $50K-$200K per datacenter per year
- **Professional Services**: $100K-$500K per year

### Total Annual Operational Costs
**Estimated**: $50M-$200M per year (at full scale)

## Procurement Considerations

### Vendor Selection
- **Diversity**: Use multiple vendors for redundancy
- **Support**: Ensure 24/7 support availability
- **Warranty**: Minimum 3-year warranty on all hardware
- **Compatibility**: Ensure hardware compatibility

### Lead Times
- **Standard Hardware**: 4-8 weeks
- **Custom Hardware**: 8-16 weeks
- **Network Equipment**: 6-12 weeks
- **Power and Cooling**: 12-24 weeks

### Deployment Schedule
- **Hardware Procurement**: Start 3-6 months before deployment
- **Staging and Testing**: 2-4 weeks per datacenter
- **Deployment**: 4-8 weeks per datacenter
- **Validation**: 1-2 weeks per datacenter

## Related Documentation

- [System Architecture](./system_architecture.md) - Overall system architecture
- [Datacenter Architecture](./datacenter_architecture.md) - Detailed datacenter specifications
- [Blockchain EEA Architecture](./blockchain_eea_architecture.md) - Blockchain architecture
- [Deployment Plan](./deployment_plan.md) - Deployment procedures