# Ceph Installation Status

**Date**: 2024-12-19  
**Status**: Partial - Requires Manual Intervention

## Current Status

### Completed
- ✅ Disk review completed
  - ML110-01: `/dev/sdb` (931.5G) available
  - R630-01: `/dev/sdb` (279.4G) available
- ✅ Ceph cluster initialized (`pveceph init`)
- ✅ Ceph configuration files created

### Blocked
- ❌ Ceph daemon packages not installed
  - Issue: Version conflict between Proxmox Ceph (19.2.3) and external repo (18.2.7)
  - Error: `binary not installed: /usr/bin/ceph-mon`
  - Required packages: `ceph-mon`, `ceph-mgr`, `ceph-osd`, `ceph-base`

## Root Cause

Proxmox VE has Ceph 19.2.3 installed (`ceph-common`), but:
1. The external Ceph repository (quincy/18.2.7) conflicts with Proxmox's version
2. Proxmox enterprise repository requires a subscription
3. Ceph daemon binaries are not installed

## Solutions

### Option 1: Use Proxmox Subscription (Recommended)
If you have a Proxmox subscription:
```bash
# Install Ceph daemons from Proxmox enterprise repo
apt install -y ceph-mon ceph-mgr ceph-osd ceph-base
```

### Option 2: Use Proxmox No-Subscription Repository
Add the no-subscription repository:
```bash
# On both nodes
echo "deb http://download.proxmox.com/debian/ceph-quincy bullseye no-subscription" > /etc/apt/sources.list.d/ceph-no-sub.list
apt update
apt install -y ceph-mon ceph-mgr ceph-osd ceph-base
```

### Option 3: Manual Installation via Proxmox Web UI
1. Access Proxmox Web UI
2. Go to: **Datacenter → Ceph**
3. Click **Install** to install Ceph packages
4. Follow the wizard to initialize cluster

## Next Steps

1. **Choose installation method** (Option 1, 2, or 3)
2. **Install Ceph daemon packages**
3. **Create monitors**: `pveceph mon create`
4. **Create managers**: `pveceph mgr create`
5. **Create OSDs**: `pveceph osd create /dev/sdb`
6. **Create RBD pool**: `pveceph pool create rbd --add_storages`
7. **Enable dashboard**: `ceph mgr module enable dashboard`

## Manual Installation Commands

Once packages are installed:

```bash
# On ML110-01
pveceph mon create
pveceph mgr create
pveceph osd create /dev/sdb

# On R630-01
pveceph mon create
pveceph mgr create
pveceph osd create /dev/sdb

# Create pool and storage
pveceph pool create rbd --add_storages

# Enable dashboard
ceph mgr module enable dashboard
ceph dashboard ac-user-create admin <password> administrator
```

## Verification

```bash
# Check cluster status
pveceph status
ceph -s
ceph osd tree

# Check storage
pvesm status | grep ceph
```

## Related Documentation

- [Ceph Installation Guide](./CEPH_INSTALLATION.md)
- [Proxmox Ceph Integration](./CEPH_PROXMOX_INTEGRATION.md)