Skip to content

Commit 3a90ee2

Browse files
web-flowclaude
andcommitted
docs: fix Crucible guide - single node works fine
Remove incorrect "3 downstairs minimum" requirement. Single node Crucible deployment works and is in production. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
1 parent 19eb62d commit 3a90ee2

1 file changed

Lines changed: 8 additions & 35 deletions

File tree

docs/ma90-crucible-deployment-complete-guide.md

Lines changed: 8 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -25,12 +25,6 @@ ssh root@still-fawn.maas "ls -la /tmp/crucible/target/release/crucible-downstair
2525

2626
## 🚨 CRITICAL LIMITATIONS
2727

28-
### **Single-Sled Testing Not Supported**
29-
**CRUCIBLE REQUIRES MINIMUM 3 DOWNSTAIRS FOR TESTING** - Cannot test with single MA90 sled!
30-
-**1 downstairs**: Crucible upstairs/NBD fails to start
31-
-**3 downstairs**: Required for any Crucible testing (can be on same sled)
32-
- 📋 **Minimum deployment**: 3 MA90 sleds OR 3 downstairs processes on single sled
33-
3428
### **Performance Requirements**
3529
**NEVER USE 512-BYTE BLOCKS** - Performance is 10x worse than 4K blocks!
3630
-**512B blocks**: 6-11 MB/s
@@ -416,36 +410,15 @@ ssh -i ~/.ssh/id_ed25519_pve ubuntu@proper-raptor.maas "ps aux | grep crucible"
416410

417411
## Next Steps
418412

419-
### 💡 **BUDGET-FRIENDLY TESTING STRATEGY**
420-
With only 1 downstairs process, Crucible requires 3 total downstairs for functionality:
421-
- Crucible upstairs uses 3-way quorum for consensus-based operations
422-
- NBD server needs minimum 3 downstairs targets to start
423-
- **Solution**: Add 2 more downstairs processes (same sled = $30 testing vs 3 sleds = $90)
424-
425-
### **Required Next Steps for Testing:**
426-
427-
**Option A: Deploy 2 Additional MA90 Sleds (Production Fault Tolerance)**
428-
1. **Deploy 2 more MA90 sleds** using this exact process
429-
2. **Configure each with 1 downstairs** on port 3810
430-
3. **Test true 3-way distributed replication** across 3 separate sleds
431-
4. **Benefits**: Hardware fault tolerance, geographic distribution, 3x performance scaling
432-
433-
**Option B: Add 2 More Downstairs to Current Sled (Cost-Effective Testing)**
434-
435-
**💡 SMART BUDGET APPROACH - Test full Crucible functionality for $30**
436-
- **Perfect for Learning**: Understand all Crucible features without expensive hardware
437-
- **Complete Testing**: NBD integration, replication, upstairs/downstairs communication
438-
- **Development Platform**: Ideal for experimentation and proof-of-concept work
439-
- **Upgrade Ready**: Easy migration to 3-sled production setup when needed
440-
441-
1. **Create 2 additional regions** on proper-raptor (see NBD guide)
442-
2. **Start downstairs on ports 3811, 3812**
443-
3. **Test complete 3-downstairs functionality** on single sled
413+
### **After Deployment:**
414+
1. **Test NBD integration** with Proxmox VMs (see `docs/crucible-proxmox-nbd-integration-guide.md`)
415+
2. **Set up systemd services** for persistent operation
416+
3. **Monitor performance** and storage health
444417

445-
### **After 3 Downstairs Available:**
446-
4. **Test NBD integration** with Proxmox VMs (see `docs/crucible-proxmox-nbd-integration-guide.md`)
447-
5. **Set up systemd services** for persistent operation
448-
6. **Monitor performance** and storage health
418+
### **Optional: Multi-Sled for Fault Tolerance**
419+
For production fault tolerance, deploy additional MA90 sleds:
420+
- Each sled runs 1 downstairs on port 3810
421+
- Benefits: Hardware fault tolerance, geographic distribution
449422

450423
---
451424

0 commit comments

Comments
 (0)