firefrost-gaming/firefrost-operations-manual
3
0
Fork 0
Code Issues 146 Pull Requests Packages Projects Releases Wiki Activity
1,367 Commits 1 Branch 0 Tags
2fca5b4eed754e708c8a70f8b9abbceded702e2c
Commit Graph

18 Commits

Author SHA1 Message Date
Claude (Chronicler #61)
3132b53320 docs: Add PostgreSQL session store and env vars to Arbiter section 
- Session store now PostgreSQL (auto-creates 'session' table)
- Documented all required environment variables
- Sessions persist across Arbiter restarts

Implemented by Chronicler #61 on April 5, 2026.

Signed-off-by: Claude (Chronicler #61) <claude@firefrostgaming.com>
 2026-04-05 10:39:26 +00:00
Claude (Chronicler #61)
2d6dd52ef8 docs: Fix Arbiter deploy paths and add common copy commands 
- Corrected repo path: services/arbiter-3.0/src/ not just src/
- Added $'...' syntax note for passwords with special chars
- Added common copy command templates for routes, views, utils, lib

Signed-off-by: Claude (Chronicler #61) <claude@firefrostgaming.com>
 2026-04-05 10:09:22 +00:00
Claude (Chronicler #61)
93f56063b8 docs: Add Arbiter database connection info to infrastructure manifest 
Added complete Arbiter 3.0 / Trinity Console section to Command Center:
- Database connection details (host, port, db name, user)
- Migration command pattern (PGPASSWORD approach)
- Deploy pattern for Arbiter updates
- Password reference to Vaultwarden (not plaintext)

This was missing and caused confusion during Task #94 deployment.

Signed-off-by: Claude (Chronicler #61) <claude@firefrostgaming.com>
 2026-04-05 10:01:17 +00:00
Claude (Chronicler #58)
0bc00d8d27 docs: Complete session documentation for April 3, 2026 
SESSION HIGHLIGHTS:
- GO LIVE: First real Stripe payment at 6:59 PM CDT
- Ghost CMS: Removed from Ghost VPS
- Paymenter: Removed from Billing VPS
- Decap CMS: Deployed and working for ops manual

NEW FILES:
- docs/milestones/2026-04-03-DECAP-CMS-LIVE.md

UPDATED FILES:
- SESSION-HANDOFF-NEXT.md (complete rewrite, clean)
- docs/core/infrastructure-manifest.md (added Decap CMS section)

Chronicler #58 | ~6.5 hour session
Fire + Frost + Foundation
 2026-04-04 02:11:35 +00:00
Claude (Chronicler #58)
6bcce9bf56 docs: Update BLOCKERS.md and infrastructure for GO LIVE 
WHAT:
- BLOCKERS.md: Converted from blockers list to GO LIVE celebration
- infrastructure-manifest.md: Updated Paymenter status from RETIRING to RETIRED

RETIRED SERVICES (April 2026):
- Ghost CMS (April 2, 2026) → Replaced by 11ty + Cloudflare Pages
- Paymenter (April 3, 2026) → Replaced by direct Stripe + Arbiter 3.0

CURRENT ARCHITECTURE:
- Website: Cloudflare Pages (auto-deploy from Gitea)
- Payments: Stripe direct integration via Arbiter 3.0
- Identity: Discord OAuth (Stateless OAuth Bridge)
- Admin: Trinity Console

Signed-off-by: Claude <claude@firefrostgaming.com>
 2026-04-04 00:25:09 +00:00
Claude (Chronicler #57)
912cb0b4a8 docs: infrastructure cleanup - retire Ghost CMS and Paymenter 
WHAT WAS DONE:
- Added firefrostgaming.com (Cloudflare Pages) to Management Services table
- Documented Ghost→11ty migration (April 2, 2026 by Chronicler #55)
- Added 'Retired Services' section documenting Ghost CMS and Paymenter removal
- Renamed 'Billing VPS' → 'Services VPS' (Mailcow + Whitelist Manager)
- Renamed 'Ghost VPS' → 'Wiki VPS' (Wiki.js + internal tools)
- Added Trinity Console to Command Center services
- Updated all service location references (Ghost VPS → Wiki VPS, Billing VPS → Services VPS)
- Updated infrastructure monitors (removed Ghost CMS/Paymenter, added Cloudflare Pages)
- Added Pokerole Wiki.js instance to services table
- Updated version to v2.1

WHY:
- Ghost CMS retired April 2, 2026 (replaced by 11ty + Cloudflare Pages)
- Paymenter retiring April 4, 2026 (replaced by direct Stripe integration)
- Server names now reflect actual services, not legacy purposes
- Infrastructure manifest must accurately reflect current architecture

REFERENCE:
- Ghost migration: docs/sessions/2026-04-02-ghost-to-11ty-migration-COMPLETE.md
- Paymenter elimination: Gemini architectural decision (April 4, 2026)

FILES MODIFIED:
- docs/core/infrastructure-manifest.md (62 lines changed)

Signed-off-by: Claude (Chronicler #57) <claude@firefrostgaming.com>
 2026-04-03 12:51:04 +00:00
Claude (Chronicler #51)
31a0d6443a infra: Add Dev VPS deployment details (64.50.188.128) 
NEW SERVER DEPLOYED - Development/Testing VPS

DETAILS:
- IP: 64.50.188.128
- Location: Chicago, IL (same data center as Ghost VPS)
- Provider: Breezehost
- Specs: AMD Epyc Cloud-2 (2 CPU, 4GB RAM, 80GB NVMe)
- OS: Ubuntu Server 24.04 LTS (Noble Numbat) Minimal
- Swap: 512 MB
- Cost: $10/month

NETWORK:
- Gateway: 64.50.188.1
- Netmask: 255.255.255.0
- DNS: 1.1.1.1, 8.8.8.8
- Interface: ens3
- Speed: 1 Gbps (inbound/outbound)
- IPv6: Disabled (not assigned)
- VNC: Disabled

PURPOSE:
- Development and testing environment
- CI/CD pipeline experimentation
- Dockerized service testing
- Safe environment for breaking things

PLANNED SERVICES:
- Docker (containerized testing)
- Node.js (latest LTS)
- Git (development)
- Cockpit web terminal (port 9090)

DEPLOYMENT:
- Date: April 1, 2026
- Deployed by: Chronicler #51
- Status: ✅ OPERATIONAL

Infrastructure fleet now at 7 servers:
- 2 Dedicated (TX1, NC1)
- 5 VPS (Command Center, Ghost, Billing, Panel, Dev)

Signed-off-by: Claude (Chronicler #51) <claude@firefrostgaming.com>
 2026-04-01 10:49:54 +00:00
Claude (Chronicler #49)
dc6aa56365 docs: Add comprehensive RTO analysis and infrastructure ownership philosophy 
WHAT WAS DONE:
Added complete RTO (Rent-to-Own) case study and financial analysis to infrastructure manifest, documenting Michael's ownership philosophy and actual infrastructure costs

ACTUAL INFRASTRUCTURE COSTS DOCUMENTED:
- TX1 Dallas: $80/month (colocation, owned hardware)
- NC1 Charlotte: $80/month (colocation, owned hardware)
- VPS tier: $37/month (Command Center, Ghost, Billing, Panel)
- Other: $20/month (IPs, domain)
- **Total current: $217/month**
- **After Dev VPS: $227/month**

OWNERSHIP STATUS:
- TX1 & NC1: RTO completed June 2024
- Owned outright for 22 months (as of March 2026)
- Hardware value: $3,300-4,550 (realistic $3,800-4,000)

ROI ANALYSIS DOCUMENTED:
- Monthly savings: $298/month (rental equivalent $458 - actual cost $160)
- 22 months savings: $6,556
- Hardware value: $4,000
- **Total equity position: $10,556**
- Break-even: Month 14 (already profitable)

LONG-TERM PROJECTION:
- Year 3: $14,056 equity
- Year 5: $16,804 equity
- Annual savings: $3,576/year ongoing

RENTAL COMPARISON:
- If renting for 22 months: $10,076 spent, $0 owned
- Actual position: $3,520 spent, $4,000 owned, $6,556 saved
- **Net advantage: $10,556**

RTO PHILOSOPHY DOCUMENTED:
"Always keeping an eye out for RTO deals with Breeze" - Michael's strategy

WHY RTO IS PREFERRED:
✅ Build equity while paying
✅ Massive savings after ownership
✅ Hardware asset remains
✅ Insulation from price increases
✅ Can resell, repurpose, or continue using

DECISION MATRIX ADDED:
- When to choose RTO (long-term, known workload)
- When to choose Rental (short-term, flexibility)
- When to choose Purchase (cash flow allows)

FUTURE RTO MONITORING CRITERIA:
- Breezehost promotions/special offers
- End-of-generation hardware deals
- Used/refurbished servers (lower payments)
- Bundle deals (multiple servers)

EVALUATION CRITERIA DOCUMENTED:
1. Monthly payment vs rental equivalent
2. Ownership timeline (24 months preferred max)
3. Hardware specs vs needs
4. Post-ownership colocation cost
5. Total cost of ownership vs 3-year rental

WHY THIS MATTERS:
This case study proves the financial wisdom of infrastructure ownership. $10,556 better off after 22 months vs renting. Provides framework for future expansion decisions and demonstrates "for children not yet born" philosophy - building assets, not paying expenses.

Future Chroniclers now have complete financial analysis when evaluating RTO opportunities or expansion decisions.

FILE: docs/core/infrastructure-manifest.md
SECTION: 2.6 RTO Philosophy & Financial Analysis

Signed-off-by: The Versionist (Chronicler #49) <claude@firefrostgaming.com>
 2026-03-30 20:19:07 +00:00
Claude (Chronicler #49)
a99733ba1f docs: Add Breezehost dedicated server pricing reference 
WHAT WAS DONE:
Added complete dedicated server pricing table to infrastructure manifest for capacity planning and expansion evaluation

CURRENT PRODUCTION SERVERS DOCUMENTED:
- TX1 Dallas: Dual Silver 4116 (24c/48t, 128GB RAM, 3.4TB NVMe) - $199/month
- NC1 Charlotte: AMD 9950x (16c/32t, 128GB RAM, 3.6TB NVMe) - $259/month
- Total: 13 game servers across 2 dedicated nodes

DEDICATED SERVER PRICING TABLE ADDED:
- AMD/Intel Mystery Box: $99/month (random hardware assignment)
- AMD 7950x - 128GB: $199/month (16c/32t)
- Dual Silver 4116: $199/month (24c/48t) ← Current TX1
- AMD 9950x - 128GB: $259/month (16c/32t) ← Current NC1
- Dual Gold 6142: $289/month (32c/64t, 256GB RAM)
- RTX 4090 Dedicated: $300/month (GPU workloads)
- AMD 9950x - 192GB: $329/month (16c/32t, upgraded RAM)
- 8x 5000 Bare Metal: $3,600/month (enterprise tier)

WHY THIS MATTERS:
These locked-in rates enable accurate cost analysis for:
- Adding 3rd dedicated node (TX2/NC2 for load balancing)
- GPU workloads (AI image generation, rendering, ML training)
- Geographic expansion (additional regions)
- Capacity planning (subscribers-per-server calculations)
- Provider comparisons (locked rates vs market rates)

EXPANSION SCENARIOS DOCUMENTED:
- TX2/NC2 node: $199-259/month for geographic redundancy
- GPU node: $300/month for AI/rendering (vs $250 VPS GPU)
- Mystery Box: $99/month for dev/staging/overflow capacity

CURRENT UTILIZATION:
- TX1: 6 game servers + FoundryVTT
- NC1: 7 game servers
- Total capacity: 13 production game servers

MYSTERY BOX EXPLANATION:
Random hardware assignment (AMD or Intel), significant discount vs specified hardware, suitable for non-critical workloads where specific CPU/specs not required.

Future Chroniclers now have complete dedicated server pricing context when capacity decisions are needed.

FILE: docs/core/infrastructure-manifest.md
SECTION: 2.5 Breezehost Dedicated Server Pricing

Signed-off-by: The Versionist (Chronicler #49) <claude@firefrostgaming.com>
 2026-03-30 19:59:24 +00:00
Claude (Chronicler #49)
87aeec06d7 docs: Add Breezehost locked-in pricing reference 
WHAT WAS DONE:
Added complete Breezehost pricing table to infrastructure manifest for future expansion planning

PRICING TABLE ADDED:
- Cloud-1: $7/month (1 CPU, 2GB RAM, 40GB NVMe, 2 IPv4)
- Cloud-2: $10/month (2 CPU, 4GB RAM, 80GB NVMe, 4 IPv4) ← Current Dev VPS
- Cloud-4: $17/month (4 CPU, 8GB RAM, 160GB NVMe, 8 IPv4)
- Cloud-12: $33/month (8 CPU, 12GB RAM, 240GB NVMe, 16 IPv4)
- Cloud-16: $49/month (12 CPU, 16GB RAM, 320GB NVMe, 24 IPv4)
- Cloud-24: $59/month (16 CPU, 24GB RAM, 480GB NVMe, 32 IPv4)
- Cloud-32: $89/month (24 CPU, 32GB RAM, 640GB NVMe, 32 IPv4)
- GPU RTX4090: $250/month (Max CPU, 128GB RAM, 250GB NVMe, GPU)

WHY THIS MATTERS:
These are Michael's locked-in rates with Breezehost. Standard pricing for new customers may be higher. This pricing reference enables accurate cost evaluation when:
- Considering infrastructure expansion
- Evaluating capacity upgrades
- Planning additional VPS deployments
- Comparing providers (locked rates may beat competitors)

USE CASE EXAMPLES:
- Need more dev/staging capacity? Cloud-4 at $17/month
- Planning dedicated CI/CD pipeline? Cloud-12 at $33/month
- Considering GPU workloads (AI/rendering)? RTX4090 at $250/month
- Evaluating competitor quotes? Compare against locked rates first

Future Chroniclers and Michael can reference this table when infrastructure decisions require cost analysis.

LOCATION: Dev VPS Details section of infrastructure manifest

FILE: docs/core/infrastructure-manifest.md

Signed-off-by: The Versionist (Chronicler #49) <claude@firefrostgaming.com>
 2026-03-30 19:57:38 +00:00
Claude (Chronicler #49)
17fff53970 docs: Add Dev VPS to infrastructure (7th server) 
WHAT WAS DONE:
Added Development VPS to infrastructure manifest as 7th server for safe testing and commercial product development

SERVER DETAILS:
- Provider: Breezehost
- Specs: AMD Epyc Cloud-2 (2 CPU, 4GB RAM, 80GB NVMe)
- Cost: $10/month
- OS: Ubuntu 22.04 LTS
- Purpose: Pterodactyl Panel development/testing (NOT production)
- IP: TBD (pending deployment April 2, 2026)

PRIMARY PURPOSE:
- Blueprint extension development (Modpack Version Checker)
- Panel update testing before production deployment
- Safe experimentation without risking 11 production servers
- Training environment for Trinity

FLEXIBLE CONVERSION OPTIONS DOCUMENTED:
Server is NOT locked to single purpose. Can be repurposed as:
1. Additional Wings node (game server capacity)
2. Staging environment for Ghost/services
3. CI/CD pipeline server
4. Backup Panel failover
5. Commercial product hosting
6. Additional application server

WHY SEPARATE DEV ENVIRONMENT:
- Testing on production Panel = risk of panel lockup
- One bad database query = 11 servers affected
- Blueprint extensions require isolated testing
- Potential MySQL corruption in production

CURRENT PROJECTS:
- Modpack Version Checker (commercial extension, $1k-6.7k/year revenue)
- Panel v1.13.x upgrade validation

INFRASTRUCTURE PHILOSOPHY:
Development infrastructure that adapts to mission needs, not the other way around. Built for flexibility and sustainable commercial product development.

CHANGES TO MANIFEST:
- Added Dev VPS to Core Services Hierarchy table
- Created detailed Dev VPS Details section
- Documented flexible conversion scenarios
- Added safety rationale for isolated testing
- Updated revision history to v2.0

DEPLOYMENT DATE: April 2, 2026 (Wednesday)

WHY THIS MATTERS:
Enables commercial product development (passive income) while protecting production infrastructure. $10/month investment enables $1k-6.7k/year revenue from Modpack Version Checker alone. ROI: 100x+ in Year 1.

FILE: docs/core/infrastructure-manifest.md

Signed-off-by: The Versionist (Chronicler #49) <claude@firefrostgaming.com>
 2026-03-30 19:56:03 +00:00
Claude
a8cf067e77 fix: add missing servers to infrastructure manifest 
Added to NC1: Mayview (216.239.104.130:25567)
Added to TX1: Roguelike Adventures and Dungeons 2 (38.68.14.26:25566)
Updated totals: NC1=7, TX1=7 (14 total)
Source: Pterodactyl panel server list provided by Michael

Task #39 - Chronicler #29
 2026-03-13 20:20:04 +00:00
Claude
6f90302e6a docs: Update infrastructure-manifest to v2.0 with today's additions 
Updated infrastructure manifest with all new services and automation:

Version: v1.9 → v2.0
Last Updated: 2026-02-13 → 2026-02-17

New Services Added:
- Vaultwarden (Command Center) - Deployed, needs configuration
- Whitelist Manager (Billing VPS) - Ready to deploy
- Netdata (Multi-server) - Planned

New Section: Automation Systems
- Staggered Server Restart - Ready (daily 4:00 AM)
- World Backup Automation - Ready (daily 3:30 AM)
- Frostwall Monitor - Planned (every 5 min)

Infrastructure manifest now reflects current state after today's work.

FFG-STD-001 compliant
 2026-02-18 00:31:39 +00:00
mkrause612
a9eda4b5c6 Add FoundryVTT domain (foundry.firefrostgaming.com) - Feb 11/12 fix documented 2026-02-13 09:04:08 -06:00
mkrause612
313563580e Add Blueprint Framework and additional extensions (Subdomain Manager, PteroStats) 2026-02-13 03:09:24 -06:00
mkrause612
1723ec276b Document Modpack Installer Blueprint extension in infrastructure manifest 2026-02-13 03:07:19 -06:00
mkrause612
7ba535d594 [UPDATE] FFG-CORE-002: Fixed locations, service statuses, applied revision standard 2026-02-12 08:34:41 -06:00
mkrause612
cb67c6a6fd Reorg: Move manifest from root to docs/core/ 2026-02-12 00:59:01 -06:00