926 B
926 B
Loki Mode Benchmark Results
Generated: 2026-01-05 09:31:14
Overview
This directory contains benchmark results for Loki Mode multi-agent system.
Methodology
Loki Mode uses its multi-agent architecture to solve each problem:
- Architect Agent analyzes the problem
- Engineer Agent implements the solution
- QA Agent validates with test cases
- Review Agent checks code quality
This mirrors real-world software development more accurately than single-agent approaches.
Running Benchmarks
# Setup only (download datasets)
./benchmarks/run-benchmarks.sh all
# Execute with Claude
./benchmarks/run-benchmarks.sh humaneval --execute
./benchmarks/run-benchmarks.sh humaneval --execute --limit 10 # First 10 only
./benchmarks/run-benchmarks.sh swebench --execute --limit 5 # First 5 only
# Use different model
./benchmarks/run-benchmarks.sh humaneval --execute --model opus