StuartFenton 55bc8518f0 fix: MCP scraping hangs and collects only 1 page when using Claude Code CLI (#155) ...

## ✅ Approved and Merged

Excellent work, @StuartFenton! This is a critical bug fix that unblocks MCP integration for Claude Code CLI users.

### Review Summary

**Test Results:** ✅ All 372 tests passing (100% success rate)
**Code Quality:** ✅ Minimal, surgical changes with clear documentation
**Impact:** ✅ Fixes critical MCP scraping bug (1 page → 100 pages)
**Compatibility:** ✅ Fully backward compatible, no breaking changes

### What This Fixes

1. **MCP subprocess EOFError**: No more crashes on user input prompts
2. **Link discovery**: Now finds navigation links outside main content (10-100x more pages)
3. **--fresh flag**: Properly skips user prompts in automation mode

### Changes Merged

- **cli/doc_scraper.py**: Link extraction from entire page + --fresh flag fix
- **skill_seeker_mcp/server.py**: Auto-pass --fresh flag to prevent prompts

### Testing Validation

Real-world MCP testing shows:
- ✅ Tailwind CSS: 1 page → 100 pages
- ✅ No user prompts during execution
- ✅ Navigation links properly discovered
- ✅ End-to-end workflow through Claude Code CLI

Thank you for the thorough problem analysis, comprehensive testing, and excellent PR description! 🎉

---

**Next Steps:**
- Will be included in next release (v2.0.1)
- Added to project changelog
- MCP integration now fully functional

🤖 Merged with [Claude Code](https://claude.com/claude-code)

2025-11-06 23:23:45 +03:00

68 KiB

Executable File

Raw Blame History

View Raw