Commit Graph

2 Commits

Author SHA1 Message Date
yusyus
8031ce69ce fix: Update test imports to use proper package names
Fixed import paths in test_skip_llms_txt.py to use skill_seekers
package name instead of old-style cli imports.

Changes:
- Updated import from 'cli.doc_scraper' to 'skill_seekers.cli.doc_scraper'
- Updated logger names from 'cli.doc_scraper' to 'skill_seekers.cli.doc_scraper'
- Removed sys.path manipulation (no longer needed with proper imports)

All 17 tests now pass successfully (15 in test_skip_llms_txt.py + 2 in test_config_validation.py)
2025-11-29 22:56:37 +03:00
sogoiii
a0b1c2f42f feat: add skip_llms_txt config option to bypass llms.txt detection
- Add skip_llms_txt config option (default: False)
- Validate value is boolean, warn and default to False if not
- Support in both sync and async scraping modes
- Add 17 tests for config, behavior, and edge cases
2025-11-20 13:55:46 -08:00