4 Commits

Author	SHA1	Message	Date
Pablo Estevez	c33c6f9073	change max lenght	2026-01-17 17:48:15 +00:00
Pablo Estevez	5ed767ff9a	run ruff	2026-01-17 17:29:21 +00:00
yusyus	8031ce69ce	fix: Update test imports to use proper package names ... Fixed import paths in test_skip_llms_txt.py to use skill_seekers package name instead of old-style cli imports. Changes: - Updated import from 'cli.doc_scraper' to 'skill_seekers.cli.doc_scraper' - Updated logger names from 'cli.doc_scraper' to 'skill_seekers.cli.doc_scraper' - Removed sys.path manipulation (no longer needed with proper imports) All 17 tests now pass successfully (15 in test_skip_llms_txt.py + 2 in test_config_validation.py)	2025-11-29 22:56:37 +03:00
sogoiii	a0b1c2f42f	✨ feat: add skip_llms_txt config option to bypass llms.txt detection ... - Add skip_llms_txt config option (default: False) - Validate value is boolean, warn and default to False if not - Support in both sync and async scraping modes - Add 17 tests for config, behavior, and edge cases	2025-11-20 13:55:46 -08:00