sogoiii a0b1c2f42f ✨ feat: add skip_llms_txt config option to bypass llms.txt detection ...

- Add skip_llms_txt config option (default: False)
- Validate value is boolean, warn and default to False if not
- Support in both sync and async scraping modes
- Add 17 tests for config, behavior, and edge cases

2025-11-20 13:55:46 -08:00

..

fixtures

Add unified scraping tests and example conflict data

2025-10-29 23:19:32 +03:00

__init__.py

Add comprehensive test system with 71 tests (100% pass rate)

2025-10-19 02:08:58 +03:00

conftest.py

Fix GitHub Actions test failures for unified MCP integration

2025-10-26 17:19:06 +03:00

mcp_integration_test.md

Add comprehensive MCP setup guide and integration test template

2025-10-19 17:01:37 +03:00

test_async_scraping.py

fix: Update test imports for new package structure

2025-11-07 01:21:29 +03:00

test_cli_paths.py

test: Fix tests for modern Python packaging structure

2025-11-10 21:35:44 +03:00

test_config_validation.py

✨ feat: add skip_llms_txt config option to bypass llms.txt detection

2025-11-20 13:55:46 -08:00

test_constants.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_estimate_pages.py

test: Fix tests for modern Python packaging structure

2025-11-10 21:35:44 +03:00

test_github_scraper.py

test: Add comprehensive test suite for GitHub scraper (22 tests)

2025-10-26 14:30:57 +03:00

test_integration.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_llms_txt_detector.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_llms_txt_downloader.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_llms_txt_parser.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_mcp_server.py

fix: Update test imports and merge_sources for v2.0.0 release

2025-11-11 22:26:52 +03:00

test_package_skill.py

test: Fix tests for modern Python packaging structure

2025-11-10 21:35:44 +03:00

test_package_structure.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_parallel_scraping.py

fix: Update test imports for new package structure

2025-11-07 01:21:29 +03:00

test_pdf_advanced_features.py

Add PDF Advanced Features (v1.2.0)

2025-10-23 21:43:05 +03:00

test_pdf_extractor.py

Add PDF Advanced Features (v1.2.0)

2025-10-23 21:43:05 +03:00

test_pdf_scraper.py

Fix all tests: 297/297 passing, 0 skipped, 0 failed

2025-10-26 00:51:18 +03:00

test_pr144_concerns.py

feat: Complete refactoring with async support, type safety, and package structure

2025-10-26 13:05:39 +03:00

test_scraper_features.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_setup_scripts.py

test: Fix tests for modern Python packaging structure

2025-11-10 21:35:44 +03:00

test_skip_llms_txt.py

✨ feat: add skip_llms_txt config option to bypass llms.txt detection

2025-11-20 13:55:46 -08:00

test_terminal_detection.py

feat: Add modern Python packaging - Phase 1 (Foundation)

2025-11-07 01:14:24 +03:00

test_unified_mcp_integration.py

fix: Update test imports and merge_sources for v2.0.0 release

2025-11-11 22:26:52 +03:00

test_unified.py

fix: Update test imports for new package structure

2025-11-07 01:21:29 +03:00

test_upload_skill.py

test: Fix tests for modern Python packaging structure

2025-11-10 21:35:44 +03:00

test_utilities.py

fix: Update test imports for new package structure

2025-11-07 01:21:29 +03:00