ConfigSplitter

UMLClass
Skill Seekers :: skill_seekers :: Utilities :: ConfigSplitter

Description

Splits unified scraping configs into individual source configs. Used when a unified config needs to be run as separate scraping jobs.

Attributes

Visibility Name Type Description
private strategy str
private target_pages int

Operations

Visibility Name Description
public split()
public save_configs()
public split_by_source()
public split_by_category()

Properties

Name Value
name ConfigSplitter
stereotype null
visibility public
isAbstract false
isFinalSpecialization false
isLeaf false
isActive false

Diagrams