Closed
Description
The Crawler class takes a classname for the parser class, and a dict of parser_args to instantiate the parser:
class Crawler:
def __init__(
...
parser_cls=Parser,
extra_parser_args=None,
...
):
...
parser_kwargs = {} if extra_parser_args is None else extra_parser_args
self.parser = parser_cls(parser_threads, self.signal, self.session, **parser_kwargs)Yet the parser class doens't accept any kwargs. It's constructor is:
class Parser(ThreadPool):
def __init__(self, thread_num, signal, session):
Why is this the case? It causes problems when passing extra kwargs. For example
Metadata
Metadata
Assignees
Labels
No labels