tinyCrawl.base package

Submodules

tinyCrawl.base.base module

Created on 2021/1/7 13:36

@author: Irvinfaith

@email: Irvinfaith@hotmail.com

class tinyCrawl.base.base.BaseCrawl(iter_url, iter_num_range, thread_num)

基类:object

crawl(*args, **kwargs)
main()
run(obj)
sink()

tinyCrawl.base.base_container module

Created on 2021/1/10 14:44

@author: Irvinfaith

@email: Irvinfaith@hotmail.com

class tinyCrawl.base.base_container.Container(*args, **kwargs)

基类:list

classmethod clear()

Remove all items from list.

container = {}
class tinyCrawl.base.base_container.RowContainer(*args, **kwargs)

基类:tinyCrawl.base.base_container.Container

Module contents

Created on 2021/1/10 14:44

@author: Irvinfaith

@email: Irvinfaith@hotmail.com