arche.readers.items module

class arche.readers.items.CollectionItems(key: str, count: Optional[int] = None, filters: Optional[List[Tuple[str, str, str]]] = None, expand: bool = True)

Bases: arche.readers.items.Items

count

The number of items users wants to retrieve

fetch_data()
limit

The maximum number of items in source

class arche.readers.items.Items(key: str, count: Optional[int] = None, filters: Optional[List[Tuple[str, str, str]]] = None, expand: bool = True)

Bases: abc.ABC

count

The number of items users wants to retrieve

create_df_from_items()
df
dicts

Raw dicts of items downloaded from Scrapy Cloud

fetch_data()
flat_df
get_origin_column_name(column_name)
limit

The maximum number of items in source

size
class arche.readers.items.JobItems(start: int = 0, *args, **kwargs)

Bases: arche.readers.items.Items

count

The number of items users wants to retrieve

fetch_data()
job
limit

The maximum number of items in source