44 lines
1.5 KiB
Markdown
44 lines
1.5 KiB
Markdown
# Supermarket basic scraping
|
|
The library supports scraping from Shufersal, CoOp, Rami Levi, Osher Ad, Zol Vebegadol, Tiv Taam, Freshmarket, Mahsanei Hashook, Victory, Maayan2000, Yohananof, Stop Market, Keshet Taamim, Hazi Hinam, Dor Alon supermarkets, Shefa Birkat Hashem, Shuk Hayir, King Store and Super Bareket.
|
|
|
|
## Installation
|
|
clone:
|
|
```cmd script
|
|
git clone https://github.com/korenLazar/supermarket-scraping.git
|
|
cd supermarket-scraping
|
|
virtualenv venv
|
|
venv\bin\activate
|
|
pip install -r requirements.txt
|
|
```
|
|
|
|
## Dependencies
|
|
|
|
1. python (3.7+)
|
|
2. virtualenv
|
|
|
|
## Usage
|
|
First, to find your Shufersal store's ID, you can run the following command (assuming you live in Jerusalem):
|
|
```cmd script
|
|
python main.py --find_store ירושלים --chain Shufersal
|
|
```
|
|
In case you want a different supermarket chain, just change 'Shufersal' to a different name (the options will be
|
|
printed in case of misspelling).
|
|
|
|
The output of the last command - the different Shufersal stores in Jerusalem with their IDs - should be printed.
|
|
|
|
Now, that we have the store's ID, we can get the store's relevant promotions sorted by their start date, last update and length.
|
|
```cmd script
|
|
python main.py --promos 5 --chain Shufersal
|
|
```
|
|
* We assumed that the store's ID is 5.
|
|
Now, you can find the promos in both "results\Shufersal_promos_5.csv" and "results\Shufersal_promos_5.log".
|
|
|
|
For other documentation and commands, you can run
|
|
```cmd script
|
|
python main.py --h
|
|
```
|
|
|
|
Any file that was downloaded in the process will be located in the "raw_files" directory.
|
|
|
|
Good luck!
|