Supermarket basic scraping

The library supports scraping from Shufersal, Co-Op and Zol Vebegadol

Installation

clone:

git clone https://github.com/korenLazar/supermarket-scraping.git
cd supermarket-scraping
virtualenv venv
venv\bin\activate
pip install -r requirements.txt

Dependencies

1. python (3.7+)
2. virtualenv

Usage

First, to find your Shufersal store's ID, you can run the following command (assuming you live in Jerusalem):

python main.py --find_store ירושלים --chain Shufersal

In case you want a different supermarket chain, just change 'Shufersal' to a different name (the options will be printed in case of misspelling).

After running the command, you'll be able to see the different stores in Jerusalem with their IDs in "results\Shufersal-Stores.xml".

Now, that we have the store's ID, we can get the store's relevant promotions sorted by their start date, last update , and length.

python main.py --promos 5 --chain Shufersal

• We assumed that the store's ID is 5. Now, you can find the promos in "results\Shufersal_promos_5.log".

For other documentation and commands, you can run

python main.py --h

Any file that was downloaded in the process will be located in the "raw_files" directory.

Good luck!