saret/BulkBooks
1
0
Fork 1
Code Issues Pull Requests Releases Wiki Activity

Compare commits

base: saret:29f6324bc2fe0349c13ee491e273dbfba677cfcd
Branches Tags
saret:master
..
compare: saret:master
Branches Tags
saret:master

10 Commits
29f6324bc2 ... master

Author SHA1 Message Date
1kamma
520303cd03 Merge branch 'master' of https://git.saret.tk/saret/BulkBooks 2023-05-02 22:33:40 +03:00
1kamma
14bd12ee8f books to download 2023-05-02 22:33:31 +03:00
Benny Saret
6e0446af3f Merge pull request 'master' (#3) from Mooooooooo/BulkBooks:master into master 
Reviewed-on: https://git.saret.tk/saret/BulkBooks/pulls/3
 2023-05-02 14:47:44 +03:00
saret
18f4876291 Merge branch 'master' of https://git.saret.tk/Mooooooooo/BulkBooks 2023-05-02 14:46:22 +03:00
Benny Saret
8163dd903d Modify The Readme 
Added explanations of how to use the script.
 2023-05-01 23:08:46 +03:00
1kamma
6d19d28f6e prettified the code 2023-05-01 22:56:39 +03:00
work
d73c5c579f Merge branch 'master' of https://git.saret.tk/Mooooooooo/BulkBooks 2023-04-25 12:54:33 +03:00
work
4eefe79bab added requirements 2023-04-25 12:52:57 +03:00
Benny Saret
864ab7ad1e Merge pull request 'master' (#1) from saret/BulkBooks:master into master 
Reviewed-on: https://git.saret.tk/Mooooooooo/BulkBooks/pulls/1
 2023-04-25 12:44:39 +03:00
Benny Saret
3055dc05f9 typo 2023-04-25 12:28:23 +03:00
4 changed files with 260 additions and 200 deletions
Expand all files Collapse all files

34
BooksToDownload
View File

@@ -1 +1,33 @@
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=105179261
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110994706
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110918661
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110930833
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110933810
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110938002
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110938002
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110942621
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110942621
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110948032
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110948032
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=110959329
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=105256337
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=105018830
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=109444642
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=109400325
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=109392561
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=107884166
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=97645077
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=97645077
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=102594097
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=102591827
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=102588217
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=102589202
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=101052334
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=101048613
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=101986400
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=100976710
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=100974786
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=108426718
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=108236946
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=106246523
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=104502712
https://kotar.cet.ac.il/KotarApp/Viewer.aspx?nBookID=103818662

12
README.md
View File

@@ -1,2 +1,12 @@
# BulkBooks
# Bulk Books:
This script's goal is to help you to download books from [Kotar](https://kotar.cet.ac.il/).
## How To?
1. You need an Academic Access to Kotar.
1. You need to have python>=3.9
1. download the requiremetns. (It might be prefered by using venv).
1. Add the links to the __BooksToDownload__ file.
1. Run the script.
Enjoy.

19
download books in bulks.py
View File

@@ -21,6 +21,8 @@ Books = []
THREADS = []
PATHS = []
OLD_REMOVE = []
BROWSER_PREFENCES = {"browser.download.folderList": 2, "browser.download.manager.showWhenStarting": False, "browser.download.dir": "ignore", "browser.helperApps.neverAsk.saveToDisk": "attachment/csv, text/plain, application/octet-stream, application/binary, text/csv, application/csv, application/excel, text/comma-separated-values, text/xml, application/xml, application/xls, excel/xls, application/excel 97-2003,application/Microsoft Excel 97-2003 Worksheet, application/vnd.ms-excel", "browser.helperApps.neverAsk.openFile":
"application/PDF, application/FDF, application/XFDF, application/LSL, application/LSO, application/LSS, application/IQY, application/RQY, application/XLK, application/XLS, application/XLT, application/POT application/PPS, application/PPT, application/DOS, application/DOT, application/WKS, application/BAT, application/PS, application/EPS, application/WCH, application/WCM, application/WB1, application/WB3, application/RTF, application/DOC, application/MDB, application/MDE, application/WBK, application/WB1, application/WCH, application/WCM, application/AD, application/ADP, application/vnd.ms-excel", "browser.download.panel.shown": False}
def remove_text(text: str):
@@ -121,7 +123,7 @@ def act_now(index: int, path: str = None):
couters += 1
pathus = f'{path}/{name}.pdf' if path else f"ignore/{name}/{name}.pdf"
with open(pathus, "wb") as file:
file.write(img2pdf.convert(glob.glob(f"ignore/{name}/*jpg")))
file.write(img2pdf.convert(glob.glob(f"ignore/{name}/*.jpg")))
ACTS[index]._driver.quit()
remove_text(OLD_REMOVE[index])
treads -= 1
@@ -153,25 +155,16 @@ def open_firefox(url: str):
def give_me_web():
options = webdriver.FirefoxOptions()
fp = webdriver.FirefoxProfile()
fp.set_preference("browser.download.folderList", 2)
fp.set_preference("browser.download.manager.showWhenStarting", False)
fp.set_preference("browser.download.dir", "ignore")
fp.set_preference(
"browser.helperApps.neverAsk.saveToDisk",
"attachment/csv, text/plain, application/octet-stream, application/binary, text/csv, application/csv, application/excel, text/comma-separated-values, text/xml, application/xml, application/xls, excel/xls, application/excel 97-2003,application/Microsoft Excel 97-2003 Worksheet, application/vnd.ms-excel")
fp.set_preference(
"browser.helperApps.neverAsk.openFile",
"application/PDF, application/FDF, application/XFDF, application/LSL, application/LSO, application/LSS, application/IQY, application/RQY, application/XLK, application/XLS, application/XLT, application/POT application/PPS, application/PPT, application/DOS, application/DOT, application/WKS, application/BAT, application/PS, application/EPS, application/WCH, application/WCM, application/WB1, application/WB3, application/RTF, application/DOC, application/MDB, application/MDE, application/WBK, application/WB1, application/WCH, application/WCM, application/AD, application/ADP, application/vnd.ms-excel")
fp.set_preference("browser.download.panel.shown", False)
for key,val in BROWSER_PREFENCES:
fp.set_preference(key, val)
options.add_argument('--lang=EN')
options.headless = True
fire = "geckodriver"
return (fp, fire, options)
if __name__ == "__main__":
with open("BooksToDownload", "r", encoding="utf_8") as file:
books = file.read().split("\n")
for b in books:
if b.find('````') > -1 and not b.startswith("#"):
OLD_REMOVE.append(b)

25
requirements.txt Normal file
View File

@@ -0,0 +1,25 @@
async-generator==1.10
attrs==23.1.0
beautifulsoup4==4.12.2
bs4==0.0.1
certifi==2022.12.7
chromedriver-autoinstaller==0.4.0
deprecation==2.1.0
exceptiongroup==1.1.1
h11==0.14.0
idna==3.4
img2pdf==0.4.4
lxml==4.9.2
outcome==1.2.0
packaging==23.1
pikepdf==7.2.0
Pillow==9.5.0
PySocks==1.7.1
selenium==4.9.0
sniffio==1.3.0
sortedcontainers==2.4.0
soupsieve==2.4.1
trio==0.22.0
trio-websocket==0.10.2
urllib3==1.26.15
wsproto==1.2.0