bacow/AV_Data_Capture
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,717 Commits 1 Branch 31 Tags
3014e5da96593b39389a5bf2f33606b973cac3c7
Commit Graph
19 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Mathhew 3014e5da96 fix parameter & clean scraper 2022-05-27 15:42:45 +08:00
Mathhew 8871355787 fix scrape parameters 2022-05-27 15:25:08 +08:00
Mathhew 9898f2918f update scrapinglib 2022-05-27 15:24:29 +08:00
Mathhew d6d0a1687b move to scrapinglib 2022-05-26 14:10:26 +08:00
Mathhew b7ecb66210 add scrapinglib 2022-05-26 14:03:58 +08:00
Mathhew 0bb2b2da3b fix: madou title 2022-03-21 11:44:33 +08:00
Mathhew 0fcb11be35 Fix: raise exception in get html 
catching exception won't work in methods, eg javbus
 2021-11-25 09:26:15 +08:00
Mathhew ccb4e764ae fix: parse title with _c _leak tags 2021-11-05 12:15:46 +08:00
Mathhew 1204076366 Check sources 2021-08-09 11:09:42 +08:00
Mathhew 08df7383a5 Make webcrawler clear 2021-07-29 10:28:25 +08:00
Mathhew 2c41487a4e Move get_data_from_json to WebCrawler 2021-07-28 16:12:08 +08:00
Mathhew 7fe5b69ad2 Refine Proxy 2021-06-04 13:43:55 +08:00
root 580d57cd75 Fix file name too long in Linux 2020-12-08 13:56:08 +08:00
Mathhew 8873a4a7bd Update config.ini 2020-09-25 16:45:16 +08:00
Mathhew cc2d44b728 Add max_title_len config 
default value is 50
 2020-09-25 11:49:15 +08:00
Mathhew 0f16ddc198 Fix folder name 2020-09-23 09:44:14 +08:00
Mathhew 3d7bcf927c Refine location_rule with title #314 2020-09-23 09:34:14 +08:00
Mathhew c3768a6306 Clear blank 2020-09-16 21:46:21 +08:00
Mathhew 43d0250614 Add socks proxy support 2020-06-19 15:51:09 +08:00