bacow/AV_Data_Capture
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,757 Commits 1 Branch 31 Tags
4b83f39241a0e321f6768396e42cfcdae973f478
Commit Graph
30 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Mathhew 4b83f39241 fix user rating 2022-07-28 17:51:45 +08:00
Mathhew 0dda035057 update scrapinglib 
- 优化提取extrafanart，trailer等，直接使用xpath expr，不需要正则匹配
- 优化 getchu 获取cover方法,直接使用og标签信息
- 优化 www.getchu 识别 getchu-id 的资源
- 统一获取 tag 方法,返回值 list
 2022-06-15 14:23:49 +08:00
Mathhew efb805a987 update lib 
fix(airav): tags & extrafanart
fix(mgstage): clean
fix(fanza): outline
 2022-06-13 18:24:10 +08:00
Mathhew cd01de1344 minor fixes 
- fix dlsite discount
- fix fanza: cover from og:image and extrafanart xpath expr
 2022-06-13 15:15:32 +08:00
Mathhew e7315e3ffa fix getchu 
headers extrafanart
 2022-06-13 10:01:03 +08:00
Mathhew 4074dcd366 update scrapinglib 2022-06-13 10:00:41 +08:00
Mathhew 8348fa167b Merge branch 'master' into dev 2022-06-13 09:04:26 +08:00
Mathhew f11378186d update lib 2022-06-13 09:02:05 +08:00
Mathhew e665bceb5b update scrapinglib 2022-05-30 15:05:08 +08:00
Mathhew feccd67115 remove webcrawler 2022-05-27 17:06:31 +08:00
Mathhew c1fd755ccb fix sources 2022-05-27 16:50:26 +08:00
Mathhew 3014e5da96 fix parameter & clean scraper 2022-05-27 15:42:45 +08:00
Mathhew 8871355787 fix scrape parameters 2022-05-27 15:25:08 +08:00
Mathhew 9898f2918f update scrapinglib 2022-05-27 15:24:29 +08:00
Mathhew d6d0a1687b move to scrapinglib 2022-05-26 14:10:26 +08:00
Mathhew b7ecb66210 add scrapinglib 2022-05-26 14:03:58 +08:00
Mathhew 0bb2b2da3b fix: madou title 2022-03-21 11:44:33 +08:00
Mathhew 0fcb11be35 Fix: raise exception in get html 
catching exception won't work in methods, eg javbus
 2021-11-25 09:26:15 +08:00
Mathhew ccb4e764ae fix: parse title with _c _leak tags 2021-11-05 12:15:46 +08:00
Mathhew 1204076366 Check sources 2021-08-09 11:09:42 +08:00
Mathhew 08df7383a5 Make webcrawler clear 2021-07-29 10:28:25 +08:00
Mathhew 2c41487a4e Move get_data_from_json to WebCrawler 2021-07-28 16:12:08 +08:00
Mathhew 7fe5b69ad2 Refine Proxy 2021-06-04 13:43:55 +08:00
root 580d57cd75 Fix file name too long in Linux 2020-12-08 13:56:08 +08:00
Mathhew 8873a4a7bd Update config.ini 2020-09-25 16:45:16 +08:00
Mathhew cc2d44b728 Add max_title_len config 
default value is 50
 2020-09-25 11:49:15 +08:00
Mathhew 0f16ddc198 Fix folder name 2020-09-23 09:44:14 +08:00
Mathhew 3d7bcf927c Refine location_rule with title #314 2020-09-23 09:34:14 +08:00
Mathhew c3768a6306 Clear blank 2020-09-16 21:46:21 +08:00
Mathhew 43d0250614 Add socks proxy support 2020-06-19 15:51:09 +08:00