AV_Data_Capture

Author	SHA1	Message	Date
Mathhew	ee1306fb3b	fix(madou): split tags	2022-07-28 17:58:17 +08:00
Mathhew	17d0c638dc	fix(carib): morestoryline	2022-07-28 17:56:22 +08:00
Mathhew	4b83f39241	fix user rating	2022-07-28 17:51:45 +08:00
Mathhew	0dda035057	update scrapinglib - 优化提取extrafanart，trailer等，直接使用xpath expr，不需要正则匹配 - 优化 getchu 获取cover方法,直接使用og标签信息 - 优化 www.getchu 识别 getchu-id 的资源 - 统一获取 tag 方法,返回值 list	2022-06-15 14:23:49 +08:00
Mathhew	efb805a987	update lib fix(airav): tags & extrafanart fix(mgstage): clean fix(fanza): outline	2022-06-13 18:24:10 +08:00
Mathhew	cd01de1344	minor fixes - fix dlsite discount - fix fanza: cover from og:image and extrafanart xpath expr	2022-06-13 15:15:32 +08:00
Mathhew	e7315e3ffa	fix getchu headers extrafanart	2022-06-13 10:01:03 +08:00
Mathhew	4074dcd366	update scrapinglib	2022-06-13 10:00:41 +08:00
Mathhew	8348fa167b	Merge branch 'master' into dev	2022-06-13 09:04:26 +08:00
Mathhew	f11378186d	update lib	2022-06-13 09:02:05 +08:00
Mathhew	e665bceb5b	update scrapinglib	2022-05-30 15:05:08 +08:00
Mathhew	feccd67115	remove webcrawler	2022-05-27 17:06:31 +08:00
Mathhew	c1fd755ccb	fix sources	2022-05-27 16:50:26 +08:00
Mathhew	3014e5da96	fix parameter & clean scraper	2022-05-27 15:42:45 +08:00
Mathhew	8871355787	fix scrape parameters	2022-05-27 15:25:08 +08:00
Mathhew	9898f2918f	update scrapinglib	2022-05-27 15:24:29 +08:00
Mathhew	d6d0a1687b	move to scrapinglib	2022-05-26 14:10:26 +08:00
Mathhew	b7ecb66210	add scrapinglib	2022-05-26 14:03:58 +08:00
Mathhew	0bb2b2da3b	fix: madou title	2022-03-21 11:44:33 +08:00
Mathhew	0fcb11be35	Fix: raise exception in get html catching exception won't work in methods, eg javbus	2021-11-25 09:26:15 +08:00
Mathhew	ccb4e764ae	fix: parse title with _c _leak tags	2021-11-05 12:15:46 +08:00
Mathhew	1204076366	Check sources	2021-08-09 11:09:42 +08:00
Mathhew	08df7383a5	Make webcrawler clear	2021-07-29 10:28:25 +08:00
Mathhew	2c41487a4e	Move get_data_from_json to WebCrawler	2021-07-28 16:12:08 +08:00
Mathhew	7fe5b69ad2	Refine Proxy	2021-06-04 13:43:55 +08:00
root	580d57cd75	Fix file name too long in Linux	2020-12-08 13:56:08 +08:00
Mathhew	8873a4a7bd	Update config.ini	2020-09-25 16:45:16 +08:00
Mathhew	cc2d44b728	Add max_title_len config default value is 50	2020-09-25 11:49:15 +08:00
Mathhew	0f16ddc198	Fix folder name	2020-09-23 09:44:14 +08:00
Mathhew	3d7bcf927c	Refine location_rule with title #314	2020-09-23 09:34:14 +08:00
Mathhew	c3768a6306	Clear blank	2020-09-16 21:46:21 +08:00
Mathhew	43d0250614	Add socks proxy support	2020-06-19 15:51:09 +08:00