Commit Graph

95 Commits

Author SHA1 Message Date
Yoshiko2
75373dd513 Merge pull request #913 from hejianjun/master
弃用91mv,换用新网站javday
2022-11-17 15:07:50 +08:00
hejianjun
b906be8099 弃用91mv,换用新网站javday 2022-11-06 20:27:55 +08:00
yoshiko2
447c035a55 Simply message output 2022-11-06 05:32:02 +08:00
yoshiko2
ac3001b14c Modify: useless output in debug mode 2022-11-06 04:57:14 +08:00
Yoshiko2
c1370e96d8 Merge pull request #910 from Bluefissure/patch-2
fix: fast return if url is None
2022-11-02 01:51:24 +08:00
Yoshiko2
80e53529a8 Merge pull request #908 from Bluefissure/patch-1
feat: default javbus to actual javbus
2022-11-02 01:51:13 +08:00
Bluefissure
4d5e816dd4 fix: fast return if url is None 2022-10-31 22:30:41 -05:00
Bluefissure
1e88d06248 default javbus to actual javbus
why do we use unstable mirrors first?
2022-10-30 22:25:04 -05:00
hejianjun
2aaea3446c 修复一些脚本执行异常和添加mdbk和mdtm的规则,避免被麻豆番号污染 2022-10-26 23:07:23 +08:00
naughtyGitCat
78298495ac fix var name consistency error
change var name to reach human friendly
add type hinting
PEP8 formatting
2022-09-30 16:43:15 +08:00
naughtyGitCat
50ef41ee50 Merge remote-tracking branch 'origin/master'
# Conflicts:
#	scraper.py
#	scrapinglib/api.py
2022-09-16 18:26:43 +08:00
naughtyGitCat
f56400a56b add type hinting
PEP8 formatting
2022-09-16 18:23:20 +08:00
Mathhew
8db24498d0 minor fixes 2022-09-16 15:35:47 +08:00
Mathhew
890b934fe9 add debug in scrapinglib 2022-09-16 15:30:01 +08:00
yoshiko2
8446489b68 Fix sources select func 2022-09-14 15:39:09 +08:00
yoshiko2
5f5a5a4a56 Fix getchu #2 2022-09-14 15:38:33 +08:00
yoshiko2
ba340caa5f Fix getchu cover 2022-09-14 14:55:04 +08:00
yoshiko2
c30b235fe3 Add output select source in debug mode 2022-09-14 14:54:24 +08:00
yoshiko2
fcfe586f7b Merge remote-tracking branch 'origin/master' 2022-09-09 01:39:06 +08:00
Yoshiko2
5296a62c45 Merge pull request #871 from WarpTraveller/master
Update carib.py to download trailer
2022-09-09 01:38:25 +08:00
yoshiko2
6f5c67d8f9 Fix uncensored image processing 2022-09-09 01:38:02 +08:00
Wayne.Lui
2a62b59346 Update carib.py to download trailer 2022-09-06 12:46:03 +08:00
aedvoan
6cb4be22ae Update javbus.py
fanbus.us already deco, removed to prevent void retry.
2022-09-04 23:14:38 +08:00
Wayne.S.Lui
4502167216 Merge remote-tracking branch 'origin/master'
# Conflicts:
#	scrapinglib/fanza.py
2022-08-31 14:17:52 +08:00
Wayne.S.Lui
f848a4ec24 Update fanza.py 2022-08-31 04:36:50 +08:00
Wayne.S.Lui
75aedf8601 Update fanza.py
Update to get trailer, extrafanarts and cover, using the method from older version
2022-08-30 22:46:40 +08:00
yoshiko2
54440de9b1 Remove useless error output 2022-08-26 02:43:50 +08:00
Yoshiko2
db9eaa7ec8 Merge pull request #859 from KyoMiko/master
Update getchu.py
2022-08-25 23:29:27 +08:00
Mathhew
793ef89f22 update init 2022-08-22 10:39:41 +08:00
KyoMiko
3318c3cf01 Update getchu.py
解决getchu匹配到无关结果的问题
2022-08-16 23:06:16 +08:00
Mathhew
153cdcde00 fixes
- 优化avsox刮削 FC2
- 修复javdb与library的specifiedUrl
- 其他
2022-08-16 09:24:16 +08:00
Mathhew
6de2e8f60f fix storyline 2022-07-28 23:07:51 +08:00
Mathhew
ce388edce8 update scrapinglib
- support specifiedUrl when scraping single movie
- support javlibrary and rating
2022-07-28 18:45:54 +08:00
Mathhew
ee1306fb3b fix(madou): split tags 2022-07-28 17:58:17 +08:00
Mathhew
17d0c638dc fix(carib): morestoryline 2022-07-28 17:56:22 +08:00
ChaseDream
baf915508f 修复gcolle无法刮削的问题
number前面缺了个self,请求URL会变成'https://gcolle.net/product_info.php/products_id/gcolle-xxxxx',导致无法刮削
2022-07-17 20:07:50 +08:00
Mathhew
0dda035057 update scrapinglib
- 优化提取extrafanart,trailer等,直接使用xpath expr,不需要正则匹配
- 优化 getchu 获取cover方法,直接使用og标签信息
- 优化 www.getchu 识别 getchu-id 的资源
- 统一获取 tag 方法,返回值 list
2022-06-15 14:23:49 +08:00
Mathhew
efb805a987 update lib
fix(airav): tags & extrafanart
fix(mgstage): clean
fix(fanza): outline
2022-06-13 18:24:10 +08:00
Mathhew
cd01de1344 minor fixes
- fix dlsite discount
- fix fanza: cover from og:image and extrafanart xpath expr
2022-06-13 15:15:32 +08:00
Mathhew
e7315e3ffa fix getchu
headers extrafanart
2022-06-13 10:01:03 +08:00
Mathhew
4074dcd366 update scrapinglib 2022-06-13 10:00:41 +08:00
Mathhew
f11378186d update lib 2022-06-13 09:02:05 +08:00
Mathhew
e665bceb5b update scrapinglib 2022-05-30 15:05:08 +08:00
Mathhew
9898f2918f update scrapinglib 2022-05-27 15:24:29 +08:00
Mathhew
b7ecb66210 add scrapinglib 2022-05-26 14:03:58 +08:00