Commit Graph

207 Commits

Author SHA1 Message Date
lededev
b0959d1b18 javdb:无有效期内cookies文件时,随机选择一个站点 2021-10-09 20:29:17 +08:00
lededev
d010ea6d51 清理全部conf穿梭参数 2021-10-09 19:42:11 +08:00
lededev
bd3504f3b5 javdb:only accept one login site after javdb site update 2021-10-09 19:32:00 +08:00
lededev
f601669229 javdb:change to site 31 and 32 2021-10-09 12:23:00 +08:00
lededev
a405c5c41b WebCrawler:全面换装getInstance(),厘清airav.py与javbus.py及javdb.py的相爱相杀 2021-10-08 11:46:35 +08:00
lededev
0aa4c7d76c javdb.py:javdbx.json bugfix, find path before check days 2021-09-30 06:29:29 +08:00
lededev
3e1d951af8 去掉返回值为空的tag 2021-09-28 18:36:20 +08:00
lededev
b5b2e7f0d8 由于目前程序未实现演员照片功能,暂时屏蔽以提升速度 2021-09-28 18:31:20 +08:00
lededev
75b71888d9 javdb*.json path search order 2021-09-27 22:20:37 +08:00
Yoshiko2
8f99f4b939 Merge pull request #597 from lededev/fc2-m
fc2.py: update
2021-09-27 22:02:07 +08:00
Yoshiko2
30bc6a59c6 Merge pull request #591 from lededev/xcity-f1
xcity.py: get detail page by form query
2021-09-27 22:00:43 +08:00
lededev
161f4063b9 fc2.py: update 2021-09-26 11:38:48 +08:00
lededev
c6efec91dd 新增失败文件列表以避免重复刮削,模式3与软连接适用 2021-09-26 04:25:25 +08:00
lededev
4ffc34a5cf xcity on top when number similar ABP321 2021-09-25 20:54:07 +08:00
Yoshiko2
8cfefc60ef Merge pull request #594 from lededev/schar-2
replace special characters after translate, null str do not write back
2021-09-25 16:43:41 +08:00
lededev
43bb64d7d0 xcity.py: Strictly limit the number 2021-09-25 06:53:40 +08:00
lededev
6c990e8482 xcity.py: Mode 3 requires the file name to remain unchanged 2021-09-25 06:45:08 +08:00
lededev
c41df40e9f replace special characters after translate, null str do not write back 2021-09-24 01:11:25 +08:00
lededev
50574a705b carib.py: add outline/series/actor_photo 2021-09-23 15:45:00 +08:00
lededev
5e0e8b9cea WebCrawler site list in default config.ini larger than 60 2021-09-23 15:43:00 +08:00
lededev
54ed626294 remove abs_url(), just urljoin() is enough 2021-09-23 08:21:01 +08:00
lededev
c599463409 rewrite getActorPhoto() to get real photo 2021-09-23 07:58:53 +08:00
lededev
c32a4a12ac speed up by reusing stateful browser 2021-09-23 07:01:24 +08:00
lededev
b59b4938d6 xcity.py: get detail page by form query 2021-09-22 06:03:58 +08:00
lededev
d368d061f2 replace special characters in outline json node 2021-09-19 17:53:18 +08:00
lededev
d4f6abe1be special characters replacement in all json text nodes 2021-09-15 17:29:05 +08:00
Mathhew
1204076366 Check sources 2021-08-09 11:09:42 +08:00
yoshiko2
91c7b016a2 Adjust order for sources 2021-08-03 02:52:38 +08:00
Mathhew
08df7383a5 Make webcrawler clear 2021-07-29 10:28:25 +08:00
Mathhew
2c41487a4e Move get_data_from_json to WebCrawler 2021-07-28 16:12:08 +08:00
tojito
1cb54fb956 fix fc2 exception of getTrail() 2021-07-20 23:54:36 +08:00
tojito
9ed239105a add fc2club 2021-07-19 01:04:50 +08:00
Yoshiko2
99e9cfc5bf Merge pull request #549 from loveritsu929/master
Cut mgstage fanart
2021-07-18 21:22:03 +08:00
loveritsu929@home
9f337effbf cut mgstage poster 2021-07-17 01:07:40 +08:00
lededev
f51d91b227 try another domain name 2021-07-15 12:34:21 +08:00
lededev
d771b4e985 javdb:always include over18 cookies 2021-07-15 12:18:55 +08:00
yoshiko2
458e951d42 Update source javdb #2 2021-07-06 16:47:41 +08:00
yoshiko2
99832367a2 Update source javdb 2021-07-05 21:51:56 +08:00
lededev
5bd044dc61 javdb:only accept unique number 2021-06-29 02:13:46 +08:00
lededev
3cce315100 convert image relative url to absolute url 2021-06-11 13:53:08 +08:00
lededev
9072f8b5ec use str startswith() 2021-06-06 05:14:13 +08:00
lededev
ac22fcdf05 optimize code logic 2021-06-06 05:06:42 +08:00
lededev
e2cd1f09df check uri not start with / 2021-06-06 04:57:24 +08:00
lededev
5abeb360af if not start with http 2021-06-06 04:46:59 +08:00
lededev
0989195008 javbus:fix uri 2021-06-06 04:31:12 +08:00
xingfan_xia
93cb465bde fix import 2021-06-04 02:12:01 -07:00
xingfan_xia
b88b2ead7e add airav outline to javdb crawler 2021-06-03 12:29:19 -07:00
yoshiko2
88cef56870 Fix source avsox 2021-06-04 01:27:02 +08:00
lededev
a5363430b1 detail page number as number 2021-05-31 19:34:06 +08:00
lededev
cf45a8bf60 simplified statement 2021-05-31 19:24:21 +08:00