lededev
|
54ed626294
|
remove abs_url(), just urljoin() is enough
|
2021-09-23 08:21:01 +08:00 |
|
lededev
|
c599463409
|
rewrite getActorPhoto() to get real photo
|
2021-09-23 07:58:53 +08:00 |
|
lededev
|
c32a4a12ac
|
speed up by reusing stateful browser
|
2021-09-23 07:01:24 +08:00 |
|
lededev
|
b59b4938d6
|
xcity.py: get detail page by form query
|
2021-09-22 06:03:58 +08:00 |
|
lededev
|
d4f6abe1be
|
special characters replacement in all json text nodes
|
2021-09-15 17:29:05 +08:00 |
|
Mathhew
|
1204076366
|
Check sources
|
2021-08-09 11:09:42 +08:00 |
|
yoshiko2
|
91c7b016a2
|
Adjust order for sources
|
2021-08-03 02:52:38 +08:00 |
|
Mathhew
|
08df7383a5
|
Make webcrawler clear
|
2021-07-29 10:28:25 +08:00 |
|
Mathhew
|
2c41487a4e
|
Move get_data_from_json to WebCrawler
|
2021-07-28 16:12:08 +08:00 |
|
tojito
|
1cb54fb956
|
fix fc2 exception of getTrail()
|
2021-07-20 23:54:36 +08:00 |
|
tojito
|
9ed239105a
|
add fc2club
|
2021-07-19 01:04:50 +08:00 |
|
Yoshiko2
|
99e9cfc5bf
|
Merge pull request #549 from loveritsu929/master
Cut mgstage fanart
|
2021-07-18 21:22:03 +08:00 |
|
loveritsu929@home
|
9f337effbf
|
cut mgstage poster
|
2021-07-17 01:07:40 +08:00 |
|
lededev
|
f51d91b227
|
try another domain name
|
2021-07-15 12:34:21 +08:00 |
|
lededev
|
d771b4e985
|
javdb:always include over18 cookies
|
2021-07-15 12:18:55 +08:00 |
|
yoshiko2
|
458e951d42
|
Update source javdb #2
|
2021-07-06 16:47:41 +08:00 |
|
yoshiko2
|
99832367a2
|
Update source javdb
|
2021-07-05 21:51:56 +08:00 |
|
lededev
|
5bd044dc61
|
javdb:only accept unique number
|
2021-06-29 02:13:46 +08:00 |
|
lededev
|
3cce315100
|
convert image relative url to absolute url
|
2021-06-11 13:53:08 +08:00 |
|
lededev
|
9072f8b5ec
|
use str startswith()
|
2021-06-06 05:14:13 +08:00 |
|
lededev
|
ac22fcdf05
|
optimize code logic
|
2021-06-06 05:06:42 +08:00 |
|
lededev
|
e2cd1f09df
|
check uri not start with /
|
2021-06-06 04:57:24 +08:00 |
|
lededev
|
5abeb360af
|
if not start with http
|
2021-06-06 04:46:59 +08:00 |
|
lededev
|
0989195008
|
javbus:fix uri
|
2021-06-06 04:31:12 +08:00 |
|
xingfan_xia
|
93cb465bde
|
fix import
|
2021-06-04 02:12:01 -07:00 |
|
xingfan_xia
|
b88b2ead7e
|
add airav outline to javdb crawler
|
2021-06-03 12:29:19 -07:00 |
|
yoshiko2
|
88cef56870
|
Fix source avsox
|
2021-06-04 01:27:02 +08:00 |
|
lededev
|
a5363430b1
|
detail page number as number
|
2021-05-31 19:34:06 +08:00 |
|
lededev
|
cf45a8bf60
|
simplified statement
|
2021-05-31 19:24:21 +08:00 |
|
lededev
|
2ab40201b5
|
javdb:FC2 PPV number precise matching
|
2021-05-31 19:12:06 +08:00 |
|
yoshiko2
|
0fa1e482cd
|
Fix javbus source
|
2021-05-29 23:35:07 +08:00 |
|
yoshiko2
|
a3eb94ddcb
|
Fix source output 'list out of range'
|
2021-05-29 00:50:47 +08:00 |
|
yoshiko2
|
2a7c2b5095
|
Fix search fuction for javdb source #2
|
2021-05-28 03:16:42 +08:00 |
|
yoshiko2
|
047da6baa8
|
Fix search fuction for javdb source
|
2021-05-28 03:16:21 +08:00 |
|
lededev
|
fa14dcc492
|
cookies expiration warrning
|
2021-05-22 15:13:01 +08:00 |
|
lededev
|
8908bb8892
|
javdb: fix title, cookie expiration detection
|
2021-05-20 21:25:17 +08:00 |
|
yoshiko2
|
ab50ec6b30
|
Update javdb source
|
2021-05-20 20:41:14 +08:00 |
|
lededev
|
a900019099
|
fix javdb actors section
|
2021-05-19 15:41:55 +08:00 |
|
lededev
|
3042001df5
|
javdb enable user login cookies
|
2021-05-09 12:23:21 +08:00 |
|
lededev
|
1460e2962d
|
carib.py: use proxy config settings
|
2021-05-06 02:07:53 +08:00 |
|
lededev
|
10e35cbd92
|
fix carib and 1pond number issues
|
2021-05-05 12:00:10 +08:00 |
|
yoshiko2
|
f2eebff163
|
Fix jav321 Exception handling #2
|
2021-05-04 01:32:17 +08:00 |
|
yoshiko2
|
a088992e74
|
Fix jav321 Exception handling
|
2021-05-04 00:29:38 +08:00 |
|
yoshiko2
|
f8a3756173
|
Fix FC2 fake success
|
2021-05-04 00:02:02 +08:00 |
|
yoshiko2
|
94c5598fde
|
Fix all source Exception handling
|
2021-05-03 22:27:09 +08:00 |
|
yoshiko2
|
c8e61936b3
|
Merge branch 'master' of https://github.com/yoshiko2/AV_Data_Capture
|
2021-05-03 22:14:41 +08:00 |
|
yoshiko2
|
fceed1d04e
|
Fix mgstage source error Exception handling
|
2021-05-03 22:14:22 +08:00 |
|
yoshiko2
|
ef87a626da
|
Fix 'local variable 'url_json' referenced before assignment'
|
2021-05-03 22:03:32 +08:00 |
|
Wenhan Zhu (Cosmos)
|
efb4531034
|
changed mgstage to use high-res cover
|
2021-05-03 13:21:19 +08:00 |
|
SharpX2016
|
c9407e2df7
|
更新 javbus.py
修复javbus类别标签抓取时多出的 “多選提交”
|
2021-04-28 13:41:12 +08:00 |
|