Commit Graph

128 Commits

Author SHA1 Message Date
yoshiko2
bb6ff56ce5 Fix Mapping Table Download FAILED 2022-05-26 23:43:11 +08:00
yoshiko2
0fdb79b8cd Remove not useful requests error output 2022-05-23 20:24:27 +08:00
yoshiko2
a3f3613742 Remove not useful requests error output 2022-05-23 20:24:17 +08:00
yoshiko2
daf431b9f5 Add custom headers in Image Download func 2022-05-21 23:42:30 +08:00
lededev
20dbe31b49 update UserAgent 2022-04-29 22:45:11 +08:00
yoshiko2
87972b0335 Add crawler named gcolle.py #2 2022-04-19 21:27:09 +08:00
yoshiko2
a6652e6636 Add func get_html() for session #2 2022-04-18 19:57:04 +08:00
yoshiko2
fbc2f3e2a4 Add func get_html() for session 2022-04-18 19:55:05 +08:00
lededev
3dda5a94cf 影片刮削时Ctrl+C立刻退出,而不是加入失败列表并跳到下一部影片 2022-04-18 01:27:46 +08:00
lededev
499baf51fb 简化 2022-04-14 01:21:02 +08:00
lededev
475f02fbe6 处理format空格对齐内容包含中文的情况,DEBUG INFO输出对齐 2022-04-12 06:34:08 +08:00
lededev
f728f33363 UserAgent update to Chrome 100.0 2022-04-07 12:38:27 +08:00
lededev
580139c626 try fix issue #751 2022-04-06 12:08:51 +08:00
yoshiko2
64e7a3a016 Fix cc_convert convert str to list 2022-02-28 03:16:36 +08:00
FatalFurY
0bd34f907e Merge branch 'master' of https://github.com/naughtyGitCat/Movie_Data_Capture 2022-02-23 22:15:04 +08:00
FatalFurY
377a9f308b PEP8 PREFIX, AND SOME TYPING ANNOTATION, FUNCTION COMMENT 2022-02-23 22:11:45 +08:00
lededev
ec28814449 update User-Agent 2022-02-17 17:18:41 +08:00
yoshiko2
0b0d0fcafc Update to 6.0.1 #2 2021-12-17 23:39:02 +08:00
yoshiko2
6655d41491 Optimize error output & adjust code sequence #2 2021-12-02 14:01:35 +08:00
yoshiko2
1604f0567f Optimize error output & adjust code sequence 2021-12-02 02:00:54 +08:00
Mathhew
0fcb11be35 Fix: raise exception in get html
catching exception won't work in methods, eg javbus
2021-11-25 09:26:15 +08:00
yoshiko2
1acf8b5096 Fix web request encoding #2 2021-11-23 22:13:35 +08:00
unknown
fc933615f0 Fix web request encoding 2021-11-23 00:20:15 +08:00
yoshiko2
963320a14e Update translate func for title 2021-11-09 13:35:58 +08:00
Yoshiko2
e825ad99a3 Merge pull request #630 from lededev/storyline-3
storyline: still need improve
2021-11-06 23:20:58 +08:00
Yoshiko2
06297949da Merge branch 'master' into parallel-mapdown 2021-11-06 23:17:52 +08:00
unknown
0c4df0130b Delete large translate 2021-11-06 22:45:44 +08:00
lededev
a9c4b0e417 parallel map download 2021-11-05 07:42:58 +08:00
lededev
e8af0e5a53 Merge branch 'master' into storyline-3 2021-11-05 03:29:56 +08:00
lededev
92effe53b7 storyline: still need improve 2021-11-05 02:59:48 +08:00
yoshiko2
50c3975b75 Add Donwload Mapping Table function 2021-11-05 00:49:19 +08:00
lededev
e564629f16 deal with websites behind Clo*dfl**e 2021-11-02 03:51:31 +08:00
lededev
3b498d32ca replace browser by session in some places 2021-11-01 03:49:35 +08:00
lededev
05a0838d86 UA update to chrome v95 2021-10-31 03:21:39 +08:00
lededev
921f926056 ADC_function.py: add browser retry and timeout 2021-10-23 05:21:08 +08:00
lededev
c440315488 翻译前检查语言,已经是中文了不必翻译,只翻译日语 2021-10-20 23:07:37 +08:00
lededev
cb83e4246d 无码检测移入number_parser.py并扩充识别能力 2021-10-20 03:34:44 +08:00
lededev
24b4f9f5e2 将元数据的来源网站记入日志以便进行评估 2021-10-18 10:51:32 +08:00
lededev
a546c4e83e Parall query on storyline data 2021-10-17 21:59:08 +08:00
lededev
7f8d500b13 correction mechanicalsoup browser with cookies calling method 2021-10-15 21:00:32 +08:00
lededev
317449c568 try fix issue 616: onedrive OSError input/output 2021-10-15 09:11:40 +08:00
lededev
f8dc05a38b improve javbus and javdb outline source 2021-10-12 11:28:17 +08:00
lededev
0933e87944 fix outline of javbus and javdb which caused by airav down 2021-10-10 17:41:33 +08:00
lededev
3873d1aa4c update user agent 2021-10-09 19:37:40 +08:00
lededev
8ab736e4fa AV_Data_Capture.py:command params new add -m -d -c -i -g -z 2021-10-08 13:02:52 +08:00
lededev
40d25d23f5 ADC_function.py:换装getInstance(),load_cookies()改用pathlib 2021-10-08 12:17:12 +08:00
lededev
531840c3fb 还有一点小bug,以及代码清理 2021-09-29 06:37:45 +08:00
Yoshiko2
256c711c6d Merge pull request #599 from lededev/ggt-conf
google translate site configurable
2021-09-28 13:58:08 +08:00
lededev
536ee3f6d8 google translate site configurable 2021-09-28 00:28:31 +08:00
lededev
b1d302a042 log fullpath 2021-09-28 00:26:01 +08:00