bacow/AV_Data_Capture
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,504 Commits 1 Branch 31 Tags
5af806017699dd20b33c096a649181dea9261d2a
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
lededev 5af8060176 link_mode small fix 2022-03-27 17:08:11 +08:00
lededev 12e8c88a07 javdb site 37,38 2022-03-27 17:07:37 +08:00
lededev 85ecff451c download_only_missing_images=1 do not cut exist image again 2022-03-27 17:06:46 +08:00
lededev fdc988a481 javdb.py:simplify again 2022-03-26 15:58:22 +08:00
lededev b585c0fbbd javdb.py:check empty str 2022-03-26 15:55:53 +08:00
lededev 00be6b86d5 JavDB: add User Rating to .NFO 2022-03-26 15:41:29 +08:00
lededev 30064745c6 dlsite.py: update to current website 2022-03-26 14:51:29 +08:00
lededev de7b982783 core.py:Copy subtitle files in link mode 2022-03-26 12:44:03 +08:00
lededev 068ab15f90 add hard link target option and command line switch 2022-03-26 11:39:43 +08:00
lededev 5c6e011489 number_parser.py:remove *.com@ and *.cc@ 2022-03-24 12:58:57 +08:00
lededev b6786ef9d7 fc2.py:fix some pages can not auto detect UTF-8 encoding 2022-03-06 21:20:20 +08:00
lededev 6b7e518fbe madou.py:fix get tags 2022-03-06 21:03:00 +08:00
lededev 8ad4997342 madou.py:simp by regex 2022-03-06 20:39:59 +08:00
lededev 3117b3a18d madou.py:fix get title for MAD039 2022-03-06 17:36:22 +08:00
lededev 31da166931 madou.py:fix get title for MD0140-2 2022-03-06 17:29:15 +08:00
lededev 788fc4a97c madou numbers MD0140-2 MD0165-8 2022-03-06 16:22:11 +08:00
lededev 1cecf66a84 support more madou numbers 2022-03-06 16:08:37 +08:00
lededev 48d14e19ae add madou and mv91 to website list 2022-03-06 01:37:09 +08:00
lededev 54d8f3af87 madou priority against javdb 2022-03-06 01:31:43 +08:00
lededev 6ffdf08bc8 vscode debug AttributeError: 'NoneType' object has no attribute 2022-03-03 06:44:38 +08:00
lededev c354518c57 vscode debug AttributeError: 'NoneType' object has no attribute 'flush' or 'fileno' 2022-02-26 15:37:05 +08:00
lededev a3c8398f29 fix OpenCC not work 2022-02-26 15:36:05 +08:00
lededev 592005be01 不再以字符串长度为限制条件 2022-02-17 17:19:47 +08:00
lededev ec28814449 update User-Agent 2022-02-17 17:18:41 +08:00
lededev 8bdc4fac46 filter 4K 2022-02-06 21:28:49 +08:00
lededev 8e9ea6d852 simp2 2021-11-14 09:24:49 +08:00
lededev b64dc83e2e simp 2021-11-14 08:58:27 +08:00
lededev 701cc954cb bugfix 2021-11-14 08:52:45 +08:00
lededev e025d9d99a 修正调试信息选中站点字数为0的错误提示 2021-11-10 01:22:48 +08:00
lededev 722c96b29a fix conflicts 2021-11-05 08:12:57 +08:00
lededev a9c4b0e417 parallel map download 2021-11-05 07:42:58 +08:00
lededev e8af0e5a53 Merge branch 'master' into storyline-3 2021-11-05 03:29:56 +08:00
lededev 744178d288 storyline:Japanese results should not be the highest priority 2021-11-05 03:19:26 +08:00
lededev 92effe53b7 storyline: still need improve 2021-11-05 02:59:48 +08:00
lededev 0622b8bda3 map function call local function 2021-11-03 20:14:06 +08:00
lededev 1863ccb1e2 fix when cookies path is None 2021-11-03 18:47:33 +08:00
lededev fffa78a2c4 code refactoring: replace some enumerate() with zip() 2021-11-02 07:18:07 +08:00
lededev e564629f16 deal with websites behind Clo*dfl**e 2021-11-02 03:51:31 +08:00
lededev 3786f58bb6 opencc need in pyinstaller --add-data 2021-11-01 05:07:53 +08:00
lededev 3b498d32ca replace browser by session in some places 2021-11-01 03:49:35 +08:00
lededev 0fe1b2fcac 新增繁简可选输出功能 2021-10-31 17:12:17 +08:00
lededev cc0d89805a 剧情简介:增加功能启用开关，因质量airavwiki取繁体简介 2021-10-31 15:40:39 +08:00
lededev 05a0838d86 UA update to chrome v95 2021-10-31 03:21:39 +08:00
lededev b67acd256b data from json 2021-10-31 02:51:30 +08:00
lededev a50af88409 storyline:add data source airavwiki 2021-10-31 00:09:05 +08:00
lededev 935d12f4dc refactor with enumerate 2021-10-30 13:03:36 +08:00
lededev b96b3c6481 remove semicolon 2021-10-24 18:43:04 +08:00
lededev 2f523ea540 剧照下载:只显示每个错误,如果全部成功只显示一行汇总,大幅精简日志 2021-10-24 01:31:24 +08:00
lededev 1cf1782a22 bug fix using pathlib mkdir -p 2021-10-24 01:04:23 +08:00
lededev 7bc667e3b9 avsox.py: call translateTag_to_sc() 2021-10-24 00:42:57 +08:00
lededev 90593b6d7a number_parser.py: uncensored number add heyzo 2021-10-24 00:08:32 +08:00
lededev e8eb3ff192 change download threads number configable default parallel_download=5 2021-10-23 21:05:49 +08:00
lededev 9c5db258ec clean up unused param 2021-10-23 20:42:27 +08:00
lededev 0758104e7a output error message also 2021-10-23 19:42:36 +08:00
lededev db1ad1d582 make download_one_file() more general 2021-10-23 19:28:20 +08:00
lededev 03954c3a35 map return result keeping the same order with args, no need sorted() 2021-10-23 19:19:38 +08:00
lededev 4e96d57204 extrafanart download speed 6x up by thread pool 2021-10-23 18:14:25 +08:00
lededev dbbfa72268 vscode debug program/cwd/args demo settings 2021-10-23 06:15:24 +08:00
lededev eaa9d51d00 clean up 2021-10-23 05:51:43 +08:00
lededev 921f926056 ADC_function.py: add browser retry and timeout 2021-10-23 05:21:08 +08:00
lededev 24ac95f365 storyline.py: fix debug output 2021-10-23 05:04:15 +08:00
lededev 414151b139 add original_title for config.ini [Name_Rule]location_rule and naming_rule 2021-10-22 18:44:14 +08:00
lededev d3eef993de storyline.py:剧情简介站点名称前增加序号，数字小的优先 2021-10-22 17:19:33 +08:00
lededev 99ae5bf996 三种调用接口保持一致性 2021-10-22 16:50:36 +08:00
lededev 850679705e 剧情简介:新增无码元数据站点，配置文件改为通用、有码、无码三种站点分列 2021-10-21 20:02:07 +08:00
lededev 1f9bf6b4c2 日志合并:三天之前的日志，合并为单日单个文件，以解决增量处理时小文件过多问题 2021-10-21 19:57:09 +08:00
lededev c440315488 翻译前检查语言，已经是中文了不必翻译，只翻译日语 2021-10-20 23:07:37 +08:00
lededev cb83e4246d 无码检测移入number_parser.py并扩充识别能力 2021-10-20 03:34:44 +08:00
lededev b025c51852 xcity.py:尝试获得中文剧情简介，没有则用原来的。修复tag数目不对，修复runtime不显示 2021-10-19 18:40:57 +08:00
lededev c3e9ab7957 avsox.py: 优化:完成精简 2021-10-19 17:08:00 +08:00
lededev 8559eea296 avsox.py: 元数据新增剧情介绍。优化:减少etree.fromstring高开销调用次数 2021-10-19 15:18:39 +08:00
lededev daf7f5e0a0 carib.py: 尝试获取中文剧情介绍 2021-10-19 15:14:15 +08:00
lededev aae4df73fa javbus.py: 清理过期代码 2021-10-19 01:00:50 +08:00
lededev 249884a27e javbus.py: 优化提速 2021-10-19 00:58:28 +08:00
lededev 5da134986a storyline.py: bug fix 2021-10-19 00:17:45 +08:00
lededev d80b2eeb7d javbus.py: 优化，修理无码片的导演、系列等字段 2021-10-19 00:14:26 +08:00
lededev dd106453f7 对标记为删除的tag进行清理 2021-10-19 00:03:51 +08:00
lededev 4428971135 javdb.py: 优化，修理getActorPhoto() 2021-10-18 19:52:42 +08:00
lededev 5ef16e3a6d 剧情简介新增运行模式run_mode, 0:顺序执行 1:线程池 2:进程池 2021-10-18 18:09:36 +08:00
lededev f553927913 提速，暂时屏蔽未实现的演员照片功能 javdb javbus 2021-10-18 17:58:21 +08:00
lededev 24b4f9f5e2 将元数据的来源网站记入日志以便进行评估 2021-10-18 10:51:32 +08:00
lededev c9b96f65ab one line file copy 2021-10-18 08:47:11 +08:00
lededev 56bbfe6f24 storyline.py: skip SequenceMatcher when number match 2021-10-17 23:25:19 +08:00
lededev 3420f918f5 fix ratio.txt log lost newline 2021-10-17 22:53:53 +08:00
lededev 6624ed7224 clean up 2021-10-17 22:47:49 +08:00
lededev bc3cda953d fix 2021-10-17 22:29:57 +08:00
lededev a546c4e83e Parall query on storyline data 2021-10-17 21:59:08 +08:00
lededev b006aee34d failed_list.txt keep order remove duplication 2021-10-17 21:21:12 +08:00
lededev 189f4db616 javdb:get faster benefit from http keep-alive 2021-10-15 21:16:48 +08:00
lededev 7f8d500b13 correction mechanicalsoup browser with cookies calling method 2021-10-15 21:00:32 +08:00
lededev 416e8be351 merge PR#612 2021-10-15 10:07:53 +08:00
lededev 317449c568 try fix issue 616: onedrive OSError input/output 2021-10-15 09:11:40 +08:00
lededev f26987ddf9 move into try block 2021-10-12 11:42:30 +08:00
lededev c0a4ce638c call moveFailedFolder when empty number on debug branch 2021-10-12 11:29:53 +08:00
lededev f8dc05a38b improve javbus and javdb outline source 2021-10-12 11:28:17 +08:00
lededev 678a8f9bc8 Add signal handler 2021-10-11 10:24:46 +08:00
lededev e5abac9138 add download_only_missing_image config item 2021-10-10 18:02:53 +08:00
lededev 0933e87944 fix outline of javbus and javdb which caused by airav down 2021-10-10 17:41:33 +08:00
lededev b0959d1b18 javdb:无有效期内cookies文件时，随机选择一个站点 2021-10-09 20:29:17 +08:00
lededev d010ea6d51 清理全部conf穿梭参数 2021-10-09 19:42:11 +08:00