Commit Graph
100 Commits
Author SHA1 Message Date
lededev a405c5c41b WebCrawler:全面换装getInstance(),厘清airav.py与javbus.py及javdb.py的相爱相杀 2021-10-08 11:46:35 +08:00
lededev cf072e79d1 输出排版优化,number放在左边固定位置,上一行的留白以便迅速定位 2021-10-08 11:29:47 +08:00
lededev 8cb57673b0 log auto merge 2021-10-08 11:15:30 +08:00
lededev 39ad025760 config.py:override config settings by cmd params, pyinstaller add config.ini 2021-10-08 10:22:05 +08:00
lededev 3183d284b7 number_parser.py:add more studio, unit test, full disk search as unit test 2021-10-08 08:33:03 +08:00
lededev 5df0339279 用normpath()才能维持原来的大小写,normcase()会全部变为小写 2021-10-04 23:57:16 +08:00
lededev 952e2c9a30 所有makedirs()失败做相同处理 2021-10-03 10:59:25 +08:00
lededev 6d1e99d8ab fix issue 603 2021-10-03 10:44:57 +08:00
lededev 8ef87c285f 再将其它几个makedirs()一起修正,去掉错上加错的提升到admin建议信息 2021-10-03 10:43:54 +08:00
lededev f52db0011c optimize if logic 2021-10-03 10:21:47 +08:00
lededev f21fdcb5f5 log dir adapts to makedirs(), fix CmdLine output 2021-10-03 09:53:09 +08:00
lededev ccf187245c soft_link mode .nfo check loop fix 2021-09-30 08:31:01 +08:00
lededev 0aa4c7d76c javdb.py:javdbx.json bugfix, find path before check days 2021-09-30 06:29:29 +08:00
lededev 531840c3fb 还有一点小bug,以及代码清理 2021-09-29 06:37:45 +08:00
lededev 3e1d951af8 去掉返回值为空的tag 2021-09-28 18:36:20 +08:00
lededev b5b2e7f0d8 由于目前程序未实现演员照片功能,暂时屏蔽以提升速度 2021-09-28 18:31:20 +08:00
lededev b5d6c7fe4f 日志内前后增加完整日期时间戳以便日志合并 2021-09-28 18:30:50 +08:00
lededev ef1c816483 修改运行计时为时分秒增加可读性,小数点保留3位以便区分定位到秒 2021-09-28 17:55:06 +08:00
lededev a20bfc08b0 small optimization of log feature 2021-09-28 17:32:31 +08:00
lededev 536ee3f6d8 google translate site configurable 2021-09-28 00:28:31 +08:00
lededev b1d302a042 log fullpath 2021-09-28 00:26:01 +08:00
lededev 75b71888d9 javdb*.json path search order 2021-09-27 22:20:37 +08:00
lededev afc0118830 由调用flush()改为hook print() 2021-09-27 06:39:47 +08:00
lededev d7aea9a09d 双重异常有时会生成两条相同记录,用集合去重写回,并利用集合提升查询速度 2021-09-27 04:34:41 +08:00
lededev 9304aab940 外层也调用moveFailedFolder()函数来处理 2021-09-27 03:56:59 +08:00
lededev 3ef0db1890 每完成一部影片刷新一下输出,以免等到程序结束才看到日志内容 2021-09-27 03:23:33 +08:00
lededev cc36562c17 add config path search order 2021-09-27 01:05:24 +08:00
lededev d7197d8b8c 日志信息包含命令行参数 2021-09-26 19:49:24 +08:00
lededev 620affc987 add param -q regex query filepath 2021-09-26 19:20:20 +08:00
lededev 161f4063b9 fc2.py: update 2021-09-26 11:38:48 +08:00
lededev 948a3d20b0 输出内容更详细一些 2021-09-26 09:49:28 +08:00
lededev 6a4739c035 fix file close, add moving list 2021-09-26 09:07:19 +08:00
lededev ecd5c7de1c 小清理,优化代码排版 2021-09-26 07:43:57 +08:00
lededev bf5bd5d444 增量整理修改为适用于所有模式 2021-09-26 06:35:35 +08:00
lededev c6efec91dd 新增失败文件列表以避免重复刮削,模式3与软连接适用 2021-09-26 04:25:25 +08:00
lededev e87f5b7a1f Path().parent is a better way in here 2021-09-26 02:07:33 +08:00
lededev 911f43cd5c 路径分隔符方向保持一致输出会更美观 2021-09-26 01:23:44 +08:00
lededev 16078b95b1 解决一个视频文件名不带,而.nfo文件名带'-流出'的死循环bug 2021-09-26 00:35:00 +08:00
lededev aae5b0a8d3 using makedirs() 2021-09-25 23:45:55 +08:00
lededev 6834b7d215 help output format 2021-09-25 23:14:57 +08:00
lededev 184230f934 supplementary explanation in --help 2021-09-25 22:57:48 +08:00
lededev 4fbb6454c0 show default --log-dir for current user in --help 2021-09-25 22:41:12 +08:00
lededev bdbd97149f turn on log by default, to turn off by '--log-dir=' 2021-09-25 22:26:21 +08:00
lededev 4ffc34a5cf xcity on top when number similar ABP321 2021-09-25 20:54:07 +08:00
lededev 0ca57fa8c1 add Google-free translate failed warnning 2021-09-25 19:31:53 +08:00
lededev 37869f58e7 新功能:1.模式3增量整理 2.保存运行及错误日志到目录 2021-09-25 18:56:18 +08:00
lededev 43bb64d7d0 xcity.py: Strictly limit the number 2021-09-25 06:53:40 +08:00
lededev 6c990e8482 xcity.py: Mode 3 requires the file name to remain unchanged 2021-09-25 06:45:08 +08:00
lededev c41df40e9f replace special characters after translate, null str do not write back 2021-09-24 01:11:25 +08:00
lededev c7b83bfc0e update user agent 2021-09-23 22:20:25 +08:00
lededev 50574a705b carib.py: add outline/series/actor_photo 2021-09-23 15:45:00 +08:00
lededev 5e0e8b9cea WebCrawler site list in default config.ini larger than 60 2021-09-23 15:43:00 +08:00
lededev 54ed626294 remove abs_url(), just urljoin() is enough 2021-09-23 08:21:01 +08:00
lededev c599463409 rewrite getActorPhoto() to get real photo 2021-09-23 07:58:53 +08:00
lededev c32a4a12ac speed up by reusing stateful browser 2021-09-23 07:01:24 +08:00
lededev 367d53b09b add param allow return stateful browser for follow_link() 2021-09-23 05:10:43 +08:00
lededev d6677b717d check add cookies 2021-09-23 03:56:55 +08:00
lededev 446eb166a3 requests-2.26.0 need by MechanicalSoup-1.1.0 2021-09-22 06:13:20 +08:00
lededev b59b4938d6 xcity.py: get detail page by form query 2021-09-22 06:03:58 +08:00
lededev efc94917a6 shorter str formatting 2021-09-22 00:47:15 +08:00
lededev 12159abba7 reduce 2 lines 2021-09-22 00:25:07 +08:00
lededev 21a3c9fd02 config.py: unit test dump all items 2021-09-21 23:45:25 +08:00
lededev 3bbcc52aee fix across volume moving 2021-09-21 19:44:06 +08:00
lededev d368d061f2 replace special characters in outline json node 2021-09-19 17:53:18 +08:00
lededev d409e5006b improve the judgment method of the same directory 2021-09-19 03:11:46 +08:00
lededev 9d1c6e9ca0 javbus on top 2021-09-17 22:46:49 +08:00
lededev d4f6abe1be special characters replacement in all json text nodes 2021-09-15 17:29:05 +08:00
lededev 1b93fcfecc as local function 2021-09-12 23:51:58 +08:00
lededev 4d86003c13 better config unit test output 2021-09-12 23:43:21 +08:00
lededev c40be3e5a9 CLI version depends on python 3.7 2021-09-04 10:29:55 +08:00
lededev 631dee6d9a change to global variables to avoid repeated compilling in recursion 2021-09-03 19:47:12 +08:00
lededev 757e930a50 precompile and search 2021-09-03 19:30:52 +08:00
lededev f9433e589f mode 3 also need check this match pattern 2021-09-03 19:10:49 +08:00
lededev a98ba439bc ignore -trailer video files 2021-09-03 18:49:52 +08:00
lededev 033b1c498e rewrite rm_empty_folder, add option in config.ini 2021-08-16 00:21:18 +08:00
lededev 50c4be28c2 Add media format suffixes .mpg .m4v support 2021-08-13 04:45:06 +08:00
lededev f8cf813d83 Make mode 3 run through 2021-08-13 03:12:07 +08:00
lededev 27e47334ea minor correction 2021-07-16 13:54:24 +08:00
lededev 1c759e713e number_parser:add x-art support 2021-07-16 13:23:29 +08:00
lededev f51d91b227 try another domain name 2021-07-15 12:34:21 +08:00
lededev d771b4e985 javdb:always include over18 cookies 2021-07-15 12:18:55 +08:00
lededev 7048a3254c all http requests using the same user-agent 2021-07-15 10:39:41 +08:00
lededev 34b0d37748 simplified using assignment expressions, new feature in python 3.8 2021-07-10 14:51:25 +08:00
lededev 996ee5609f up 2021-07-04 17:36:32 +08:00
lededev d14b315e53 tuple as return values in type annotation 2021-07-04 17:29:17 +08:00
lededev 5bd044dc61 javdb:only accept unique number 2021-06-29 02:13:46 +08:00
lededev 15aa0a5198 use path.join() to avoid // path complaints 2021-06-26 18:21:01 +08:00
lededev 9cd4b35ea0 call Config() one time and assign refence 2021-06-26 16:18:43 +08:00
lededev a31673d07c core.py:remove useless shuttle parameters 2021-06-26 02:45:43 +08:00
lededev eb1d577f00 core.py:moveFailedFolder() just the same action as in ADC_function.py 2021-06-26 01:55:26 +08:00
lededev d37b06f38b cover copy path fix 2021-06-18 16:22:48 +08:00
lededev fa49a14a0f simplify again 2021-06-14 13:29:58 +08:00
lededev 8020d24226 optimize code logic and tighten restrictions 2021-06-14 12:56:43 +08:00
lededev 4c1a0f80c1 improve processing speed by priority of using local watermark images 2021-06-14 12:28:39 +08:00
lededev 3cce315100 convert image relative url to absolute url 2021-06-11 13:53:08 +08:00
lededev 36c734ca9e upgrade User-Agent string to current Chrome version 2021-06-06 05:57:22 +08:00
lededev 9072f8b5ec use str startswith() 2021-06-06 05:14:13 +08:00
lededev ac22fcdf05 optimize code logic 2021-06-06 05:06:42 +08:00
lededev e2cd1f09df check uri not start with / 2021-06-06 04:57:24 +08:00
lededev 5abeb360af if not start with http 2021-06-06 04:46:59 +08:00