Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

docker 0.3.4版提示: 检测到同名文件，文件内容完全一致，无需重复上传 #461

Open
tracking opened this issue Oct 19, 2024 · 0 comments
Open

docker 0.3.4版提示: 检测到同名文件，文件内容完全一致，无需重复上传 #461

tracking opened this issue Oct 19, 2024 · 0 comments

Comments

@tracking
Copy link

tracking commented Oct 19, 2024 •
edited
Loading

docker 0.3.4版提示: 检测到同名文件，文件内容完全一致，无需重复上传

但实际文件内容是不同的. 我从老版本更新上来后发现每日备份有好几天没上传, 查看后发现有这个问题

environment:

# 时区，东8区
- TZ=Asia/Shanghai
# 下载文件并发数
- ALIYUNPAN_DOWNLOAD_PARALLEL=2
# 上传文件并发数
- ALIYUNPAN_UPLOAD_PARALLEL=2
# 下载数据块大小，单位为KB，默认为10240KB，建议范围1024KB~10240KB
- ALIYUNPAN_DOWNLOAD_BLOCK_SIZE=1024
# 上传数据块大小，单位为KB，默认为10240KB，建议范围1024KB~10240KB
- ALIYUNPAN_UPLOAD_BLOCK_SIZE=10240
# 指定网盘文件夹作为备份目录，不要指定根目录
- ALIYUNPAN_PAN_DIR=/备份/MINIPC
# 备份模式：upload(备份本地文件到云盘), download(备份云盘文件到本地), sync(双向同步备份)
- ALIYUNPAN_SYNC_MODE=upload
# 备份策略: exclusive(排他备份文件，目标目录多余的文件会被删除),increment(增量备份文件，目标目录多余的文件不会被删除)
- ALIYUNPAN_SYNC_POLICY=increment
# 备份周期, 支持两种: infinity(永久循环备份),onetime(只运行一次备份)
- ALIYUNPAN_SYNC_CYCLE=infinity
# 网盘：backup(备份盘), resource(资源盘)
- ALIYUNPAN_SYNC_DRIVE=backup
# 是否显示文件备份过程日志，true-显示，false-不显示
- ALIYUNPAN_SYNC_LOG=true
# 本地文件修改检测延迟间隔，单位秒。如果本地文件会被频繁修改，例如录制视频文件，配置好该时间可以避免上传未录制好的文件
- ALIYUNPAN_LOCAL_DELAY_TIME=3
# 调试日志
- ALIYUNPAN_VERBOSE=1

logs:

app-1  | using existed sync_drive_config.json file
app-1  | [2024-10-19 17:55:36.914] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:36.914] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:36.920] do request url: https://openapi.alipan.com/adrive/v1.0/user/getDriveInfo
app-1  | [2024-10-19 17:55:37.084] do request url: https://openapi.alipan.com/business/v1.0/user/getVipInfo
app-1  | [2024-10-19 17:55:37.145] do request url: https://openapi.alipan.com/adrive/v1.0/user/getSpaceInfo
app-1  | 内网IP地址: 
app-1  | 127.0.0.1
app-1  | ::1
app-1  | 192.168.240.2
app-1  | 
app-1  | 公网IP地址: 180.158.117.242
app-1  | [2024-10-19 17:55:37.372] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:37.372] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:37.373] do request url: https://openapi.alipan.com/adrive/v1.0/user/getDriveInfo
app-1  | [2024-10-19 17:55:37.499] do request url: https://openapi.alipan.com/business/v1.0/user/getVipInfo
app-1  | [2024-10-19 17:55:37.568] do request url: https://openapi.alipan.com/adrive/v1.0/user/getSpaceInfo
app-1  | [2024-10-19 17:55:37.680] do request url: https://openapi.alipan.com/adrive/v1.0/user/getDriveInfo
app-1  | [2024-10-19 17:55:37.750] do request url: https://openapi.alipan.com/business/v1.0/user/getVipInfo
app-1  | [2024-10-19 17:55:37.808] do request url: https://openapi.alipan.com/adrive/v1.0/user/getSpaceInfo
app-1  | 当前帐号UID: **mask**, 昵称: **mask**, 三方权益包: 未开通, 当前使用网盘：备份盘
app-1  | cache token is valid, not need to re-login
app-1  | [2024-10-19 17:55:37.921] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:37.921] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:37.922] do request url: https://openapi.alipan.com/adrive/v1.0/user/getDriveInfo
app-1  | [2024-10-19 17:55:38.053] do request url: https://openapi.alipan.com/business/v1.0/user/getVipInfo
app-1  | [2024-10-19 17:55:38.117] do request url: https://openapi.alipan.com/adrive/v1.0/user/getSpaceInfo
app-1  |   名称                   值                        建议值                        描述                                                                                          
app-1  |   cache_size             0B                        1KB ~ 256KB                   下载缓存, 如果硬盘占用高或下载速度慢, 请尝试调大此值                                          
app-1  |   max_download_parallel  0                         1 ~ 20                        最大下载并发量，即同时下载文件最大数量                                                        
app-1  |   max_upload_parallel    0                         1 ~ 20                        最大上传并发量，即同时上传文件最大数量                                                        
app-1  |   max_download_rate      不限制                                                  限制单个文件最大下载速度, 0代表不限制                                                         
app-1  |   max_upload_rate        不限制                                                  限制单个文件最大上传速度, 0代表不限制                                                         
app-1  |   savedir                /root/Downloads                                         下载文件的储存目录                                                                            
app-1  |   proxy                                                                          设置代理, 支持 http/socks5 代理，例如: http://127.0.0.1:8888 或者 socks5://127.0.0.1:8889     
app-1  |   local_addrs                                                                    绑定本地网卡地址, 多个地址用逗号隔开，支持网口名称，例如: 127.0.0.1,192.168.100.126,en0,eth0  
app-1  |   ip_type                ipv4                      ipv4-优先IPv4，ipv6-优先IPv6  设置域名解析IP优先类型。修改后需要重启应用生效                                                
app-1  |   file_record_config     开启                      1-开启，2-禁用                设置是否开启上传、下载、同步文件的结果记录，开启后会把结果记录到CSV文件方便后期查看           
app-1  |   device_id              **mask**                                客户端ID，用于标识登录客户端，阿里单个账号最多允许10个客户端同时在线。修改后需要重启应用生效  
app-1  | 
app-1  | 保存配置成功!
app-1  | 
app-1  | [2024-10-19 17:55:38.226] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.226] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.227] do request url: https://openapi.alipan.com/adrive/v1.0/user/getDriveInfo
app-1  | [2024-10-19 17:55:38.343] do request url: https://openapi.alipan.com/business/v1.0/user/getVipInfo
app-1  | [2024-10-19 17:55:38.400] do request url: https://openapi.alipan.com/adrive/v1.0/user/getSpaceInfo
app-1  |   名称                   值                        建议值                        描述                                                                                          
app-1  |   cache_size             0B                        1KB ~ 256KB                   下载缓存, 如果硬盘占用高或下载速度慢, 请尝试调大此值                                          
app-1  |   max_download_parallel  0                         1 ~ 20                        最大下载并发量，即同时下载文件最大数量                                                        
app-1  |   max_upload_parallel    0                         1 ~ 20                        最大上传并发量，即同时上传文件最大数量                                                        
app-1  |   max_download_rate      不限制                                                  限制单个文件最大下载速度, 0代表不限制                                                         
app-1  |   max_upload_rate        不限制                                                  限制单个文件最大上传速度, 0代表不限制                                                         
app-1  |   savedir                /root/Downloads                                         下载文件的储存目录                                                                            
app-1  |   proxy                                                                          设置代理, 支持 http/socks5 代理，例如: http://127.0.0.1:8888 或者 socks5://127.0.0.1:8889     
app-1  |   local_addrs                                                                    绑定本地网卡地址, 多个地址用逗号隔开，支持网口名称，例如: 127.0.0.1,192.168.100.126,en0,eth0  
app-1  |   ip_type                ipv4                      ipv4-优先IPv4，ipv6-优先IPv6  设置域名解析IP优先类型。修改后需要重启应用生效                                                
app-1  |   file_record_config     开启                      1-开启，2-禁用                设置是否开启上传、下载、同步文件的结果记录，开启后会把结果记录到CSV文件方便后期查看           
app-1  |   device_id              0wwx3lJtHulCyzmA0uFEl37K                                客户端ID，用于标识登录客户端，阿里单个账号最多允许10个客户端同时在线。修改后需要重启应用生效  
app-1  | 
app-1  | 保存配置成功!
app-1  | 
app-1  | [2024-10-19 17:55:38.511] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.511] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.512] do request url: https://openapi.alipan.com/adrive/v1.0/user/getDriveInfo
app-1  | [2024-10-19 17:55:38.639] do request url: https://openapi.alipan.com/business/v1.0/user/getVipInfo
app-1  | [2024-10-19 17:55:38.699] do request url: https://openapi.alipan.com/adrive/v1.0/user/getSpaceInfo
app-1  | [2024-10-19 17:55:38.791] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.791] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | 启动同步备份进程
app-1  | 备份配置文件：/home/app/config/sync_drive/sync_drive_config.json
app-1  | 下载并发：2
app-1  | 上传并发：2
app-1  | 下载分片大小：1.00MB
app-1  | 上传分片大小：10.00MB
app-1  | [2024-10-19 17:55:38.796] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/get_by_path
app-1  | [2024-10-19 17:55:38.887] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.888] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.888] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | [2024-10-19 17:55:38.889] use config dir from ALIYUNPAN_CONFIG_DIR env:  /home/app/config
app-1  | 
app-1  | 启动同步任务
app-1  | 任务: 阿里云盘备份(**mask**)
app-1  | 同步模式: 备份本地文件（上传）
app-1  | 同步策略: 增量备份（只上传）
app-1  | 运行周期: 永久循环
app-1  | 本地目录: /home/app/data
app-1  | 云盘目录: /备份/MINIPC
app-1  | 目标网盘: 备份盘
app-1  | 
app-1  | [2024-10-19 17:55:38.894] start scan local file process at  2024-10-19 17:55:38
app-1  | [2024-10-19 17:55:38.894] start file execute task at  2024-10-19 17:55:38
app-1  | 开始进行文件扫描...
app-1  | 扫描到本地文件：/home/app/data/gitlab
app-1  | [2024-10-19 17:55:38.895] update local file to db:  {"fileName":"gitlab","fileSize":4096,"fileType":"folder","createdAt":"2024-10-19 17:54:42","updatedAt":"2024-10-19 17:54:42","fileExtension":"","sha1Hash":"","path":"/home/app/data/gitlab","scanTimeAt":"2024-10-19 17:55:38","scanStatus":"normal"}
app-1  | [2024-10-19 17:55:38.896] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/get_by_path
app-1  | [2024-10-19 17:55:38.964] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/list
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention10.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention11.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention12.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention13.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention14.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention15.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention16.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention17.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention18.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention19.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention20.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention21.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention22.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention23.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention24.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention25.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention26.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention27.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention28.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention29.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention4.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention5.7z
app-1  | [2024-10-19 17:55:39.086] update local file to db:  {"fileName":"gitlab-retention5.7z","fileSize":354786852,"fileType":"file","createdAt":"2024-10-19 17:54:42","updatedAt":"2024-10-19 17:54:42","fileExtension":".7z","sha1Hash":"","path":"/home/app/data/gitlab/gitlab-retention5.7z","scanTimeAt":"2024-10-19 17:55:39","scanStatus":"normal"}
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention6.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention7.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention8.7z
app-1  | 扫描到本地文件：/home/app/data/gitlab/gitlab-retention9.7z
app-1  | [2024-10-19 17:55:39.087] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/get_by_path
app-1  | 本命令不会退出，程序正在以Docker的方式运行。如需退出请借助Docker提供的方式。
app-1  | [2024-10-19 17:55:39.164] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/list
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention4.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention10.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention19.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention20.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention14.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention22.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention6.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention7.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention23.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention9.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention24.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention15.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention12.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention11.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention25.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention21.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention28.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention18.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention13.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention16.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention27.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention17.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention8.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention29.7z
app-1  | [2024-10-19 17:55:39.279] file is the same, no need to upload file:  /home/app/data/gitlab/gitlab-retention26.7z
app-1  | 上传文件：/home/app/data/gitlab/gitlab-retention5.7z
app-1  | [2024-10-19 17:55:44.304] file action task： {"action":"upload","status":"create","localFile":{"fileName":"gitlab-retention5.7z","fileSize":354786852,"fileType":"file","createdAt":"2024-10-19 17:54:42","updatedAt":"2024-10-19 17:54:42","fileExtension":".7z","sha1Hash":"","path":"/home/app/data/gitlab/gitlab-retention5.7z","scanTimeAt":"2024-10-19 17:55:39","scanStatus":"normal"},"panFile":null,"localFolderPath":"/home/app/data","panFolderPath":"/备份/MINIPC","statusUpdateTime":"","driveId":"94374456","downloadRange":null,"downloadBlockSize":1048576,"uploadRange":null,"uploadEntity":null,"uploadPartSeq":0,"uploadBlockSize":10485760}
app-1  | [2024-10-19 17:55:44.304] 检测云盘文件夹: /备份/MINIPC/gitlab
app-1  | [2024-10-19 17:55:44.304] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/get_by_path
app-1  | [2024-10-19 17:55:44.403] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/create
app-1  | [2024-10-19 17:55:44.548] PreHash not match, upload file directly
app-1  | [2024-10-19 17:55:44.548] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/get_by_path
app-1  | [2024-10-19 17:55:44.640] 检测到同名文件，文件内容完全一致，无需重复上传: /备份/MINIPC/gitlab/gitlab-retention5.7z
app-1  | [2024-10-19 17:55:44.647] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/get_by_path
app-1  | [2024-10-19 17:55:49.596] file execute task is finish, exit normally
app-1  | 完成全部文件的同步上传，等待下一次扫描
@tracking tracking changed the title docker 0.34版提示: 检测到同名文件，文件内容完全一致，无需重复上传 docker 0.3.4版提示: 检测到同名文件，文件内容完全一致，无需重复上传 Oct 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tracking