Skip to content

fix(torrent): sync .torrent file when copy/move/rename/upload#2522

Open
PIKACHUIM wants to merge 3 commits into
mainfrom
fix-torrent
Open

fix(torrent): sync .torrent file when copy/move/rename/upload#2522
PIKACHUIM wants to merge 3 commits into
mainfrom
fix-torrent

Conversation

@PIKACHUIM

Copy link
Copy Markdown
Member

feat(driver): extend 189pc generate_torrent to Copy/Move/Rename/FastUpload/RapidUploadFromTorrent

Summary / 摘要

扩展 drivers/189pcgenerate_torrent 功能,使其不再仅在 StreamUpload 时生成种子文件,而是覆盖以下场景:

  • FastUpload:补齐 SHA-1 piece hash 计算,上传完成后异步生成并上传 .cas.torrent 文件
  • Copy(云端复制):复制成功后,检查源目录是否存在同名 .cas.torrent,存在则跟随复制到目标目录
  • Move(云端移动):移动成功后,检查源目录是否存在同名 .cas.torrent,存在则跟随移动到目标目录
  • Rename(重命名):重命名成功后,检查同目录是否存在旧名 .cas.torrent,存在则跟随重命名为新名 .cas.torrent
  • RapidUploadFromTorrent(从 torrent 秒传):秒传成功后,将已有的 torrent 数据上传到目标目录

设计原则

操作类型 是否经过本地 是否生成/搬运 torrent 说明
StreamUpload ✅ 生成 已有逻辑,不变
FastUpload ✅ 生成 新增:补齐 SHA-1 计算后生成
RapidUploadFromTorrent ✅(已有数据) ✅ 上传 新增:秒传后上传已有 torrent
Copy(云端) ✅ 跟随复制 新增:复制已有 .cas.torrent
Move(云端) ✅ 跟随移动 新增:移动已有 .cas.torrent
Rename ✅ 跟随重命名 新增:重命名已有 .cas.torrent
RapidUpload(普通秒传) 不涉及哈希计算,不生成
快速移动/复制(跨存储下载再上传) 由上传路径决定 走 StreamUpload/FastUpload 时自动生成
  • 纯云端操作(Copy/Move/Rename)不重新计算哈希,仅跟随搬运已有的 .cas.torrent 文件
  • 所有 torrent 相关操作均为异步执行(goroutine),不影响主操作的返回结果和性能
  • 所有操作均受 GenerateTorrent 配置项控制,未开启时无任何额外开销

变更文件

  • drivers/189pc/driver.go:在 MoveRenameCopy 方法中添加 torrent 跟随逻辑调用

  • drivers/189pc/utils.go:在 FastUpload 中补齐 SHA-1 piece hash 计算并异步生成 torrent

  • drivers/189pc/torrent.go:新增 torrentFollowCopytorrentFollowMovetorrentFollowRename 函数;RapidUploadFromTorrent 秒传成功后异步上传 torrent 文件

  • This PR has breaking changes.
    / 此 PR 包含破坏性变更。

  • This PR changes public API, config, storage format, or migration behavior.
    / 此 PR 修改了公开 API、配置、存储格式或迁移行为。

  • This PR requires corresponding changes in related repositories.
    / 此 PR 需要关联仓库同步修改。

Related repository PRs / 关联仓库 PR:

  • OpenList-Frontend: N/A
  • OpenList-Docs: N/A

Related Issues / 关联 Issue

N/A

Testing / 测试

  • go test ./...
  • Manual test / 手动测试:
    • 上传文件(StreamUpload)验证 torrent 生成(已有逻辑,回归测试)
    • 上传文件(FastUpload,文件流支持随机读取)验证 torrent 生成
    • 从 torrent 秒传(RapidUploadFromTorrent)验证 torrent 文件被上传到目标目录
    • 复制已有 .cas.torrent 的文件,验证 torrent 被跟随复制
    • 移动已有 .cas.torrent 的文件,验证 torrent 被跟随移动
    • 重命名已有 .cas.torrent 的文件,验证 torrent 被跟随重命名
    • 关闭 GenerateTorrent 配置项,验证以上操作均无额外行为

Checklist / 检查清单

  • I have read CONTRIBUTING.
    / 我已阅读 CONTRIBUTING
  • I confirm this contribution follows the repository license, contribution policy, and code of conduct.
    / 我确认此贡献符合仓库许可证、贡献规范和行为准则。
  • I have formatted the changed code with gofmt, go fmt, or prettier where applicable.
    / 我已按适用情况使用 gofmtgo fmtprettier 格式化变更代码。
  • I have requested review from relevant maintainers or code owners where applicable.
    / 我已在适用情况下请求相关维护者或代码所有者审查。

AI Disclosure / AI 使用声明

  • This PR includes AI-assisted content.
    / 此 PR 包含 AI 辅助内容。

Tools used / 使用工具:

  • ChatGPT
  • Codex
  • GitHub Copilot
  • Claude
  • Gemini
  • Other (please specify) / 其他(请注明):

Usage scope / 使用范围:

  • Code generation / 代码生成

  • Refactoring / 重构

  • Documentation / 文档

  • Tests / 测试

  • Translation / 翻译

  • Review assistance / 审查辅助

  • I have reviewed and validated all AI-assisted content included in this PR.
    / 我已审核并验证此 PR 中的所有 AI 辅助内容。

  • I have ensured that all AI-assisted commits include Co-Authored-By attribution.
    / 我已确保所有 AI 辅助提交都包含 Co-Authored-By 归属信息。

  • I can reproduce all AI-assisted content included in this PR without any AI tools.
    / 我可以在没有任何 AI 工具的情况下重现此 PR 中包含的所有 AI 辅助内容。

@PIKACHUIM PIKACHUIM enabled auto-merge (squash) June 12, 2026 03:38
@PIKACHUIM PIKACHUIM requested a review from jyxjjj June 12, 2026 03:39
@jyxjjj

jyxjjj commented Jun 12, 2026

Copy link
Copy Markdown
Member

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 1a13cca1b3

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread drivers/189pc/utils.go
Reader: bytes.NewReader(torrentData),
Mimetype: "application/x-bittorrent",
}
_, uploadErr := y.fastUpload(context.Background(), capturedDstDir, torrentFileStream, func(p float64) {}, capturedIsFamily, false, false)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Preserve overwrite behavior for generated torrents

When uploading over an existing file, Put passes overwrite=true for the main upload, but this sidecar upload always uses overwrite=false. In that scenario an existing <name>.cas.torrent is not replaced (or may conflict/duplicate, depending on the provider), so the visible sidecar can keep pointing at the old file content even though the data file was overwritten. Capture and pass the original overwrite value here so the generated CAS torrent stays in sync with the upload.

Useful? React with 👍 / 👎.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR extends the 189pc driver’s “generate torrent” behavior so that .cas.torrent files are generated or “followed” across additional operations (FastUpload, RapidUploadFromTorrent, Copy/Move/Rename), aiming to keep torrent sidecar files in sync without blocking the main operation (async goroutines).

Changes:

  • Extend FastUpload to compute SHA-1 piece hashes and asynchronously generate/upload the .cas.torrent sidecar.
  • After RapidUploadFromTorrent, asynchronously upload the provided torrent data as <filename>.cas.torrent.
  • After cloud Copy/Move/Rename, asynchronously copy/move/rename an existing .cas.torrent sidecar when present.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 7 comments.

File Description
drivers/189pc/utils.go Adds parent-id stamping on list results; extends FastUpload to optionally compute SHA-1 piece hashes and async-generate/upload torrent
drivers/189pc/types.go Adds ParentId field to Cloud189File for use by follow operations
drivers/189pc/torrent.go Adds async “follow copy/move/rename” helpers; RapidUploadFromTorrent uploads torrent sidecar after success
drivers/189pc/driver.go Hooks torrent-follow helpers into Move/Copy/Rename

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread drivers/189pc/utils.go
Comment on lines +989 to +992
// 收集 SHA-1 piece hash
if generateTorrent && sha1Writer != nil {
pieceSHA1Hashes = append(pieceSHA1Hashes, sha1Writer.Sum(nil)...)
}
Comment thread drivers/189pc/utils.go
Comment on lines +1109 to +1111
// 生成 torrent 文件(异步,不影响上传结果)
if generateTorrent && len(pieceSHA1Hashes) > 0 {
capturedDstDir := dstDir
Comment thread drivers/189pc/torrent.go
Comment on lines +346 to +350
torrentFile, err := y.findFileByName(context.Background(), torrentName, srcFolderId, isFamily)
if err != nil {
// torrent 文件不存在,忽略
return
}
Comment thread drivers/189pc/torrent.go
Comment on lines +384 to +388
torrentFile, err := y.findFileByName(context.Background(), torrentName, srcFolderId, isFamily)
if err != nil {
// torrent 文件不存在,忽略
return
}
Comment thread drivers/189pc/torrent.go
Comment on lines +421 to +425
torrentFile, err := y.findFileByName(context.Background(), oldTorrentName, folderId, isFamily)
if err != nil {
// torrent 文件不存在,忽略
return
}
Comment thread drivers/189pc/torrent.go
Comment on lines +401 to +402
_ = y.WaitBatchTask("MOVE", resp.TaskID, time.Millisecond*400)
}()
Comment thread drivers/189pc/types.go
Comment on lines 168 to +173
type Cloud189File struct {
ID String `json:"id"`
Name string `json:"name"`
Size int64 `json:"size"`
Md5 string `json:"md5"`
ID String `json:"id"`
Name string `json:"name"`
Size int64 `json:"size"`
Md5 string `json:"md5"`
ParentId string `json:"-"` // 由 getFiles 设置,不从 JSON 解析
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants