Skip to content

[Fix][admin] Fix resource same-name overwrite not refreshing local rs cache - #4565

Open
fancy27 wants to merge 1 commit into
DataLinkDC:devfrom
fancy27:Fix-rs-local-cache-overwrite
Open

[Fix][admin] Fix resource same-name overwrite not refreshing local rs cache#4565
fancy27 wants to merge 1 commit into
DataLinkDC:devfrom
fancy27:Fix-rs-local-cache-overwrite

Conversation

@fancy27

@fancy27 fancy27 commented Jul 30, 2026

Copy link
Copy Markdown

Summary

  • Invalidate tmp/rs local cache after resource same-name overwrite / delete so OSS/HDFS updates are picked up
  • Rewrite rs:// local files atomically (delete + temp download + move) and disable URL caches to avoid stale JarFile/ClassLoader content in Session modes
  • Fix parent directory size accounting on overwrite (use size delta instead of always adding)

Test plan

  • Upload a jar to Resource Center (OSS), run a Flink Jar task on kubernetes-session referencing rs:/...
  • Overwrite the same jar with a different version; confirm tmp/rs/... is removed/updated after upload
  • Re-run the task without restarting Dinky; confirm the new jar behavior is used
  • Delete the resource and confirm local tmp/rs cache for that path is cleared

… cache

Invalidate tmp/rs after overwrite/delete, rewrite local cache atomically on
rs:// load, and correct parent size delta on overwrite so session jobs do not
keep using stale jars.

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant