hooks/pyramid_attention_broadcast: remove redundant iteration==0 guard and fix stale cache VRAM leak#13497

GitGlimpse895 wants to merge 1 commit intohuggingface:mainhuggingface/diffusers:mainfrom

GitGlimpse895:fix/pab-cache-logicGitGlimpse895/diffusers:fix/pab-cache-logicCopy head branch name to clipboard