[macOS Sequoia 15.2] This worked for me at some point, but stopped (possibly as a result of a system update). I’ve restarted and made sure that Show icon preview is toggled on (works with Illustrator files in the same folder). (also posted to Github #834)
