Haven't read anything about this yet, nor have I noticed this on all the games, so here goes:
I picked up the Japanese Soul Calibur III this evening (it runs fully in English, too!), and noticed that the load times seemed to be quicker. I couldn't even get a character to say his/her taunt on the match-up screen, as the game would go right into the battle before they could speak, making load times around 1-3 seconds total.
Then it hit me to try the notoriously long-load time title, Neo-Geo Battle Coliseum. Amazingly enough, the load times DO get shortened! Instead of taking between 13-19 seconds to load up a match, the game only takes about 4-6 seconds to load up a stage now, and 1-2 seconds to load up the next set of opponents on the same stage in arcade mode. This is awesome.
EDIT: Some other games I've noticed a difference on, although nothing as big as SCIII and NGBC, are VF4 Evolution (2-4 seconds), Rumble Roses (loads shortened only a little bit), The Rumblefish, and KOF Maximum Impact 2 (same as RR).
Someone on GAF said he saw a Gizmodo video of a PS3 running Final Fantasy XII, with the load times seeminly dramatically reduced. I can't confirm this, nor can I with any other RPGs, sorry.
Also I notce that all the PS2 games I've run have played in 480p, whether they support that option or not. Makes some games look a lot sharper and more vibrant, particularly the 2D games.