Start the PS2 without a game. Go to "Browser". Then go into your memory card. At the corrupted data hit "X" and choose delete and confirm it to delete the specified data.
In the past I've been unable to delete some corrupted data. In those cases I had to use GameShark to format my memory card.