quoting Aino Meilani:

Huh? My avatar is a PNG. The server thinks it's a JPEG, but browsers do not really care about the extension or the MIME type.

In that case, the information on the avatar-uploading page is outdated. Because that still says that only JPEGs are accepted as avatars (my Gravatar is a PNG, too, and that's not a problem).