I came across this video from Thrive Themes.
In summary, it says – use JPEG for Pictures
Use PNG for Graphics and Screenshots.
Interesting – I have been using PNG because of their transparency capability.
It also recommends using Kraken for image compression.
CLICK HERE to see the video.