EDIT : I've found a solution ! I switched my Chromecast (2nd Gen) to a different HDMI Port and... that's it.
I don't know why but on my TV (Samsung UE46F6400) the HDMI3 port is a pain in the a$$... Even with a PS3 or PS4 I haven't access to all the functions (like Game Mode and picture parameters...). The 3 other ports are fine, so it's somthing you can try ;)