The reason “5” looks wrong is because of the difference in how video is transmitted with YPbPr versus RGB.
Simply put, with YPbPr, a black and white image is sent on the green line (Y, luminance), and the other two lines contain minimal color data (the difference between luma and blue, Pb; and the difference luma and red, Pr); and RGB sends red, green, and blue color data on separate lines; essentially red, green, and blue images that get combined into a full-color image.
So, when your Wii is outputting YPbPr, and the OSSC is interpreting it as RGB (RGsB specifically), it looks all-green, because almost all of the image data is being sent on the green line.