Most painters seem to like going with a redish color. History has simply proven this to be wrong. Red is more of a Hollywood-ish color. The color more often than not was a light khaki/ off white/ pale linen color. Ultimately though, its your figure so the decision is yours. Osprey has two good titles on Roman clothing. See if you can find them as it offers much more insight than I can offer.
Jim Patrick