What to wear in my Courthouse Wedding?

Here a few questions: What should I wear in my courthouse day? My fiance will be wearing his formal Army uniform and he would like me to wear something white. It will be only the 2 of us in the ceremony. He just got back from Iraq and neither of us has friends or family here. Also we don't plan on having a big wedding in the future, so this will be our "Big Day" for pictures and memories. Also, what can we do after the courthouse? Is that appropriate if we go out for dinner all dressed up or should we change? My fiance doesnt like too much attention and concerns me if he will be all shy dressed up in public, although it was his idea to wear his formal jacket. Thank you for your advice :)