Deaf people have improved this slightly :-)
They consider a hand with only the thumb extended to mean "6", while the index finger means "1". Zero is signed by forming a round shape using the thumb and index finger. This way they can sign the numbers 0 .. 9 using one hand only.
Time flies when you don't know what you're doing