4 bits can store 16.

So the hours can fit easily in the leftmost nibble of a byte (if you don't use 24 format), but there are 60 minutes in an hour.

Good luck jamming that in the rightmost nibble.

Robert