As Gil says, they will work on much lower voltage...
Most small 2 legged LEDs will light from 2.5-3V, so you should have no problem sourcing one for this project.
(Which i by the way will go through with my own as well,as it would be cool with a "reminder" on there.)