If it's only one light I still say it's the bulb (new or not). Make sure you have the bulb seated properly in the socket. Go get another bulb and try it anyway. Remember not to touch the bulb with your fingers because it will cause a hot spot from the oil in your skin and cause it to burn out prematurely.
If it was both lights then it may be the multi-function switch (dimmer)