As has been said, Panic at the Disco is grammatically correct.

I am neurotic though and sometimes it just doesn't look right unless I capitalize all the letters in a band's name. The names in my media player are all kinds of inconsistent with the capitalization, sometimes I'll do it right and sometimes I won't.