Buffing might have been the problem as paint has a hard time sticking to a shiny surface. Better to rough it up first with 400 grit paper for paint to get a good grip. Sticking on brass is also problematic and buffing compound can get embedded in it.