Buffing might have been the problem as paint has a hard time sticking to a shiny surface. Better to rough it up first with 400 grit paper for paint to get a good grip. Sticking on brass is also problematic and buffing compound can get embedded in it.
I thought I cleaned the copper surface well but it does look like some was left behind....maybe - must do better next time.