Hi Ken,
I think you've assessed the situation correctly. While I'm not familiar with that specific check valve ("clack valve" in the UK), there should be a ball which needs to seat correctly within.
Also, if the pump piston is being forced back, you have the same situation with the pump's discharge valve. Should take a look at that one too.
Paula