DeLorean sender block off cap keeps popping off

After installing the modern fuel pump for my DeLorean, after I filled up with gas for the first time, I created a massive gas spill as fuel came spilling out. After digging into this, I found that the cap that is put in place of the original fuel sender comes off extremely easily. Such a hazard!