Do you have any idea what is inside the trailer behind where the rivets pulled out? Can you make a plate out of metal, paint it and bolt thru the wall and use acorn nuts? I would make sure to use stainless steel screws/bolt, nuts & washers. As for caulking, I would use a rope putty and surround the holes while the arm is pulled away and then tighten.
__________________
|