You have a boundary condition on the contact surface, this should be avoided. You may need a different modeling approach here because of that. Maybe make the pin rigid or even exclude it and use the compression-only constraint instead: https://www.youtube.com/watch?v=yYuvUbu6Sw8