We all make mistakes some times (filling the engine with oil with the drain plug out, etc.)
Worst case scenario with the PRV in the incorrect position could be a minor loss of some power/responsiveness.
If worn excessively (or out of adjustment) the rack damper bolt can definitely affect the return to idle adversely.
Most likely culprits affecting engine performance at warm up are air ingress, clogged fuel filters, low cetane fuel, water in fuel, dirty fuel tank/fuel strainer, tight valves, poor injector spray pattern, glow plug failure, and a dirty air filter...just to name a few.
I'd address those areas before looking at the rack damper bolt.
The diesels respond well to being driven spiritedly on a regular basis.