BTDTWF. Been there, done that, works fine.
One of my (now retired) co-workers did that all the time... with glow plugs, injectors, push-rods, rocker arms and bridges... every 6.0 he ever took apart... never an issue. I've had to reassemble one of his in the past, and that's how I found all the valvetrain parts-in a box!
I try to do my best in returning everything to where it came from, but if something gets mixed up, I don't lose any sleep.