barn doors
Notice the cupboard on the end wall. You could solve your problem of where to slide the barn door by putting counter and cabinet behind it and when you need to get into the pantry cupboard, you slide over the counter area. I'm not advocating for the design/look of this, just pointing out the function. Your end cupboard would be on the right.
Here is the wall unit with the doors closed.
Q