During the busy season, the scariest thing about that pass in either direction, is the rental Class C's with their side mirrors extended out as far as they can go on both side...
We've done the route from West to East several times. First in our Bounder, then multiple times in our Country Coach. Last year when we made the trip, we saw two rental units pass each other in different directions. They both lost their driver side mirrors. The gent driving a few cars ahead of us, was cut by flying pieces of mirror.
That was very early on the West side, and we counted I believe the pieces of 3 more side mirrors along the rest of the route.
I had to stop once on that years trek East over the pass, as I could see the lady (Not a knock against lady drivers, but she was a lady driver
! was terrified, and was so busy watching the passenger side for the close by trees, that she was way over in my non to wide lane. So I stopped. Lightly tapped the air horn to get her to focus on the driver side a bit, and she quickly veered back into her lane. She looked very frighten, and her husband seemed to be providing vocal encouragement to her, from the look of his face and mouth of flapping rapidly
So for those that have not done this in either direction. Watch your speeds, gear down for the hills, and keep and eye out for those in the rental Class C's - as they are quite often just getting their sea legs with the unit. Many fly into the West coast to pick up their rentals, and have very little travel time under belts when they reach Yosemite
Best to all,