I've gone both directions many times in a 34' MH towing a Jeep. Biggest problem is the people stopping on the road to gawk at the wildlife. There are a couple tight spots just south of Mammoth but negotiable.
People do it every day in units like yours. 45' motorhomes towing F250 Fords, eighteen wheelers delivering gasoline and goods in the park etc can be seen on this road.
If you consider yourself a skilled driver of your rig, go for it! Downhill from Mammoth is steep for 3 or 4 miles. Steep but not too steep.
Not doing it leaves out a lot of beautiful scenery.
2003 34' Georgetown on W20 Workhorse Chassis. UltraRV power mods. Front Sumo Springs, Rear P32 Sumo Springs, UltraRV Track Bar.
1998 Jeep Toad.