5A with the fridge on sounds normal. 2A without it seems high - my power hog coach runs at about 1A with everything off, and I have a bunch of exotic electronic gear generating parasitic loads.
2A of 120vac translates to converter output on the order of 18-20A @ 12vdc. If I were you, I would be looking for specific causes for using that much power. It could be one or more weak batteries that the charger is trying unsuccessfully to recharge. Or maybe you have things drawing power that you don't know about.
Former owner of 2004 American Tradition and several other RVs
Home is in the Ocala Nat'l Forest near Ocala, FL
Summers in Black Mountain, NC