Sure would help if you put your RVs age, brand, model in your signature.
Anyway, my ol' '94 & my newer '02 both use black Butyl tape in the channel of the aluminum window frame to attach the glass to the frame and hold it there for years.
"Butyl was developed to augment traditional rubber adhesives. Butyl tapes are less temperature-sensitive and maintain their stickiness at much lower temperatures than natural rubber. With butyl rubber tape, you find a tape that instantly adheres to most surfaces and has a high adhesion level."
You might have a difficult search because most butyl tape on the consumer market isn't as thin as that used for windows. It's out there though.
I went looking for it when I pulled out and worked on my windows that had lost their seal and had moisture between the panes. Couldn't find it but just used the old stuff as it didn't get very dirty and kept it's tackiness.