You'll drive right past my house on your way to Fort Pickens. I agree you're not all that likely to have a hurricane, but nobody can guarantee that this far out.
Weather at the beginning of November can be cool to chilly at night (in the opinion of us native Floridians) but usually warms up nicely during the day. Depending on how cold the water is where you come from, the Gulf could be too chilly for you or finally getting cooled off enough to be refreshing. Most years I'm still wearing shorts and wading in the water on my daily walks. But sometimes I'm bundled in a sweat shirt and staying dry. And that can all happen in the same week.
Regardless of the temps, the sunsets at that time of year are absolutely stunning. An extra bonus - the mosquitoes and no-see-ums are pretty much non-existent by then.
Come on down and enjoy our gorgeous island. And feel free to let me know if I can answer any questions for you.