Usually I jump on my mount and fly but tonight I was lazy so did a short flight while running NUI 6 and sure enough it dropped me to 4 fps when I dismounted. Long story short with both NUI's turned off it was still doing it so turned off quest helper and problem went away.
Thanks for the help