Exactly. All the game video settings you have changed around, the character specific addon settings etc are all saved in the (default Win XP at least) c:\program files\world of warcraft\WTF folder.
That one folder contains all the realms, accounts, characters, and all your addon settings. So if you copy it, make sure to copy right from the beginning. Namely the WTF folder. That will grab everything below it also.
Do the same thing with the c:\program files\world of warcraft\Interface folder. The Interface folder holds all the addons that you have running when you play, nUI for example. As long as you copy Interface, you'll get them all in one shot.
Generally those 2 folders with all their subfolders will take upo anywhere from 50-150 or more megs of HDD space depending on the number of addons you run.
Then on the other computer you'd like to use, just copy/paste those folders back into the World of Warcraft directory and you'll be all set.
Also as a courtesy to another persons computer, if that is how you play WoW abroad, Before you copy your folders into the game directory, rename theirs
Just right click, hit rename and make them WTF_old and Interface_old that way the other person doesnt lose their settings