That's most likely not a Mac problem, but you simply have too low bandwidth to accommodate two people using high-volume internet at the same time. Have you tried it with, for example, YouTube HD? You could also go to
www.speedtest.net and compare the results of times when you're alone and when your brother is also on the internet.
You might also want to try simply resetting your router.