I'm pretty sure just the router needs to be configured. That's all I did for OpenDNS a couple years ago.
open