Basically, any CSS you place in your SideBar will override the default stuff. Take a look at my sidebar source.

Firefox's Web Developer Toolbar is invaluable for this sort of thing.