Adding borders to widgets...how do I do this?

I am in the process of setting up my website and im wanting to add borders to my widgets, pics etc...Not boring plain black, arty ones, creative, unique ones. How do I do this? Im not a html know it all...but im getting there...please help! Thanks.