You'll still need to use IE on ocassion, but you can use FireFox as your main browser.
Since IE is tightly integrated into Windows, it can't be completely removed without
a third party program. There's no uninstaller for it.
Dealing with Unwanted Spyware and Parasites