You can use the Windows XP interface (as well as other Windows versions) on the Linux distribution Q4OS. Here's how you can ...

Get more screen space, better input devices, and a more comfortable overall setup for when you're sitting at your desk using the computer.

This should remove the Recycle Bin icon from your desktop. While the Windows Settings method works on Windows Vista and later, you might be out of luck if you own a Windows XP-based PC.