If you're using Debian or Ubuntu, you can install the necessary X11 development packages. The primary package you'll likely want is: