Building FFmpeg
See building.
Build script
You can also try out this script (download) for windows. It requires you to manually setup steps 1. and 2. from the building guide, but will attempt to automatically download and build FFMpeg and its dependencies for you.