As Erik said above, the upgrade package comes with release.config instead of web.config (same thing, different name) in order to prevent accidental "overriding" of your production web.config.

So first back up your "old" web.config file and then copy your connection strings and machine keys (and other additions to web.config you may have made) to release.config, which then becomes your new web.config.