You need to upgrade the catalog. The database LR4 uses has additional fields and needs to work with a new database structure so it needs to upgrade. If you don't upgrade LR4 wont work with a LR3 database.
You should be backing up your database anyway, just in case anything goes wrong with any version of Lightroom.