The key to the other areas is in a ruined building just outside the first city. To get it go out of the city and hang a right (left, if you're looking at it top to bottom). You will find a ruined building, go in and find the cells, then go in the one with the skeleton and get the key. It's in the skeleton. Find the emerald key in the Old Thieves Guild.