I think getting a 'garden' is really just buying a house with a yard, then purchasing trees and flowerbeds from different vendors and using them to decorate it. I've gotten a lot of things like that just from doing quests, but I still don't have a castle (so for now, they have to stay in my attic - but seriously, who keeps trees in their attic?) :P Hope I helped!
