When you are inside the enclosed area that holds the tree there are two openings that lead out of the small tree area and into the larger area with all the wraiths.
From the opening furthest from the Goat Dude go straight until you hit the wall.
The oyster is right up against the wall. It is hard to see.