Your only option is to complete it or ignore it. From my experience (one grandmaster wizard) there was only one quest that really was a pain to complete and that was sunken city, i manged to do it in my 40's because I just kept putting it off from when I tried it in my 20's and failed.