To close an Oblivion Gate you need to enter the Gate and collect the Sigil Stone hidden within. You'll be able to keep the ...