At first, Link stays where he is, looking at the ghosts.

It might be life, but it doesn't seem fair. The ghosts have already lost their lives. They won't ever get to live again. And Link is right here, with the power to at least give them something that'll make them feel a little better, for a while.

But the Doctor is right - there's only so many oranges. And Link has already gone back to the beginning to grab more once before. Eventually, even all those oranges will be gone.

"I'm sorry," he says to the ghosts, before following the Doctor.