The diary has convenient previous/next appointment indicators which appear to the left and right of the diary respectively when the currently selected date has no tasks:

Clicking the previous/next indicator moves the selected date to the respective last or next day on which tasks are scheduled.