In the Tasks window, select the task list you want to work with, right-click on the task you want to delete and select the Delete option.
At the delete warning message click the OK button.