when you click the data points initially it will highlight all the data. click it a second time and it should only highlight the specific data point. that is what you want to delete