Check for future point removal in remove_point

The list of all points to be removed is passed to remove_point and only
points that will not be removed in the future are accepted as nearest
neighbours that will take up the connections from the point to be
removed.
The remove_list is sorted for faster checking.