Update will change any existing record provided it has permission (at least in MS DNS).
Still, you may find it works if you change it to...
update delete ext203.mydomain.com A
It looks like it's simply reading the entries there as Fully Qualified rather than appending any DNS suffix.
Chris