So as far as I understand when I run DELETE /resource/1 and this resource does not exists, the correct response is a 204 because the result is the expected one and the same as if the resource would have existed. Is this correct?

If so, I would suggest to add this to the specs to make it explicit.