Drop the reference count on the correct object.