Is the duty of disclosure owed only to the acting patent examiner?

No, the duty is not merely limited to representations to or dealings with the patent examiner. The duty extends to all dealings with the Office.  For example, the duty extends to proceedings before the Patent Trial and Appeal Board as well as the Office of the Commissioner for Patents (37 CFR 156(a)).