there's some insinuation that Hal's biological father could be the medical attache:
-- Hal's "atavistically dark-complected”
-- they share an interest in byzantine erotica
-- from what i remember, dates and ages line up correctly to put Avril and attache both attending Brandeis a yearish before Hal is born
-- there's a reference or two to James finding that specific affair particularly upsetting
-- Avril's said to have a preference for sleeping with Canadians
-- the attache is "one-half ethnic Arab and a Canadian by birth and residence"
IIRC it's mentioned that James is also unusually tan-skinned for a white guy, but I don't think that disproves the insinuation so much as it provides a convenient excuse for Avril, lol.