Man claims he had affair with dad accused of killing wife, kids