Tell him . . .

Its important to tell him what is really happening,
even if it might not affect the end result

it is his matter what he thinks, react and what he does
and it is your own matter how you feel, what you do
and together truthful sharing 
may become the most important factor 
of a lasting relationship.

however, truthful sharing may not be easy,
too much too sudden sharing of the whole truth,
may shake someone's belief until he hides.
too little too abstract description,
may put people in confusion.

So the simplest first step and bridging this years long communication gap,
is barely describe current situation in the sweetest way possible.

"I am glad you called, we just sat down on the east wing.  We will come over now to the west wing now, see you soon darling !"

"Glad your meeting is over.  We were just talking about Japanese but Chinese is great too"

knowing a person is one thing,
truthful sharing where we stand together is another.
we can't demand nor change the people we love
but its our loves for him that we share truthfully with him.

I will do anything, everything for you

and I just want you to know it

that's all.

Hope this helps . . .