[He opens his mouth, then closes it. He really is at lost on what to do- even if he told him about Bruce heir situations are so different it might even make things worse. (Or maybe that's him trying to justify his need to keep the promise he made the other Bruce.)]

You could talk to Oliver. Explain this, tell him that you understand he's another person altogether but it will take you some time to adapt.