"I can work it out. Don't worry," he assured him. "We need to be more concerned with when."
Other options:
no subject
"I can work it out. Don't worry," he assured him. "We need to be more concerned with when."