When you or NP sends message back to the staff, also save it in the patient's chart. When staff gets that follow up call from the patient, they can check the previous encounters first to see if there's already a reply.
We use the provider inbox for messages and chart forwards. But for Imported Items review, it's sent to the doctor's inbox so at least that's separated & provider inbox is lessened (a bit).