I agree with Eric. My MA always starts the visit with vital signs, CC and a quick history of her own. She then always sends the chart to me. You can always add to the HPI, but with a few sentences from her, if I do chart on it three days later, I at least can recall what it was about.
There are times where I see a patient after hours in the office, but I would NEVER see them without pulling his or her chart. I usually do a CTRL + S to send it to my inbox and then open it from there.
I can't recall any other way of doing it for the past six to seven years. Let the computer help you rather than using paper.
HTH