Home Forums Discussions Problems Slow Response Time

Anyone else having issues with slow times? Opening a chart takes about 1-2 minutes!

If you are using spindle drives with AC you're going to hurt. SSDs in a RAID 5 are the way to go. Make certain your AC server has at least 8G of RAM.

Workstations should have SSDs and 4G of RAM.

JamesNT

Server does use spindle drives (15000K RPM). Probably will talk to him about moving them to SSDs.

Other than that, the server is a 40C/80T CPU, 128GB Ram

Workstations are i7s, SSDs and 16GB

Watch that HDD controller. Assuming Dell server you're gonna want an H740 controller or better. Lesser controllers can't keep up with Enterprise SSD.

JamesNT

H700

Got the doc to bite the bullet and slapped some SSDs in the server. Now it is time to wait to see if it actually improves the performance.

You can't help but speed up dramatically with SSDs. Just the reboot times will be far better. Usually don't disagree with James and RAIDs will always be confrontational but I would go with a RAID1 or a RAID10 (my specific go to)

Also what is the speed of your switch? Are you using wireless or wired?

My largest speed upgrade so far has been a Optane 905p SSD for AC VM. Really fast random, queue depth 1 access (great for SQL hence AC). $340-399 for 1 Tb while they last.

It's not in a raid and running in a PCIe U.2 adapter card so definitely not official "enterprise". But, I keep good daily AC backups and have a hot-spare server.

Switched from Raid 1 and Raid 5 to a Raid 0 (single drive for OS since offsite backup) and Raid 10 for data.

Also the switch is just a managed gig switch, so the network teaming we are doing is just more for redundancy in case something fails and can load balance.

RAID0 is still two drives. It just gives slightly better performance than a RAID1 but RAID0 has no redundancy. It's nice to know that if one drive fails you still have the other drive to run on until you can replace the faulty drive.

RAID is one of the few areas were myself and Bert disagree. A few points and my argument:

1. Never use RAID 0. If one drive fails you loose the entire array and all data on it.

2. RAID 1 is great for the operating system drive. But little else.

I prefer RAID 5 or 6 and highly recommend it for AC installs. In every environment you will ever manage, that environment will fall into one or two categories: Heavy Reading | Heavy Writing. Amazing Charts is a Heavy Reader. With RAID 5/6 for every drive you add it cuts down read time. That's why my RAID 5 arrays always have a minimum of 4 drives. And, with RAID 5 you can lose one drive and be OK with RAID 6 it is two drives.

The reason I do not recommend RAID 10 is because of sheer cost. That cost comes in two forms: first is the cost of that many more drives. Second, that many more drives also take up more drive bays in your server so limit expansion ability. Remember, for RAID 10, *half* of the drives are for nothing more than redundancy.

JamesNT

I use the RAID 0 on the OS partition (single drive), but that is because we have a nightly full disk backup (for bare metal restore) and every 2 hours we take a backup of the SQL databases and the Files.

As for the RAID 10, I dont mind the cost because it isnt the biggest practice, so we have 4 500GB drives in it. This allows for 1TB of data storage (they are only using about 200GB) and still allows for redundancy, but still gives you benefits of read AND write speeds.

Either way, I feel like Amazing Charts needs a complete database overhaul because no matter what client of mine it is (I manage 4 that use amazing charts), it is always super slow when doing just about anything lol. One of them runs OK, but that is because they only have about 3K active patients, where the slower ones have closer to 16K active patients.

AC slowness is not because of SQL Server or the database. It is because of AC itself.

JamesNT

Aint that the truth. Even after all these upgrades (Server OS, SSD drives, RAID update) everything is still painfully slow. Even opening a most recent encounter takes about 1 to 1 1/2 minutes just to load up to the point you can click on anything. My doc already looking to trial other software.

If you need your AC data exported to PDF files (one per patient) including imported items, let me know.

JamesNT

He is now looking at EMDs, which we also have several clinics using that. Since we can hand them over a copy of the database, they can usually import things easily with mapping. But we shall see. I talked to AC support today and they are recommending an uninstall and reinstall on the server, but I feel like that is going to result in the same thing happening.

You can try turning off Hardware Acceleration. That has worked in the past.

Also, I may have missed it, but are you using wireless or wired?

I would take a patch cable (Ethernet) and plug a PC directly to the server and see what your AC does. This is the only way to completely bypass the wired/wireless network. But no one does it, so don't feel bad if you don't. But you have to troubleshoot. And that's the first step.

Pulling a chart should not take 1 to 1.5 minutes! I just opened a chart and it was less than 10 seconds. New Note was almost instantaneous. My problems with slowness come with opening imported and prescribing windows. What kind of times are you getting for those?

In troubleshooting it is so important to get back to those helping with the info.

1. Hardware acceleration
2. Are you wired or wireless (key)
3. Plug one computer to the server and see how fast it opens up.

If you had a fluke meter that would be great, but they are rather costly.

Plenty of IT expertise on this thread that way exceeds mine...
but if it takes 1.5 min to open a chart, I would say there is something unique to/ wrong with your current set up.

Sure, AC may have its issues, but what you describe is more than 2 standard deviations outside the norm.

Not sure if your client has given up. We used to have issues with eRx taking an excessive amount of time but everyone had that. I have NEVER heard of anyone having this much time with opening a chart. I doubt it is the server. I doubt it is AC. You have good SSDs and plenty of RAM on the PCs.

If we could know:

Speed of switch
Wired or wireless
Speed when connected by Ethernet cable directly to server. Just get a 50 to 100 foot Cat6 cable.
SQL is blazing fast when compared with AC so it won't be that.

Remember, no one else I have ever heard of has had an issue like this. I could see changing EMRs if it were this slow. I can almost guarantee you it is not AC. You are simply connecting to SQL.

It could very well be your network.

Agree. Check network, do performance testing, isolate each component. If not solvable ask a qualified server/networking IT consultant.

Sorry for late reply, went on vacation lol.

Switch is full gigabit, nothing is wireless, we have network teaming enabled in the server, amazing charts also runs equally horrible on the server.

I have been monitoring resources and the quad CPUs are only hitting about 3% usage, about 28GB of the 128 GB of ram is being used, network is only showing spikes when someone scans to Amazing Charts (for half a second) and disk usage is low.

We just had amazing charts do a full uninstall and reinstall of amazing charts and it's still slow. Their next troubleshooting step is to wipe out the server completely.

H700 controller means you likely have a Dell R710 controller.

I'm sorry, but that server isn't going to cut it. The H700 controller was out long before SSD drives were mainstream. That controller simply cannot handle the throughput.

I just sent you a direct message.

JamesNT

DON'T clear the server. That will do nothing except cause 24 to 48 hours of headaches.

Are you saying that when you run AC on the server it takes up 28GBs of RAM. That is crazy. It shouldn't take more than 150MBs of RAM

I would let James remote in and use SSMS and see what the time of queries are. Should be milliseconds. But if way more there is a problem. Do you have the OS working as a host so you can run a VM and isolate AC there?

Also, has AC looked at it? Are you on the latest version? If James can't look at it, my IT guy would probably look around for free. Why is it using 25GBs of RAM.

You don't even need AC on the server if it is running?

Tonight I had not only created a virtual machine on my server (which I host other VMs, also turned them off to test) and it was terrible. I even put it on my own machine (3950X AMD, 32GB RAM, 3090TI, PCIe 4.0 M.2 SSD at 3800Mbps) and it was still terrible. I dont know if it is the amount of patients or the size of his database (16K patients and 11GB Database), but even on my workstation being a standalone could not compete with it. I think for the size of his practice and the latest updates are just not working at all and it is time for him to switch.

My thought is, if I can play Cyberpunk at 4K no issues, encode a 4K 1 hour video in 15 minutes and my network is a 10GBPS network, with the amount of high speed cores I have and DDR5 RAM and amazing charts is still crawling, there has to be something wrong with amazing charts itself.

SQL Server Express has a 10G limit on database size that you have clearly exceeded and is very likely your problem. You will need to move to SQL Server Standard for further resolution.

JamesNT

Wow!

Perusing this thread because of problems and feel I should share a little

Using cloud hosted AC, recent upgrate from AC to 11.4.2, 35 second wait times to open any new aspect of the chart -- losing 2 hours of staff time a day for the last 8 days and spending lots of pajama time with AC. High speed conections (851 mbps this am) and OK computers on our end - the same from every home environment and our main office. Unusable. Newcrop "improvements a bandaid that doesn't adress lots of glitches and obvious opportunities for improvment. Swithching to Athena with a go live date of 11/1 so this is only purgatory?

Our practice is 15 years old and we work in a resort community, so 1 have 16,000 charts but really only have a core of 2000 locals. Any thoughts on if AC could run a script to inactive pts that havent been in in say the last 5 years -- if so would it help?

We are using the Sql Server Standard 2016

Yea, ever since this new update, it is painfully slow and my doc I manage also has about the same patient load in his database.

Fascinating, Teleski are you using official AC in the could? What did they have to say about it? Also tell me about your job, sounds great to us flatland skiers.

Paging AC reps this could help you troubleshoot potentially serious issues with 11.4.2

I'm running 11.3.2 on a local server without hiccups for any interested. Too timid for 11.4.2 without a good reason to upgrade. The solid lesson is to be a late adopter.

Yes, the only reason my clients upgraded to 11.4 was due to the lackluster performance they were receiving, but when it came down to it, upgrading to 11.4 was the worst mistake.

Now that 11.4.2 is out and we have applied that, it has gotten even worse than it was on 11.3.2

I found that sometimes if you have too many (deleted) messages in the inbox it wll slow the system down substantially. I contacted support and they logged in and cleaned out all the deletes over a year. It made a significant difference.
You can go to user preferences and under messages click automatically clear deleted messages older than X years and I have that checked now but not sure if that will clear it as effectively as they did remotely

You can also go directly to deleted items, highlight ANY of the messages and select Delete. A popup box will appear and the top bar will allow you to delete all the messages. The bottom bar will allow you to delete all items "Received before.....??

I recently did the delete "received before". I didn't think this feature worked but then I cut the date down so I was removing smaller bits at a time and it worked perfectly. I had messages in the deleted box over 2 years old. Not sure it has sped up the system but worth trying. I also was able to talk to Tech Support and he logged in to clear the dreaded pharmacy change request in the refill pop up. I had over 1200 requests for medication changes. I was not able to do any thing but deny them. This is a feature that is not working correctly and tech support was able to clear and turn it off.

How to do this yourself:

First delete them all: See above

Second: go to Edit --> My Preferences --> My messages (you can customize it to some or all

If you haven't gone to Edit --> and looked at all your options, you are missing a lot of options.

Keep in mind that if you have it check for interactive medications or allergies each time, your ePrescriber will take much longer to open. We just send the drugs and if they have interactions, we find out that way :-)