I think we found the culprit. It is (I believe):
Erp.BO.TransOrderReceiptSvc.GetRowsLandingPage
So, a PSG consultant showed us how to look at the processes currently running in a specific app pool.
Here is how (expand to see):
Open Worker Processes:
Choose the frozen one, then click “View Current Requests”:
And then you’ll see something like the following picture.
And it showed this guy, with exceptionally long times on it. (The top one is 2,290 seconds, or 38 minutes.) This is a snapshot during a freeze-up today (before I did IISRESET to it).
You may have deduced as I did that this method is the Kinetic landing page grid that you see when you open the Receive Transfer Order app.
We don’t do a ton of transfers, so it does jibe with the fact that the problem is very intermittent.
Now, why does an OOB function get so hung up? No idea.
But, you can still receive a transfer order the old-school ways – by searching, or typing the number by hand.
So, I threw a pre-processing BPM on the evil method, and it stops the grid. I did this an hour ago, but I really do think that will put the nail in the coffin.