Has this happened to anyone else?

aosemwengie1 · February 17, 2023, 1:33pm

I just had a minor heart attack and wondering if this has happened to anybody else or any idea why this happened?

We use the kinetic version of order entry and have a custom layer attached. All of the sudden nobody could open order tracker this morning (it was working fine at 8pm last night).

No errors in the server log. There was an unidentified ASP.net 4.0 error showing up in the event log but it didn’t tell me anything.

I tried previewing my layer from application studio and it worked fine. So I republished it which solved the problem.

But why did this happen? Why would a customization that has been working fine for months suddenly break completely and totally for everyone with no changes at all? Servers not updated or restarted recently, literally nothing has changed.

It makes me feel really uneasy about the stability of kinetic - what if I took vacation? Just nobody use order entry until I get back?? I don’t have much confidence that Epicor support would have solved this issue in under a week, if ever.

spaceage · February 17, 2023, 1:40pm

Happens to us all the time. We’ve had a case open about this for over a year. No root cause, no mitigation. You can try running the MetaUI fix in Data Conversion Workbench. That will resolve it sometimes. It usually just goes away on it’s own, or if you re-open it in Application Studio, re-save, re-publish, it sometimes goes away for a few weeks. Very frustrating…

aosemwengie1 · February 17, 2023, 1:41pm

That is depressing. I guess I better document this in case it happens while I am not here at some point.

Mark_Wonsil · February 17, 2023, 2:13pm

There were Windows Patches this week. Any correlation there maybe?

aosemwengie1 · February 17, 2023, 2:22pm

Nope, servers have not been updated since 1/22.

Olga · February 17, 2023, 3:34pm

You can open EOBrowser log in the client, may be it will show call that causes the error. Also what is unindentified ASP.NET error is exactly?

aosemwengie1 · February 17, 2023, 3:41pm

Event code: 3005
Event message: An unhandled exception has occurred.
Event time: 2/17/2023 7:57:03 AM
Event time (UTC): 2/17/2023 12:57:03 PM
Event ID: b7d41b5fd01d4f57bae4d1cec546b3fe
Event sequence: 636
Event occurrence: 3
Event detail code: 0

Application information:

Process information:
Process ID: 5980
Process name: w3wp.exe

Exception information:
Exception type: OperationCanceledException
Exception message: The operation was canceled.
at System.Threading.CancellationToken.ThrowOperationCanceledException()
at System.Web.Http.Owin.HttpMessageHandlerAdapter.d__27.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Web.Http.Owin.HttpMessageHandlerAdapter.d__20.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Epicor.RESTApi.Middleware.ApiKeyEnforcerMiddleware.d__10.MoveNext() in C:_releases\ICE\ICE4.1.200.29\Source\Server\Hosting\AspNet\RestApi\Epicor.RESTApi\Middleware\ApiKeyEnforcerMiddleware.cs:line 76
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Cors.CorsMiddleware.d__4.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Mapping.MapWhenMiddleware.d__3.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Host.SystemWeb.IntegratedPipeline.IntegratedPipelineContextStage.d__7.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Host.SystemWeb.IntegratedPipeline.IntegratedPipelineContext.d__12.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at Microsoft.Owin.Host.SystemWeb.IntegratedPipeline.StageAsyncResult.End(IAsyncResult ar)
at System.Web.HttpApplication.AsyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute()
at System.Web.HttpApplication.ExecuteStepImpl(IExecutionStep step)
at System.Web.HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously)

Request information:
Request URL: …/api/v1/ICE.BO.MenuSvc/GetMenuForLicenseType
Request path: …/api/v1/ICE.BO.MenuSvc/GetMenuForLicenseType
User host address:
User:
Is authenticated: True
Authentication Type: Ice
Thread account name:

Thread information:
Thread ID: 18
Thread account name:
Is impersonating: False
Stack trace: at System.Threading.CancellationToken.ThrowOperationCanceledException()
at System.Web.Http.Owin.HttpMessageHandlerAdapter.d__27.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Web.Http.Owin.HttpMessageHandlerAdapter.d__20.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Epicor.RESTApi.Middleware.ApiKeyEnforcerMiddleware.d__10.MoveNext() in C:_releases\ICE\ICE4.1.200.29\Source\Server\Hosting\AspNet\RestApi\Epicor.RESTApi\Middleware\ApiKeyEnforcerMiddleware.cs:line 76
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Cors.CorsMiddleware.d__4.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Mapping.MapWhenMiddleware.d__3.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Host.SystemWeb.IntegratedPipeline.IntegratedPipelineContextStage.d__7.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Owin.Host.SystemWeb.IntegratedPipeline.IntegratedPipelineContext.d__12.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at Microsoft.Owin.Host.SystemWeb.IntegratedPipeline.StageAsyncResult.End(IAsyncResult ar)
at System.Web.HttpApplication.AsyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute()
at System.Web.HttpApplication.ExecuteStepImpl(IExecutionStep step)
at System.Web.HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously)

Custom event details:

Olga · February 17, 2023, 3:42pm

it is just cancelled call, not important, you are right

aosemwengie1 · February 17, 2023, 3:49pm

The error right before it is
A process serving application pool ‘Kinetic’ exceeded time limits during shut down. The process id was ‘4544’.

klincecum · February 17, 2023, 4:53pm

You’re going to give @Mark_Wonsil a heart attack!

aosemwengie1 · February 17, 2023, 4:56pm

We only update them once a month, that’s not that bad is it? lol

klincecum · February 17, 2023, 4:56pm

You said 1/22 not 1/23 !

aosemwengie1 · February 17, 2023, 5:01pm

January 22nd to be clear!

Evan_Purdy · February 17, 2023, 7:06pm

I think you might have a career as a politician

Mark_Wonsil · February 17, 2023, 7:17pm

Not with a 50 vote limit…

Evan_Purdy · February 17, 2023, 7:20pm

People find a way to get some extra mph in over the limit… I’m sure someone will find a way to get more votes…

aosemwengie1 · February 17, 2023, 7:21pm

Quick somebody lock the thread lol

josecgomez · February 17, 2023, 8:09pm

Banderson · February 17, 2023, 8:10pm

^^Mods^^

Mark_Wonsil · February 17, 2023, 8:14pm

We’re only talking politics here!!!

monsters inc lol GIF by Disney Pixar