đŸ«‚ Kinetic - Americas - Extended Maintenance / Outage

Alisa,

Did parttrap services ever resume working for you?

We aren’t using parttrap - we did get our read only database running again that same day (Tuesday). I was just saying it seemed likely there could be the same underlying issue. In our case its a script they have to run every so often to fix a problem with statistics. Its a known MS issue with replicated databases.

3 Likes

I guess we are lucky again! Anyone also having performace issues today?

2 Likes

They’re doing midday maintenance again according to their status page
upsizing a SQL Server cluster, said to be a small subset of customers.

Screencap hidden here....

3 Likes

Our plant has been ‘down’ pretty much all morning. Unauthorized errors when logging in, up to a minute wait time to add a line, screens crashing and general errors doing normal things. Since they announced the maintenance it seems to have sped up for us. Unfortunate though as we are currently at Insights.

4 Likes

I predict a crowd of angry customers at the Cloud kiosk in the Solution Hall.. or it’ll just be me. Either way they’ll get an earful.

6 Likes

We been on the same boat since last monday!

2 Likes

That makes 2 of us!

2 Likes

Maintenance complete. Hope no one was negatively impacted and that the remaining issues are resolved.

1 Like

We’re back up and running now. 3 orders put in since 5am EST
 Great monday.

4 Likes

Just when you thought it was safe. We are down again.

4 Likes

These short notice events are a new thing. Friday Night 5:50pm Hey were going to be down tomorrow morning for an Hour or so, just a small hiccup. Hope this is not the new norm.

5 Likes

Us too

3 Likes

This is incredibly bad!

2 Likes

Idiot Wtf GIF by Hot Head Candles

Epicor right before / during insights

21 Likes

Yeah, I just had a go-around with “support”
made the mistake of asking for a datafix to address a bug in the system. Good times. Aside from the noontime nugget of a SQL cluster upsizing, there’s nothing new at the status site.

1 Like

From Chat GPT:
If a cloud ERP supplier has recently executed a poor upgrade resulting in data corruption and downtime, the upcoming user meeting in Las Vegas becomes a crucial moment for damage control, trust rebuilding, and reestablishing leadership. Here’s what they should do:


1. Acknowledge the Problem Transparently

  • Lead with an apology. Open the meeting or keynote with a senior executive acknowledging the failure.
  • Take responsibility. Don’t downplay or shift blame. Admit the specific issues: data corruption, downtime, customer impact.
  • Provide facts. Clearly explain what went wrong (without too much technical jargon) and how it happened.

2. Share the Recovery Plan

  • Outline what’s been fixed. Be specific about actions taken to correct data, restore services, and prevent recurrence.
  • Discuss compensation or support. If credits, service extensions, or support enhancements were (or will be) offered, make that clear.
  • Show timeline and milestones. Walk through what’s been done and what’s left to do to return to full stability and trust.

3. Highlight Lessons Learned and Changes Made

  • Talk about process improvements. Share how testing, rollback planning, and QA will be enhanced.
  • Introduce new roles or oversight. If new leadership or quality control has been added, say so.
  • Present new transparency measures. Consider publishing upgrade schedules, changelogs, or improved communication channels.

4. Focus on the Customers

  • Host listening sessions. Let users share feedback, frustrations, and suggestions. Facilitate breakouts for open discussion.
  • Create a recovery partner council. Include affected customers in beta testing, upgrade reviews, or quality checks.
  • Provide support presence on-site. Offer one-on-one help or private sessions with engineers or data specialists.

5. Reaffirm the Vision — Carefully

  • Balance humility and confidence. Share the roadmap for the product but tie it directly to stability, customer value, and reliability.
  • Avoid hype. Don’t roll out flashy features without first emphasizing quality and resilience.
  • Invite the community. Show how customer input will directly shape the ERP’s future.

Tone and Messaging Guidance

  • Be human. Use honest, non-corporate language. Customers are likely frustrated—acknowledge that sincerely.
  • Stay open. Avoid defensive answers during Q&A. If something is still being investigated, say so.
  • Close with commitment. Make clear that rebuilding trust is the top priority.

They should really provide a bigger room and popcorn to the cloud sessions this week, they are going to be a show if any current users are in the crowd mixed in with potential customers. Oh yeah and we need to hear more than a 50min session, just saying.

1 Like

We got a 12:54 AM notice this morning.
Kinetic Americas - SQL Americas is scheduled for a failover, placing the cluster back on its preferred node for management purposes. During the failover, a minor blip (a few seconds to a minute) in connectivity may be experienced. Only a small subset of customers will be affected.
From: Tuesday, May 6th, 2:00 AM CST To: Tuesday, May 6th, 3:00 AM CST
The system will be partially unavailable during this time.
An all-clear message will be posted when this maintenance is complete.

At this point, If I’m only getting a 1 hour notice I would prefer not to be told at all.
We seem to have lost all planning and stability.

3 Likes

Looks like they ran well past the hour’s duration
all clear didn’t come until 541a ET. Hopefully today goes better for everyone

Screencap hidden

2 Likes