Thanks Ned,
I just looked and we have one array of 4 drives for each VM.
We have been monitoring promon on Progress since yesterday and ti seems we
have an outrageous amount of record locks. Upwards for 14 Million at a time,
this drops rapidly and increases rapidly, but I am not certain we should be
getting that many.
Any thoughts?
For reference at any given time we have a max of 30 ppl in epicor.
Thanks!
Sincerely
Jose C Gomez
http://www.josecgomez.com
I just looked and we have one array of 4 drives for each VM.
We have been monitoring promon on Progress since yesterday and ti seems we
have an outrageous amount of record locks. Upwards for 14 Million at a time,
this drops rapidly and increases rapidly, but I am not certain we should be
getting that many.
Any thoughts?
For reference at any given time we have a max of 30 ppl in epicor.
Thanks!
Sincerely
Jose C Gomez
http://www.josecgomez.com
On Tue, Aug 10, 2010 at 10:09 AM, Ned <TechnoBabbly@...> wrote:
>
>
> What is the one storage device? SAN? Internal Drives? NAS?
>
> How many drives are in it? How many arrays are you running with those
> drives? How many VMs are using the storage device? What are the other VMs
> running?
>
> I am guessing you are running one giant array with all the VMs using the
> storage device and divvying up space based on the VM itself.
>
> This will kill your performance.
>
> Even with a VM, you will still want to separate out your drives physically
> for maximum performance out of the system.
>
> For the sake of example, if you have a storage device with say 14 drives in
> it.
>
> You could do a few different setups which would be better than the all in 1
> use of the storage device as I suspect you are currently using. Off the top
> of my head, 3 possible options would be:
>
> A- 6 Drives for your Vantage/Epicor VM and nothing else.
>
> B- 4-6 Drives for your Vantage/Epicor VM secondary Drive and nothing else,
> leave the OS on the other 8-10 drives as the other VMs
>
> C- Split out 2 drives and give them to my Vantage/Epicor OS drive, 6 drives
> to my Vantage/Epicor DB and Program Drive, and the remaining 6 to whatever
> other VMs you are running.
>
> Personally, I would run with option C, I think the value of a VM setup is
> always a better use of Processor power and RAM allocation, the bottleneck
> for Epicor/Vantage is always going to be disk access unless you go to one
> of
> those crazy expensive setups with the Fusion ioDrives. Dedicated drives
> will
> increase your performance, to use an old clich�, size is not important, you
> will get better performance out of 10 36GB drives in RAID 10 compared to 2
> 500GB drives in RAID 10.
>
> I am not saying you shouldn't get large sized drives, cuz who doesn't want
> more space, but concentrate on more disks versus disk size.
>
>
> Ned Cleary
> Technical Consultant
> alternative Technology Partners
>
>
> -----Original Message-----
> From: vantage@yahoogroups.com <vantage%40yahoogroups.com> [mailto:
> vantage@yahoogroups.com <vantage%40yahoogroups.com>] On Behalf Of
> Jose Gomez
> Sent: Tuesday, August 10, 2010 9:48 AM
> To: vantage@yahoogroups.com <vantage%40yahoogroups.com>
> Subject: Re: [Vantage] Epicor 9 Impossibly slow
>
> Thanks Chris,
> I will give those values a shot
>
> Its ESX on with one Storage Device usign Raid 10
>
> Sincerely
> Jose C Gomez
>
> http://www.josecgomez.com
>
> On Tue, Aug 10, 2010 at 9:42 AM, Ned <TechnoBabbly@...<TechnoBabbly%40gmail.com>>
> wrote:
>
> >
> >
> > Well there are a few fixes you can do...
> >
> > 1: Update to -Mm 4096, that will help you some, you could possibly go
> > higher, but I have never found a need for it, 4096 is pretty default.
> > 2: Update to -s 12000, that will help as well, also depends how much
> > RAM you have allocated, but that 50% jump can add a lot.
> >
> > Also, you mention that you are running on a VM, depending how you have
> > your VMs setup, that right there is going to rip your performance right
> down.
> >
> > What do you have for a VM setup? ESX? SAN? NAS? Internal Drives? How
> > are the drives broken up for use?
> >
> > A lot of people don't realize the performance hit you will take when
> > you are using a VM and don't dedicate drives the same way you would a
> > physical machine, you can very easily create a bottleneck for the data
> > which can make even the "fastest" machines slower than a turtle stuck
> > in molasses.
> >
> >
> > -----Original Message-----
> > From: vantage@yahoogroups.com <vantage%40yahoogroups.com> <vantage%
> 40yahoogroups.com> [mailto:
> > vantage@yahoogroups.com <vantage%40yahoogroups.com> <vantage%
> 40yahoogroups.com>] On Behalf Of Jose
> > Gomez
> > Sent: Tuesday, August 10, 2010 8:20 AM
> > To: vantage@yahoogroups.com <vantage%40yahoogroups.com> <vantage%
> 40yahoogroups.com>
> > Subject: Re: [Vantage] Epicor 9 Impossibly slow
> >
> > My PF File looks like this
> >
> > -Mm 1024 -mmax 65534 -Bt 4096 -s 8000 -yy 1970 -stsh 31 -inp 32000
> > -tok
> > 4000
> > -TB 31 -TM 32 -D 500 -l 1000 -ttmarshal 5 -tmpbsize 8 -rereadnolock
> > -lkwtmo
> > 180
> > -T "C:\Program Files\Epicor Software\EpicorData"
> > -db "C:\Program Files\Epicor Software\Epicor904\db\mfgsys"
> > -cpinternal utf-8 -cpstream utf-8 -cprcodein utf-8 -cpcoll icu-uca
> >
> > Sincerely
> > Jose C Gomez
> >
> > http://www.josecgomez.com
> >
> > On Tue, Aug 10, 2010 at 3:16 AM, Chris Thompson
> > <chriselectrix@... <chriselectrix%40ymail.com> <chriselectrix%
> 40ymail.com>>wrote:
>
> >
> > >
> > >
> > > Hi Jose,
> > >
> > > Have you logged this as a call? If so what call number?
> > >
> > > The script we are using is ...
> > >
> > > @echo off
> > > set DLC=E:\epicor904\oe101c
> > > set PATH=%DLC%\BIN;%PATH%
> > > set LIB=%DLC%\LIB;%LIB%
> > >
> > > echo .
> > > echo .
> > > echo RESTARTING LOCAL DB/APPSERVERS...
> > > call asbman -name Epicor904ProcessServer -stop -port 20940 call
> > > asbman -name Epicor904TaskAgent -stop -port 20940 call asbman -name
> > > Epicor904 -stop -port 20940 call dbman -host localhost -database
> > > Epicor904 -stop -port 20940
> > >
> > > :TestStop
> > > ECHO Testing Lock File
> > > IF EXIST E:\epicor904\db\mfgsys.lk GOTO TestStop
> > >
> > > call dbman -host localhost -database Epicor904 -start -port 20940
> > > call asbman -name Epicor904 -start -port 20940 call asbman -name
> > > Epicor904TaskAgent -start -port 20940 call asbman -name
> > > Epicor904ProcessServer -start -port 20940
> > >
> > > Obviously you will have to change the paths to suit your server
> > > setup and you will probably have to change the port number on each
> occasion.
> > > Also, I cannot be held responsible for anything that goes wrong with
> > > your system when using this script. It is worthwhile testing it on
> > > Pilot or Test first.
> > >
> > > The check for the .lk is the bit that was missing from the answer
> > > books. It is a bit of a crude fix, but it does the job.
> > >
> > > We have found that the system is much more stable after deleting the
> > > old reports and temp files folders and defragging on a weekend.
> > >
> > > Let me know if you want those scripts too.
> > >
> > >
> > > Thanks,
> > >
> > > CHRIS
> > >
> > > ________________________________
> > > From: Jose Gomez <jose@... <jose%40josecgomez.com> <jose%
> 40josecgomez.com> <jose%
> > 40josecgomez.com>>
> > > To: vantage@yahoogroups.com <vantage%40yahoogroups.com> <vantage%
> 40yahoogroups.com> <vantage%
>
> > 40yahoogroups.com>
> >
> > > Sent: Mon, 9 August, 2010 17:05:06
> > > Subject: Re: [Vantage] Epicor 9 Impossibly slow
> > >
> > >
> > > Thank you Chris,
> > > we are running Progress and basically the whole app is running slow,
> > > takes time to open forms, time to search, time to save, searching
> > > for an SO can take minutes at times. Loading Invoices into ARGroup
> > > can take minutes at times.
> > >
> > > We've ran through the DB tunning guide today and tweaked all the
> > > values we could find, and hopefully this will fix some of our issues.
> > > But I find it absurd that it takes minutes to search for a sales
> > > Order, or to save a simple 10 line invoice.
> > >
> > > We've attempted calls with Epicor but they are ... well not very
> > > helpful, sadly although some of their people are really good, it
> > > seems like most of the gen pop support doesn't actually
> > > understand/know how to deal with this kind of issues.
> > >
> > > For what is worth we are running on w 2 quad cores with 12 GB of RAM.
> > > Which should be more than enough metal for the number of users we have.
> > >
> > > Thanks for your input and i'll let you know if we find anything else.
> > >
> > > Also can you share the start / stop script for the DB, apps etc, you
> > > mentioned that the one form epicor is flawed.
> > >
> > > Thanks again!
> > >
> > > Sincerely
> > > Jose C Gomez
> > >
> > > http://www.josecgomez.com
> > >
> > > On Mon, Aug 9, 2010 at 11:48 AM, Chris Thompson
> > > <chriselectrix@... <chriselectrix%40ymail.com> <chriselectrix%
> 40ymail.com><chriselectrix%
>
> > 40ymail.com>
> >
> > > >wrote:
> > >
> > > >
> > > >
> > > > HI Jose,
> > > >
> > > > We have had a number of speed issues with Epicor 9.
> > > >
> > > > If we leave the Apps and DB running for about a week, the system
> > > > will
> > > grind
> > > > to a
> > > > halt and we would have to stop the apps and db and sometimes
> > > > restart the server to fix the issue.
> > > >
> > > > Epicor have accepted that this looks like a fault with Progress so
> > > > the
> > > call
> > > > has
> > > > been passed to them.
> > > >
> > > > At present, we have a script in place to stop the apps then the
> > > > db, then restart the apps and the db - we run this every night out
> > > > of hours. If you are going to do this, please don't use the script
> > > > from Epicor's answer books as their
> > > is
> > > > a
> > > > fault with it. It doesn't wait for the DB to be stopped before
> > > > trying to restart the Apps which just ends up in a mess.
> > > >
> > > > Secondly, on a weekend, we stop the apps, stop the db, clear out
> > > > any temp files and temp .xml data for reports, defrage all drives
> > > > on the server, start
> > > the
> > > > db,
> > > > start the apps.
> > > >
> > > > So far, we have not had any 'major' slow downs where we have had
> > > > to kick people off the system during the working week.
> > > >
> > > > We found that the reports folder (usually epicodata/reports) was
> > > > getting very full very fast. Some reports were are in excess of
> > > > 7GB in size (the xml
> > > for
> > > >
> > > > them) so if you run these a few times a month, the folder size
> > > > increases rapidly.
> > > >
> > > > One thing we noticed is that the archive option of 'Never' when
> > > > you run a report nearly always doesnt' work. 'Never' would appear
> > > > to either mean 30 days
> > > or
> > > > keep
> > > > forever - hence the reason why the reports folder was building up
> > > > in
> > > size.
> > > >
> > > > What are you classing as slow and what are you comparing against?
> > > >
> > > > Our speed issues have been associated with 'memory leaking' BAQs
> > > > and BAQs which crash on you causing the app server to get stuck in
> > > > a loop.
> > > >
> > > > There are also other things which may speed things up such as
> > > > increasing number of App servers and tweaking settings in the
> > > > mfgsys.mfgsys file (but I
> > > would
> > > > get
> > > > advice from Epicor on these).
> > > >
> > > > It is definately worth while logging a call for this issue as
> > > > something definately isn't right. Hopefully your call will be
> > > > linked with my call
> > > and
> > > > we
> > > > should get an answer quicker.
> > > >
> > > > Are you progress or SQL?
> > > >
> > > > Thanks,
> > > >
> > > > CHRIS
> > > >
> > > > ________________________________
> > > > From: Jose Gomez <jose@... <jose%40josecgomez.com> <jose%
> 40josecgomez.com>
> > > > <jose%
> > 40josecgomez.com> <jose%
> >
> > > 40josecgomez.com>>
> > > > To: Vantage <vantage@yahoogroups.com <vantage%40yahoogroups.com><vantage%
> 40yahoogroups.com>
> > > > <vantage%40yahoogroups.com><vantage%
> >
> > > 40yahoogroups.com>>
> > >
> > > > Sent: Mon, 9 August, 2010 15:14:27
> > > > Subject: [Vantage] Epicor 9 Impossibly slow
> > > >
> > > >
> > > >
> > > > I said las week that epicor 9 was running slower than normal, some
> > > > of you suggested various things but nothing seems to be helping.
> > > >
> > > > Over the weekend, we re-indexed the DB, did a dump and load,
> > > > truncated
> > > the
> > > > bi and god knows what else. It seems to be running awful still
> > > > this morning after all that.
> > > >
> > > > Does anyone have any troubleshooting / tracing / fixing ideas that
> > > > may
> > > help
> > > > us determine where the problem is?
> > > >
> > > > Thank you in advance!
> > > >
> > > > Sincerely
> > > > Jose C Gomez
> > > >
> > > > http://www.josecgomez.com
> > > >
> > > > [Non-text portions of this message have been removed]
> > > >
> > > > [Non-text portions of this message have been removed]
> > > >
> > > >
> > > >
> > >
> > > [Non-text portions of this message have been removed]
> > >
> > > ------------------------------------
> > >
> > >
> > > Useful links for the Yahoo!Groups Vantage Board are: ( Note: You
> > > must have
> > >
> > > already linked your email address to a yahoo id to enable access. )
> > > (1) To access the Files Section of our Yahoo!Group for Report
> > > Builder and Crystal Reports and other 'goodies', please goto:
> > > http://groups.yahoo.com/group/vantage/files/.
> > >
> > > (2) To search through old msg's goto:
> > > http://groups.yahoo.com/group/vantage/messages
> > > (3) To view links to Vendors that provide Vantage services goto:
> > > http://groups.yahoo.com/group/vantage/linksYahoo! Groups Links
> > >
> > >
> > > [Non-text portions of this message have been removed]
> > >
> > >
> > >
> >
> > [Non-text portions of this message have been removed]
> >
> > ------------------------------------
> >
> > Useful links for the Yahoo!Groups Vantage Board are: ( Note: You must
> > have already linked your email address to a yahoo id to enable access.
> > )
> > (1) To access the Files Section of our Yahoo!Group for Report Builder
> > and Crystal Reports and other 'goodies', please goto:
> > http://groups.yahoo.com/group/vantage/files/.
> > (2) To search through old msg's goto:
> > http://groups.yahoo.com/group/vantage/messages
> > (3) To view links to Vendors that provide Vantage services goto:
> > http://groups.yahoo.com/group/vantage/linksYahoo! Groups Links
> >
> >
> >
>
> [Non-text portions of this message have been removed]
>
> ------------------------------------
>
> Useful links for the Yahoo!Groups Vantage Board are: ( Note: You must have
> already linked your email address to a yahoo id to enable access. )
> (1) To access the Files Section of our Yahoo!Group for Report Builder and
> Crystal Reports and other 'goodies', please goto:
> http://groups.yahoo.com/group/vantage/files/.
> (2) To search through old msg's goto:
> http://groups.yahoo.com/group/vantage/messages
> (3) To view links to Vendors that provide Vantage services goto:
> http://groups.yahoo.com/group/vantage/linksYahoo! Groups Links
>
>
>
[Non-text portions of this message have been removed]