Slow Import

Jhstephenson

I am moving a system over to Aware. In importing the existing data into my BOs I am having some real frustrations with the speed of importing data. We are moving this into MySQL.

For example, I have a CaseMaster that has about 78000 records in it and a Charges table that has about 98000 records.

When the CaseMaster is imported it also links to a ClientMaster, which was previously imported, with a unique Client ID attribute. The Charges table links to the CaseMaster with a unique Case ID attribute.

I have a process that runs the import for the CaseMaster in the background and then immediately after imports the Charges file. I started the import yesterday at 5:00pm. The CaseMaster finished at about 8pm last night and the Charges import is still running 12 hrs later.

This seems ridiculously long.

What could be going on that would make this run so slow?

Thanks,
Jim

Jaymer

slow? all the rules are firing... there's a NO VALIDATION option.
if this is a one-time thing, maybe disable a bunch of rules.

saying that, imports are slow.
another option is to import straight into a temp table, then a process to move them over.
or a SQL import

You may think this is the one time to import - but if there's something you missed, you may have to import several times. all those hours will add up.
in SQL it could update in a few minutes max

tford

Also is you decided to leave validation turned on so that rules do keep firing during an import, I've found that with a lot of interrelated BOs, it can be very helpful to tick "do not check referred attributes" on certain rules.