.csv Import with .Ref - video or sample .bsv

ninap

hello,

we have read in the docs folder the text file on import/export.
and serached the forums. (avoiding the common response that it is well documented)

if anyone has advice on how to solve "many" ref. items during import that would be very usefull

we have tried for 48 hours to find a more simple way to import 10k records which are rel. to different BO's but cannot find a more simple way.

how we do it is.

export each bo so we get the exact Ref. and Table fields
then we open Excel and cut and paste fields we wish to import into the
correct collumns.

issue: ref. there typically field ids which are not simple to map

example:

we have a States and Zipcodes BO with a ref from Zicode.State back to States. So in this import we are mapping 50 states to +5k zipcodes..

perhaps i am not smart enough to figure a simpler solution.

txs, nina 🙁

tford

"many" should not have any effect on your import other than a longer processing time.

If you can get a small file to import properly, there is no reason why the same import would not work for "many" transactions.

If you want help with your specific situtation, it would be helpful for you to include details of what you tried & why it did not work.

ninap

if it is ok I will post an example with attachments or screen shots

txs, nina 🙂

ninap

here is an example:

1) Our BSV has TWO BO's

2) Our States BO has a relation to Zipcodes

STATES.ZIPCODES -> ZIPCODES.STATE

3) We want to import our Zipcode list but relate the correct states to the correct zipcodes.

The Exported Relationships File is two collumns

States.ID - States.Zipcode.ID
629 - Zipcodes#623

Our question is we have over 10k zipcodes - So is the process we must
relate them all using the ID's or is there another way?

How do people import 10k related records from other systems in the best way?

(also we cannot upload documents so we cannot add the files)

txs, nina 😐

tford

Have you looked at the sample apps for examples of how to import CSVs?

ninap

hi, it is actually not an issue of How-To as i have been importing now for a couple days. But a question if there is a better way.

there are no posts here which people describe a best pratice.

Example: to import States and Zipcodes to make them related will take maybe 6 hours if i am not interupted mapping fieldid's like 732,222,1121 which - a State record to a Zipcode...

Now imagine importing more complexe with 4 BO's..

how do people migrate data from system to system - perhaps this is not the best method to load new data and i should revert to an ETL direct to MySQL..

txs nina, 😐

tford

You do not have to have the IDs to import, you can just use values. The sample apps show that concept. For example, line_items.csv file in of the Ordering sample app.

itdeptcorp

Nina,

We have been doing similar imports for about a year.
PM me with your email address and we can exchange examples.

Please do look at the examples Tom mentioned in the sample BSV's first though.

Thanks, Mark

ninap

txs for the help..

now the wierd part is..

we have an import into a BO called Makeup, but we want to update some of the fields in that BO.

The rule is:

- If there is ID attribute among column descriptions, the object corresponding to this ID will be updated

The question is:
so now does anyone know of a way to more easily manage updates? with 10k records?

the import queen
nina 🙂

tford

nina,

You keep focusing on the ID. Are you thinking you MUST have the ID to do an import? If so, this is not accurate. A more specific question than "do you know ...more easily manage updates" would be helpful.

ninap

tom, hi

thats correct.. "does anyone know an easier method to perform updates?"

txs, nina 😐

tford

Ordering sample file "line_items.csv" uses LineItem.PurchaseOrder.OrderNumber and not a ID key.

CRM sample file "customer_alerts.csv" uses CustomerAlert.Customer.LastName and not a ID key.

CRM sample file "outgoing_emails.csv" uses OutgoingEmail.Correspondent.LastName and not a ID key.

ninap

perhaps there is a missunderstanding.

vocabulary..

def. Import (first time mass-data insert)
def. Updating (updating exsisting records by performing an import)

using your example.

when i import the same file twice it creates two records? correct.. so this is not updating.

if i import a third time with some changes (to the same .csv) it creates another record entry. this is still not updating

so, to update records which exsit in the db, you must use the ID? is this incorrect..

So back to my original question - does anyone perform routine updates and how do you overcome the mapping

txs, nina 🙁

NBDAB

NOTE: It is possible to use a particular attribute, rather than ID attribute to indicate update operation.

If you add “*” symbol before the name of the object and attribute in the
header of the CSV file, Aware IM will use values of this attribute to find instances of business objects to modify (only one instance must be found for each value of the attribute). This may be useful when exchanging data with non-Aware IM systems that do not have the ID attribute.

Taken directly from user_guide