How AwareIM processes records when using IN BATCHES OF

rbross

Hello,

My question is how AwareIM is processing the records it is returning.
It was my understanding that if you did a FIND BO Where(...) IN BATCHES OF 20 That it will return the records it finds in chunks of 20 records at a time and then do each consecutive process for each record it returns one at a time.

I am not seeing this action in the log viewer. I looks like it returns 20 records does the updates it needs to do, then goes and gets the next 20. It does not move on to the next process for each record until it had returned all the records it can find in this case it is 60 records.
What Am an seeing is it continue with the other processes only after it has read the last record.

Do I need to do this FIND and other FINDS that I have within this process made up of several sub process IN BATCHES OF 1.

I need it to go through all the processes and create a records at the end if the condition is met. Then go back and get the 2nd records and so on.....

Do I need to order my processes a certain way so I can get this type of record processing 1 at a time?

Thank You,
Roger

aware_support

The best approach here is to use a sub-process to process each record found. So the main process should just have a FIND with IN BATCHES OF followed by a sub-process, nothing else:

FIND ... IN BATCHES OF ..
ProcessRecord

IN BATCHES OF will make sure that only a limited number of records are read, which avoids potential memory problems if your FIND finds large amounts of data. It also commits a transaction after every batch.

rbross

After thinking about it that is exactly what I came up with.
I will pull all the other rules out of the process that does the first FIND and create a separate process for them.
There are several FINDS that I need to do so for each one of those should it be in its own process?

One of them does a find on apinv_line then does another find right after it on apinv_hdr. Is it OK if these two finds are together in the same process or should they be separated?

I also have several IF(...) then do this. Should the IF Then statements be in their own process as well?
This way everything is separated into individual steps.

Does this sound like I am starting to think the way AwareIM processes records and understanding what Context means? If I understand what Mark B. has been telling all this time AwareIM works with a single records at a time and then moves on to the next record...

Thanks,
Roger

rbross

I changed my 2nd FIND to IN BATCHES OF 1 from 20 ( this will return a total of 60 records)
because it was still updating my temp fields for all 20 then getting the next 20 updating those etc. then going on to the next process.
I'll try to give a picture of what this process is doing:
In the starting process it has these Rules which mostly just call other processes

FIND ALL Temp_BO IN BATCHES OF 1 ( there is only 1 record, its use to hold certain values)
FIND p21_sales_history_view Where(...) ( this will return a total 60 records for the condition provided)
Update Temp Field (called process)
Check AVXSAlesLedger_For Sales Order (called process)( this checks to see if the sale order is already in the AVX Sales Ledger table)
Continue IF AVX_SalesLedger record not found
If( TempBO.AVXSalesLedgerRecordFound='No'
Then ( below are all called processes) Else it should stop processing that record and go back and get the next one correct?
FIND PO Hdr (with a sub process)
Reset Some Temp values
Read apinv_line ( with 3 sub processes)
Find Temp AVXPurchase to update Probable PO ( with 1 sub process)
Update PO ( with 1 sub process)
Find lowest SPA Price ( with 6 sub processes. each called only if price was not found in the previous sub process)
Create AVX SalesLedger Record ( creates the record which is the whole point of the process)

AwareIM should return back to the top process and get the next record and step through everything again correct?
I feel like i am missing something on how AwareiM is processing the records?

Any insight or help in working this routine out is greatly appreciated. This is tIme sensitive for the customer! the last big process I need to get working....

Regards,
Roger

customaware

Hi Roger,

I am a bit tied up so don't have time to analyse in detail but.....

First find does not need to be IN BATCHES OF 1

It should work without the BATCHES of if only 1 record. I would tend to add TAKE BEST 1 to be sure.

Have you watched and stepped through the log to see what is happening?

Backup the Process (Copy and Paste) and then build each part step by step and run it watching the log.

You should be able to see exactly where the problem is.

Am heading back home tomorrow so will try an have a look while in transit.

rbross

Hi Mark,

Yes, I have been watching it in the log, but the log goes by fast and does not always let you see them whole process.
I will write it out to a file so I can review it that way.
I have been doing exactly what you suggested, take it step by step and watch the log.
When doing the 2nd FIND I think that needs to be IN BATCHES OF 1 so it will go through the entire process, otherwise it just updated the same temp fields in batches of 20 and I only get the last record.

I will step through it again to see if I can find the issue within one of the called processes.

Thanks,
Roger