on 08-08-2007 1:34 PM
I am doing outer join between 2 xml output, and size the outputs 1 MB and 2MB. It takes 4 minutes.
Is there any aleternative way of joining which will minimize the duration. Duirng this operation CPU also peaks.
There is no alternative way to handle performance in XMII framework
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
I have to say, those are very large xml files. In my experience, XML's structure doesn't really lend itself to high performance when using large files, period. On any platform, and I have dealt with it on many. Custom code may not get you the improvements in performance you are looking for. You should really revisit your process. You could try looping on the smaller set and pulling the data you need out of the other source in a loop. Multiple SQL queries may be faster than the system traversing a large xml dataset. I have seen it. It works. You could then unwind the loop etc. Is cahing the data an option? Is this a situation where you can churn the bulk in the morning and then only deal with deltas through the day?
It might even be better to just dump the data into a common database.
have you determined how long it is taking to load the data from your queries?
Message was edited by:
christian libich
Message was edited by:
christian libich
What are the specs of your xMII server? How much memory is allocated to xMII?
How many rows of data do each of the xml documents have?
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Looks like 1536 MB is allocated. Based install guid this is max you can allocated right?
This is the content of servlet start bat:
"C:\j2sdk1.4.2_07\bin\java" -Xmx1536m -classpath "C:\j2sdk1.4.2_07\lib\tools.jar;C:\ServletExec AS\lib\activation.jar;C:\ServletExec AS\lib\mail.jar;C:\ServletExec AS\lib\jaxp-api.jar;C:\ServletExec AS\lib\dom.jar;C:\ServletExec AS\lib\sax.jar;C:\ServletExec AS\lib\xercesImpl.jar;C:\ServletExec AS\lib\xalan.jar;C:\ServletExec AS\lib\xsltc.jar;C:\ServletExec AS\lib\jstl.jar;C:\ServletExec AS\lib\standard.jar;C:\ServletExec AS\lib\jdbc2_0-stdext.jar;C:\ServletExec AS\lib\commons-el.jar;C:\ServletExec AS\lib\servlet.jar;C:\ServletExec AS\lib\ServletExec50.jar;C:\ServletExec AS\lib\ServletExecAdmin.jar;C:\ServletExec AS\se-xMII\classes" -Djava.naming.factory.initial=com.newatlanta.servletexec.InitialContextFactory ServletExec -name "xMII" -home "C:\ServletExec AS\se-xMII" -root "C:\InetPub\wwwroot" -port 8888
User | Count |
---|---|
11 | |
6 | |
2 | |
1 | |
1 | |
1 | |
1 | |
1 | |
1 | |
1 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.