dhis2-users team mailing list archive

[Mark Spohr <mhspohr@xxxxxxxxx>]

I'm trying to import a large data set into the dhis-live so I can review
the data and run some reports.
I encounter an error processing the dxf file (about line 10,000 of the
import file):

(null,'Buni',null,'Buni','020302','1990-01-01',null,true,'Buni Health
Facility',null,null,null,'2010-06-07',false),(null,'Lokuru',null,'Lokuru','020309','1990-01-01',null,true,'Lokuru
Health
Facility',null,null,null,'2010-06-07',false),(null,'Jella',null,'Jella','020313','1990-01-01',null,true,'Jella
Health Facility',null,null,null,'2010-06-07',false) [23505-154]
    at org.h2.message.DbException.getJdbcSQLException(DbException.java:327)
    at org.h2.message.DbException.get(DbException.java:167)
    at org.h2.message.DbException.get(DbException.java:144)
    at org.h2.index.BaseIndex.getDuplicateKeyException(BaseIndex.java:80)
    at org.h2.index.PageBtree.find(PageBtree.java:121)
    at org.h2.index.PageBtreeLeaf.addRow(PageBtreeLeaf.java:146)
    at org.h2.index.PageBtreeLeaf.addRowTry(PageBtreeLeaf.java:100)
    at org.h2.index.PageBtreeIndex.addRow(PageBtreeIndex.java:93)
    at org.h2.index.PageBtreeIndex.add(PageBtreeIndex.java:84)
    at org.h2.table.RegularTable.addRow(RegularTable.java:127)
    at org.h2.command.dml.Insert.insertRows(Insert.java:126)
    at org.h2.command.dml.Insert.update(Insert.java:86)
    at org.h2.command.CommandContainer.update(CommandContainer.java:69)
    at org.h2.command.Command.executeUpdate(Command.java:212)
    at
org.h2.jdbc.JdbcStatement.executeUpdateInternal(JdbcStatement.java:125)
    at org.h2.jdbc.JdbcStatement.executeUpdate(JdbcStatement.java:110)
    at
org.amplecode.quick.batchhandler.AbstractBatchHandler.flush(AbstractBatchHandler.java:295)
    ... 7 more

The dxf import file (created from dhis 2.5) looks like this:

<uuid>9952BDB6-18CD-4DFB-BFF7-16B907DA2715</uuid>
<name>Buni</name>
<shortName>Buni</shortName>
<code>020302</code>
<openingDate>1990-01-01</openingDate>
<closedDate></closedDate>
<active>true</active>
<comment>Buni Health Facility</comment>
<geoCode></geoCode>
<feature type="">
</feature>
<lastUpdated>2010-06-07</lastUpdated>
</organisationUnit>
<organisationUnit>
<id>562</id>
<uuid>9828E889-C99F-4B62-BBD6-C608040E89D8</uuid>
<name>Lokuru</name>
<shortName>Lokuru</shortName>
<code>020309</code>
<openingDate>1990-01-01</openingDate>
<closedDate></closedDate>
<active>true</active>
<comment>Lokuru Health Facility</comment>
<geoCode></geoCode>
<feature type="">
</feature>
<lastUpdated>2010-06-07</lastUpdated>
</organisationUnit>
<organisationUnit>
<id>566</id>
<uuid>C258A163-CB4E-42AD-AD76-FD6EC5DBA10F</uuid>
<name>Jella</name>
<shortName>Jella</shortName>
<code>020313</code>
<openingDate>1990-01-01</openingDate>
<closedDate></closedDate>
<active>true</active>
<comment>Jella Health Facility</comment>
<geoCode></geoCode>
<feature type="">
</feature>
<lastUpdated>2010-06-07</lastUpdated>
</organisationUnit>
</organisationUnits>
<organisationUnitRelationships>
<organisationUnitRelationship>
<parent>879</parent>
<child>495</child>
</organisationUnitRelationship>
<organisationUnitRelationship>
<parent>879</parent>
<child>683</child>
</organisationUnitRelationship>
<organisationUnitRelationship>
<parent>879</parent>
<child>538</child>
</organisationUnitRelationship>
<organisationUnitRelationship>
<parent>879</parent>
<child>739</child>
</organisationUnitRelationship>

Note: Jella appears to be the last facility before the transition to the
organisationUnitRelationship set of data (which goes on for several
thousand lines).

Any ideas on the problem here?
Is this just too much data to try to import?

.Mark

-- 
Mark Spohr, MD