← Back to team overview

dhis2-devs team mailing list archive

Re: Problem on CSV Data Element import - Version 2.25

 

Hi,

You are correct - it imports (fast!!) if a number of additional fields are
added.

Best regards
Calle

On 26 November 2016 at 18:25, Aanyo AHIAGNO <meloprod7@xxxxxxxxx> wrote:

> But this will be confirmed by Dev team.
>
> Thanks
>
> 2016-11-26 15:38 GMT+00:00 Aanyo AHIAGNO <meloprod7@xxxxxxxxx>:
>
>> Yes, is not optional on 2.25.  So don't worry, the developer manual
>> documentation will be mention it
>>
>> 2016-11-26 15:25 GMT+00:00 Calle Hedberg <calle.hedberg@xxxxxxxxx>:
>>
>>> Hi,
>>>
>>> So you are actually saying that categorycomboid is no longer optional...
>>> Then that is either a BUG or else the developer manual documentation is out
>>> of synch...
>>>
>>> Will try
>>>
>>> Regards
>>> Calle
>>>
>>> On 26 November 2016 at 17:13, Aanyo AHIAGNO <meloprod7@xxxxxxxxx> wrote:
>>>
>>>> IS Okay now.
>>>> Put categorycomboid = default and it will be fine.
>>>>
>>>> Thanks
>>>>
>>>> 2016-11-26 14:28 GMT+00:00 Calle Hedberg <calle.hedberg@xxxxxxxxx>:
>>>>
>>>>> Hi,
>>>>>
>>>>> I've tested this with the simplest CSV file imagineable - just two
>>>>> data element names:
>>>>> "Emergency headcount total"
>>>>> "OPD headcount not referred new"
>>>>> Error is the same
>>>>>
>>>>> The manual states very clearly that the ONLY compulsory field when
>>>>> importing Data Elements in CSV format is the first "Name" field.
>>>>>
>>>>> Bottom line - the import from CSV is broken in 2.25 and 2.26 Trunk. OR
>>>>> ELSE there is something missing from our installations, some library or
>>>>> something.
>>>>>
>>>>> Sigh - I hope this can be fixed asap, it's a real real pain to have to
>>>>> shift an instance back to e.g. 2.24 or earlier to make this type of basic
>>>>> functionality work
>>>>>
>>>>> Regards
>>>>> Calle
>>>>>
>>>>> On 26 November 2016 at 16:10, Calle Hedberg <calle.hedberg@xxxxxxxxx>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I've just tried the same in Trunk - importing a CSV file with data
>>>>>> elements, same format as what used to work in previous versions. My tomcat
>>>>>> log shows the following:
>>>>>>
>>>>>> * INFO  2016-11-26 16:04:24,017 (Calle_Hedberg)
>>>>>> Import:Preheat[REFERENCE] took 0.11 seconds (DefaultPreheatService.java
>>>>>> [taskScheduler-8])
>>>>>> * ERROR 2016-11-26 16:04:24,027 Unexpected error occurred in
>>>>>> scheduled task. (TaskUtils.java [taskScheduler-8])
>>>>>> org.hibernate.LazyInitializationException: failed to lazily
>>>>>> initialize a collection of role: org.hisp.dhis.dataelement.Data
>>>>>> ElementCategoryCombo.translations, could not initialize p
>>>>>> roxy - no Session
>>>>>>         at org.hibernate.collection.inter
>>>>>> nal.AbstractPersistentCollection.throwLazyInitializationExce
>>>>>> ption(AbstractPersistentCollection.java:579)
>>>>>>         at org.hibernate.collection.inter
>>>>>> nal.AbstractPersistentCollection.withTemporarySessionIfNeede
>>>>>> d(AbstractPersistentCollection.java:203)
>>>>>>         at org.hibernate.collection.inter
>>>>>> nal.AbstractPersistentCollection.initialize(AbstractPersiste
>>>>>> ntCollection.java:558)
>>>>>>         at org.hibernate.collection.inter
>>>>>> nal.AbstractPersistentCollection.read(AbstractPersistentColl
>>>>>> ection.java:131)
>>>>>>         at org.hibernate.collection.inter
>>>>>> nal.PersistentSet.iterator(PersistentSet.java:163)
>>>>>>         at java.util.AbstractCollection.addAll(Unknown Source)
>>>>>>         at org.hisp.dhis.common.BaseIdent
>>>>>> ifiableObject.mergeWith(BaseIdentifiableObject.java:763)
>>>>>>         at org.hisp.dhis.dataelement.Data
>>>>>> ElementCategoryCombo.mergeWith(DataElementCategoryCombo.java:327)
>>>>>>         at org.hisp.dhis.dataelement.Data
>>>>>> ElementCategoryCombo.mergeWith(DataElementCategoryCombo.java:51)
>>>>>>         at org.hisp.dhis.preheat.DefaultP
>>>>>> reheatService.lambda$collectObjectReferences$28(DefaultPrehe
>>>>>> atService.java:635)
>>>>>>         at java.util.ArrayList.forEach(Unknown Source)
>>>>>>         at org.hisp.dhis.preheat.DefaultP
>>>>>> reheatService.collectObjectReferences(DefaultPreheatService.java:624)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>> Method)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at java.lang.reflect.Method.invoke(Unknown Source)
>>>>>>         at org.springframework.aop.suppor
>>>>>> t.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:302)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMet
>>>>>> hodInvocation.java:190)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:157)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionInterceptor$1.proceedWithInvocation
>>>>>> (TransactionInterceptor.java:99)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionAspectSupport.invokeWithinTransacti
>>>>>> on(TransactionAspectSupport.java:281)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionInterceptor.invoke(TransactionInter
>>>>>> ceptor.java:96)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:179)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
>>>>>>         at com.sun.proxy.$Proxy236.collectObjectReferences(Unknown
>>>>>> Source)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>> Method)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at java.lang.reflect.Method.invoke(Unknown Source)
>>>>>>         at org.springframework.aop.suppor
>>>>>> t.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:302)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMet
>>>>>> hodInvocation.java:190)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:157)
>>>>>>         at org.springframework.aop.suppor
>>>>>> t.DelegatingIntroductionInterceptor.doProceed(DelegatingIntr
>>>>>> oductionInterceptor.java:133)
>>>>>>         at org.springframework.aop.suppor
>>>>>> t.DelegatingIntroductionInterceptor.invoke(DelegatingIntrodu
>>>>>> ctionInterceptor.java:121)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:179)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
>>>>>>         at com.sun.proxy.$Proxy165.collectObjectReferences(Unknown
>>>>>> Source)
>>>>>>         at org.hisp.dhis.dxf2.metadata.ob
>>>>>> jectbundle.DefaultObjectBundleService.create(DefaultObjectBu
>>>>>> ndleService.java:113)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>> Method)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at java.lang.reflect.Method.invoke(Unknown Source)
>>>>>>         at org.springframework.aop.suppor
>>>>>> t.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:302)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMet
>>>>>> hodInvocation.java:190)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:157)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionInterceptor$1.proceedWithInvocation
>>>>>> (TransactionInterceptor.java:99)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionAspectSupport.invokeWithinTransacti
>>>>>> on(TransactionAspectSupport.java:281)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionInterceptor.invoke(TransactionInter
>>>>>> ceptor.java:96)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:179)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
>>>>>>         at com.sun.proxy.$Proxy186.create(Unknown Source)
>>>>>>         at org.hisp.dhis.dxf2.metadata.De
>>>>>> faultMetadataImportService.importMetadata(DefaultMetadataImp
>>>>>> ortService.java:107)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>> Method)
>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown
>>>>>> Source)
>>>>>>         at java.lang.reflect.Method.invoke(Unknown Source)
>>>>>>         at org.springframework.aop.suppor
>>>>>> t.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:302)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMet
>>>>>> hodInvocation.java:190)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:157)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionInterceptor$1.proceedWithInvocation
>>>>>> (TransactionInterceptor.java:99)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionAspectSupport.invokeWithinTransacti
>>>>>> on(TransactionAspectSupport.java:281)
>>>>>>         at org.springframework.transactio
>>>>>> n.interceptor.TransactionInterceptor.invoke(TransactionInter
>>>>>> ceptor.java:96)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
>>>>>> ation.java:179)
>>>>>>         at org.springframework.aop.framew
>>>>>> ork.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
>>>>>>         at com.sun.proxy.$Proxy188.importMetadata(Unknown Source)
>>>>>>         at org.hisp.dhis.importexport.act
>>>>>> ion.util.ImportMetaDataCsvTask.call(ImportMetaDataCsvTask.java:98)
>>>>>>         at org.hisp.dhis.security.Securit
>>>>>> yContextRunnable.run(SecurityContextRunnable.java:57)
>>>>>>         at org.springframework.scheduling
>>>>>> .support.DelegatingErrorHandlingRunnable.run(DelegatingError
>>>>>> HandlingRunnable.java:54)
>>>>>>         at java.util.concurrent.Executors$RunnableAdapter.call(Unknown
>>>>>> Source)
>>>>>>         at java.util.concurrent.FutureTask.run(Unknown Source)
>>>>>>         at java.util.concurrent.Scheduled
>>>>>> ThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown Source)
>>>>>>         at java.util.concurrent.Scheduled
>>>>>> ThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
>>>>>>         at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
>>>>>> Source)
>>>>>>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>>>>>> Source)
>>>>>>         at java.lang.Thread.run(Unknown Source)
>>>>>>
>>>>>>
>>>>>> Regards
>>>>>> Calle
>>>>>>
>>>>>> On 26 November 2016 at 12:34, Knut Staring <knutst@xxxxxxxxx> wrote:
>>>>>>
>>>>>>> Do you have access to the log from the server?
>>>>>>>
>>>>>>> On Nov 26, 2016 11:20 AM, "Aanyo AHIAGNO" <meloprod7@xxxxxxxxx>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>> I making a test, so i try to import on my csv just 2 data element.
>>>>>>>> but it load too long. i'm not sure that is working.
>>>>>>>> i join my csv.
>>>>>>>> 2016-11-26 09:41:46 (admin) Import:Start
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> [image: Images intégrées 1]
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>>
>>>>>>>> 2016-11-26 10:10 GMT+00:00 Knut Staring <knutst@xxxxxxxxx>:
>>>>>>>>
>>>>>>>>> Hi Aanyo,
>>>>>>>>>
>>>>>>>>> Could you describe what is happening? "Is not working" is not very
>>>>>>>>> helpful for understanding what the problem might be.
>>>>>>>>>
>>>>>>>>> Knut
>>>>>>>>>
>>>>>>>>> On Sat, Nov 26, 2016 at 11:06 AM, Aanyo AHIAGNO <
>>>>>>>>> meloprod7@xxxxxxxxx> wrote:
>>>>>>>>>
>>>>>>>>>> Hi all,
>>>>>>>>>>
>>>>>>>>>> The CSV data elemnt import does not work well on the 2.25. Does
>>>>>>>>>> someone have a good template CSV of Data Element for 2.25?
>>>>>>>>>>
>>>>>>>>>> *Is not working*
>>>>>>>>>>
>>>>>>>>>> [image: Images intégrées 1]
>>>>>>>>>>
>>>>>>>>>> *Is not working*
>>>>>>>>>>
>>>>>>>>>> name,uid,code,shortname,description,formname,domaintype,valu
>>>>>>>>>> etype,aggregationtype,categorycomboid,url,zeroissignificant,
>>>>>>>>>> optionset
>>>>>>>>>> DS_Polio 1st dose given,,,DS_Polio 1st dose given,,DS_Polio 1st
>>>>>>>>>> dose given,AGGREGATE,TEXT,,GvTQH2bALqZ,,,beLZmBucDZa
>>>>>>>>>>
>>>>>>>>>> *Is not working*
>>>>>>>>>>
>>>>>>>>>> name,uid,code,shortname,description
>>>>>>>>>> "Women participated in skill development
>>>>>>>>>> training",,"D0001","Women participated
>>>>>>>>>> development training"
>>>>>>>>>> "Women participated in community organizations",,"D0002","Women
>>>>>>>>>> participated community
>>>>>>>>>> organizations"
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> AHIAGNO Aanyo
>>>>>>>>>> HISP West Africa
>>>>>>>>>> 0022890962285
>>>>>>>>>>
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-devs
>>>>>>>>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Knut Staring
>>>>>>>>> Dept. of Informatics, University of Oslo
>>>>>>>>> Norway: +4791880522
>>>>>>>>> Skype: knutstar
>>>>>>>>> http://dhis2.org
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> AHIAGNO Aanyo
>>>>>>>> HISP West Africa
>>>>>>>> 0022890962285
>>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Mailing list: https://launchpad.net/~dhis2-devs
>>>>>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> *******************************************
>>>>>>
>>>>>> Calle Hedberg
>>>>>>
>>>>>> 46D Alma Road, 7700 Rosebank, SOUTH AFRICA
>>>>>>
>>>>>> Tel/fax (home): +27-21-685-6472
>>>>>>
>>>>>> Cell: +27-82-853-5352
>>>>>>
>>>>>> Iridium SatPhone: +8816-315-19119
>>>>>>
>>>>>> Email: calle.hedberg@xxxxxxxxx
>>>>>>
>>>>>> Skype: calle_hedberg
>>>>>>
>>>>>> *******************************************
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> *******************************************
>>>>>
>>>>> Calle Hedberg
>>>>>
>>>>> 46D Alma Road, 7700 Rosebank, SOUTH AFRICA
>>>>>
>>>>> Tel/fax (home): +27-21-685-6472
>>>>>
>>>>> Cell: +27-82-853-5352
>>>>>
>>>>> Iridium SatPhone: +8816-315-19119
>>>>>
>>>>> Email: calle.hedberg@xxxxxxxxx
>>>>>
>>>>> Skype: calle_hedberg
>>>>>
>>>>> *******************************************
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> AHIAGNO Aanyo
>>>> HISP West Africa
>>>> 0022890962285
>>>>
>>>
>>>
>>>
>>> --
>>>
>>> *******************************************
>>>
>>> Calle Hedberg
>>>
>>> 46D Alma Road, 7700 Rosebank, SOUTH AFRICA
>>>
>>> Tel/fax (home): +27-21-685-6472
>>>
>>> Cell: +27-82-853-5352
>>>
>>> Iridium SatPhone: +8816-315-19119
>>>
>>> Email: calle.hedberg@xxxxxxxxx
>>>
>>> Skype: calle_hedberg
>>>
>>> *******************************************
>>>
>>>
>>
>>
>> --
>> AHIAGNO Aanyo
>> HISP West Africa
>> 0022890962285
>>
>
>
>
> --
> AHIAGNO Aanyo
> HISP West Africa
> 0022890962285
>



-- 

*******************************************

Calle Hedberg

46D Alma Road, 7700 Rosebank, SOUTH AFRICA

Tel/fax (home): +27-21-685-6472

Cell: +27-82-853-5352

Iridium SatPhone: +8816-315-19119

Email: calle.hedberg@xxxxxxxxx

Skype: calle_hedberg

*******************************************

PNG image

PNG image


References