dhis2-devs team mailing list archive
-
dhis2-devs team
-
Mailing list archive
-
Message #46124
Re: Bugs in DHIS new importer.
Hi Sergio
I could reproduce your error, will try and have a fix ready today and
backport to 2.24.
--
Morten Olav Hansen
Senior Engineer, DHIS 2
University of Oslo
http://www.dhis2.org
On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela <
sergio.valenzuela@xxxxxxxx> wrote:
> Thanks Morten. Keep me up please.
>
> Best regards!
>
>
> *Sergio Valenzuela*
> Fundación EHAS
> Telemedicina para países en desarrollo -* www.ehas.org
> <http://www.ehas.org/>*
> E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040
> Madrid - España
> Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62
>
>
>
> 2016-07-27 16:28 GMT+02:00 Morten Olav Hansen <morten@xxxxxxxxx>:
>
>> Hi Sergio
>>
>> Not sure exactly what is wrong there, but will try and reproduce and fix
>> tomorrow.
>>
>> --
>> Morten Olav Hansen
>> Senior Engineer, DHIS 2
>> University of Oslo
>> http://www.dhis2.org
>>
>> On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela <
>> sergio.valenzuela@xxxxxxxx> wrote:
>>
>>> Hello devs,
>>>
>>> I'm getting the "Exception occurred while trying to import the
>>> metadata. object references an unsaved transient instance - save the
>>> transient instance before flushing: org.hisp.dhis.dataelement.DataElement
>>> (MetadataSyncTask.java [taskScheduler-9])" error when using the new
>>> exporter/importer (/api/24/metadata). I'm exporting event charts and event
>>> reports from one DHIS2 instance to another (same version same build: 2.24
>>> and 23522). Metadata is the same in both instances.
>>>
>>> Full stack trace attached.
>>> URL: http://localhost:8080/api/24/metadata
>>> Example eventCharts Payload:
>>> {
>>> "date": "2016-07-27T12:54:31.851+0000",
>>> "eventCharts": [
>>> {
>>> "lastUpdated": "2016-07-26T15:57:08.779+0000",
>>> "id": "uM4KpocRONz",
>>> "created": "2016-07-26T15:57:08.779+0000",
>>> "name": "Acurenam: Mortalidad total: Nº de muertes",
>>> "showData": true,
>>> "publicAccess": "rw------",
>>> "userOrganisationUnitChildren": false,
>>> "type": "LINE",
>>> "hideEmptyRows": false,
>>> "userOrganisationUnit": false,
>>> "hideNaData": false,
>>> "completedOnly": false,
>>> "sortOrder": 0,
>>> "collapseDataDimensions": false,
>>> "userOrganisationUnitGrandChildren": false,
>>> "hideSubtitle": false,
>>> "outputType": "EVENT",
>>> "title": "Número de muertes",
>>> "hideLegend": false,
>>> "externalAccess": false,
>>> "hideTitle": false,
>>> "regression": false,
>>> "program": {
>>> "id": "yBICFtJAYFR"
>>> },
>>> "relativePeriods": {
>>> "thisYear": false,
>>> "quartersLastYear": false,
>>> "last52Weeks": false,
>>> "thisWeek": false,
>>> "lastMonth": false,
>>> "monthsThisYear": false,
>>> "last2SixMonths": false,
>>> "thisQuarter": false,
>>> "last12Months": false,
>>> "last5FinancialYears": false,
>>> "thisSixMonth": false,
>>> "lastQuarter": false,
>>> "thisFinancialYear": false,
>>> "last4Weeks": false,
>>> "last3Months": false,
>>> "thisMonth": false,
>>> "last5Years": false,
>>> "last6BiMonths": false,
>>> "lastFinancialYear": false,
>>> "last6Months": false,
>>> "quartersThisYear": false,
>>> "monthsLastYear": false,
>>> "lastWeek": false,
>>> "thisBimonth": false,
>>> "lastBimonth": false,
>>> "lastSixMonth": false,
>>> "lastYear": false,
>>> "last12Weeks": true,
>>> "last4Quarters": false
>>> },
>>> "programStage": {
>>> "id": "PgGkk7ELhw7"
>>> },
>>> "user": {
>>> "id": "mGMEUNgjTYA"
>>> },
>>> "attributeDimensions": [],
>>> "translations": [],
>>> "filterDimensions": [
>>> "ou"
>>> ],
>>> "organisationUnitGroups": [],
>>> "itemOrganisationUnitGroups": [],
>>> "userGroupAccesses": [],
>>> "programIndicatorDimensions": [],
>>> "columnDimensions": [
>>> "RFGJRT5bFaC"
>>> ],
>>> "organisationUnitLevels": [],
>>> "dataElementDimensions": [
>>> {
>>> "filter": "IN:O28",
>>> "dataElement": {
>>> "id": "RFGJRT5bFaC"
>>> }
>>> }
>>> ],
>>> "periods": [],
>>> "organisationUnits": [
>>> {
>>> "id": "JnEJ2mR2WlB"
>>> }
>>> ],
>>> "rowDimensions": [
>>> "pe"
>>> ]
>>> }
>>> ]
>>> }
>>>
>>> Hope you can help me out with this.
>>>
>>> Best regards!
>>>
>>>
>>>
>>> *Sergio Valenzuela*
>>> Fundación EHAS
>>> Telemedicina para países en desarrollo -* www.ehas.org
>>> <http://www.ehas.org/>*
>>> E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040
>>> Madrid - España
>>> Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62
>>>
>>>
>>>
>>> 2016-06-29 5:18 GMT+02:00 Morten Olav Hansen <morten@xxxxxxxxx>:
>>>
>>>> @vanyas: Yes this was caught during the validation phase itself. The
>>>>> point here would be to catch such issues during configuring metadata
>>>>> itself. The use case was: We created some data set at HQ, synced to local.
>>>>> Then we created a custom attribute for data set and made it mandatory. Then
>>>>> when this version (with custom attribute info) syncs to local, we get this
>>>>> validation issues with the importer. Any general guideline for such cases.
>>>>>
>>>>
>>>> I don't disagree on that, but it's not really related to the importer.
>>>> Not sure we have any guidelines for that, in general you would never
>>>> actually change an attribute like that I think (I wouldn't mind it being
>>>> blocked), of course.. people make mistakes.. and we don't really want to
>>>> block edits either..
>>>>
>>>>
>>>>> We do not support any data approval types at this point (at least
>>>>>> nothing has been done to try and support them, it's untested)
>>>>>>
>>>>> @vanyas: Whats the plan for this in that case? If its part of metadata
>>>>> this association should get synced.
>>>>>
>>>>
>>>> We have a blueprint for adding support for this:
>>>> https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval
>>>>
>>>> It's currently set to 2.25, but nobody is assigned..
>>>>
>>>> --
>>>> Morten
>>>>
>>>> - when we updated the existing program with adding combination of
>>>>>>> categories and synched.
>>>>>>>
>>>>>>
>>>>>> This should be fixed now
>>>>>>
>>>>>> - while updating attributes in the program with registration.
>>>>>>> * ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value violates
>>>>>>> unique constraint ""programtrackedentityattribute_unique_key""
>>>>>>> Detail: Key (programid, trackedentityattributeid)=(255, 240)
>>>>>>> already exists. (SqlExceptionHelper.java [taskScheduler-6])
>>>>>>> * ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to
>>>>>>> import the metadata. could not execute statement
>>>>>>> (MetadataImportHandler.java [taskScheduler-6])
>>>>>>> org.hibernate.exception.ConstraintViolationException: could not
>>>>>>> execute statement at
>>>>>>> org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error
>>>>>>> on Edit Program Stage page. Press cancel and exception is thrown. Analytics
>>>>>>> Export Error. Process failed. null.
>>>>>>>
>>>>>>
>>>>>> Please try again, I have done several fixes related to issues like
>>>>>> this (at least similar issues)
>>>>>>
>>>>> @vanyas : Thanks. Sure will check.
>>>>>
>>>>>>
>>>>>> - Charts, pivot tables, Report Table/ Pivot Table, Event Report,
>>>>>>> Event Chart, Validation Rule
>>>>>>> Metadata Sync failed for the above metadata With the below runtime
>>>>>>> exception.
>>>>>>> --- Exception occurred while trying to import the metadata. object
>>>>>>> references an unsaved transient instance - save the transient instance
>>>>>>> before flushing: org.hisp.dhis.dataelement.DataElement
>>>>>>> (MetadataSyncTask.java [taskScheduler-9])
>>>>>>>
>>>>>>
>>>>>> This should be fixed
>>>>>>
>>>>>> - Admin user when added to dashboard item is not syncing with metadat
>>>>>>> sync.
>>>>>>>
>>>>>>
>>>>>> Will look into it
>>>>>>
>>>>>> - When deleted a legend at HQ and synced to local. The legend at
>>>>>>> Local also is deleted on UI (exists in DB). Also, legend is getting
>>>>>>> duplicated with a different UID in DB.
>>>>>>>
>>>>>>
>>>>>> Will look into it
>>>>>>
>>>>>>
>>>>>>> - Metadata Filter (Import-Export --> Metadata Detailed Export)
>>>>>>> modification to properties like name, description is successfully
>>>>>>> synced but the selection is not synced, the payload also have the details
>>>>>>> of the updated data when synced.
>>>>>>>
>>>>>>
>>>>>> Not sure how much time we should spend on this, the metadata filter
>>>>>> functionality should be replaced in future releases (it's not very stable,
>>>>>> and has not been updated to support new types etc)
>>>>>>
>>>>>> - custom forms are synced properly when created, but while Updation
>>>>>>> of custom form not reflecting on UI. However, payload has the full
>>>>>>> information of updates.
>>>>>>>
>>>>>>
>>>>>> Will look into it, is the issue present for both data set and program
>>>>>> stages?
>>>>>>
>>>>> @vanya: This was tested with data sets only.
>>>>>
>>>>>>
>>>>>> --
>>>>>> Morten
>>>>>>
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Thanks & Regards,
>>>>>>> Nalinikanth M
>>>>>>> Quality Analyst
>>>>>>> Email nalinim@xxxxxxxxxxxxxxxx
>>>>>>> Telephone +91 9052234588 <+91+9052234588>
>>>>>>> [image: ThoughtWorks]
>>>>>>> <http://www.thoughtworks.com/?utm_campaign=archana-chillala-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> With Regards
>>>>> ThoughtWorks Technologies
>>>>> Hyderabad
>>>>>
>>>>> --Stay Hungry Stay Foolish!!
>>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-devs
>>>> Post to : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>> More help : https://help.launchpad.net/ListHelp
>>>>
>>>>
>>>
>>
>
Follow ups
References