← Back to team overview

dhis2-devs team mailing list archive

Re: Bugs in DHIS new importer.

 

Hi Sergio

Please try again with latest 2.24

-- 
Morten Olav Hansen
Senior Engineer, DHIS 2
University of Oslo
http://www.dhis2.org

On Thu, Jul 28, 2016 at 10:56 AM, Sergio Valenzuela <
sergio.valenzuela@xxxxxxxx> wrote:

> Great! Thanks Morten.
>
>
> *Sergio Valenzuela*
> Fundación EHAS
> Telemedicina para países en desarrollo -* www.ehas.org
> <http://www.ehas.org/>*
> E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040
> Madrid - España
> Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62
>
>
>
> 2016-07-28 10:44 GMT+02:00 Morten Olav Hansen <morten@xxxxxxxxx>:
>
>> Hi Sergio
>>
>> I could reproduce your error, will try and have a fix ready today and
>> backport to 2.24.
>>
>> --
>> Morten Olav Hansen
>> Senior Engineer, DHIS 2
>> University of Oslo
>> http://www.dhis2.org
>>
>> On Wed, Jul 27, 2016 at 4:30 PM, Sergio Valenzuela <
>> sergio.valenzuela@xxxxxxxx> wrote:
>>
>>> Thanks Morten. Keep me up please.
>>>
>>> Best regards!
>>>
>>>
>>> *Sergio Valenzuela*
>>> Fundación EHAS
>>> Telemedicina para países en desarrollo -* www.ehas.org
>>> <http://www.ehas.org/>*
>>> E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040
>>> Madrid - España
>>> Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62
>>>
>>>
>>>
>>> 2016-07-27 16:28 GMT+02:00 Morten Olav Hansen <morten@xxxxxxxxx>:
>>>
>>>> Hi Sergio
>>>>
>>>> Not sure exactly what is wrong there, but will try and reproduce and
>>>> fix tomorrow.
>>>>
>>>> --
>>>> Morten Olav Hansen
>>>> Senior Engineer, DHIS 2
>>>> University of Oslo
>>>> http://www.dhis2.org
>>>>
>>>> On Wed, Jul 27, 2016 at 4:11 PM, Sergio Valenzuela <
>>>> sergio.valenzuela@xxxxxxxx> wrote:
>>>>
>>>>> Hello devs,
>>>>>
>>>>> I'm getting the "Exception occurred while trying to import the
>>>>> metadata. object references an unsaved transient instance - save the
>>>>> transient instance before flushing: org.hisp.dhis.dataelement.DataElement
>>>>> (MetadataSyncTask.java [taskScheduler-9])" error when using the new
>>>>> exporter/importer (/api/24/metadata). I'm exporting event charts and event
>>>>> reports from one DHIS2 instance to another (same version same build: 2.24
>>>>> and 23522). Metadata is the same in both instances.
>>>>>
>>>>> Full stack trace attached.
>>>>> URL: http://localhost:8080/api/24/metadata
>>>>> Example eventCharts Payload:
>>>>> {
>>>>>   "date": "2016-07-27T12:54:31.851+0000",
>>>>>   "eventCharts": [
>>>>>     {
>>>>>       "lastUpdated": "2016-07-26T15:57:08.779+0000",
>>>>>       "id": "uM4KpocRONz",
>>>>>       "created": "2016-07-26T15:57:08.779+0000",
>>>>>       "name": "Acurenam: Mortalidad total: Nº de muertes",
>>>>>       "showData": true,
>>>>>       "publicAccess": "rw------",
>>>>>       "userOrganisationUnitChildren": false,
>>>>>       "type": "LINE",
>>>>>       "hideEmptyRows": false,
>>>>>       "userOrganisationUnit": false,
>>>>>       "hideNaData": false,
>>>>>       "completedOnly": false,
>>>>>       "sortOrder": 0,
>>>>>       "collapseDataDimensions": false,
>>>>>       "userOrganisationUnitGrandChildren": false,
>>>>>       "hideSubtitle": false,
>>>>>       "outputType": "EVENT",
>>>>>       "title": "Número de muertes",
>>>>>       "hideLegend": false,
>>>>>       "externalAccess": false,
>>>>>       "hideTitle": false,
>>>>>       "regression": false,
>>>>>       "program": {
>>>>>         "id": "yBICFtJAYFR"
>>>>>       },
>>>>>       "relativePeriods": {
>>>>>         "thisYear": false,
>>>>>         "quartersLastYear": false,
>>>>>         "last52Weeks": false,
>>>>>         "thisWeek": false,
>>>>>         "lastMonth": false,
>>>>>         "monthsThisYear": false,
>>>>>         "last2SixMonths": false,
>>>>>         "thisQuarter": false,
>>>>>         "last12Months": false,
>>>>>         "last5FinancialYears": false,
>>>>>         "thisSixMonth": false,
>>>>>         "lastQuarter": false,
>>>>>         "thisFinancialYear": false,
>>>>>         "last4Weeks": false,
>>>>>         "last3Months": false,
>>>>>         "thisMonth": false,
>>>>>         "last5Years": false,
>>>>>         "last6BiMonths": false,
>>>>>         "lastFinancialYear": false,
>>>>>         "last6Months": false,
>>>>>         "quartersThisYear": false,
>>>>>         "monthsLastYear": false,
>>>>>         "lastWeek": false,
>>>>>         "thisBimonth": false,
>>>>>         "lastBimonth": false,
>>>>>         "lastSixMonth": false,
>>>>>         "lastYear": false,
>>>>>         "last12Weeks": true,
>>>>>         "last4Quarters": false
>>>>>       },
>>>>>       "programStage": {
>>>>>         "id": "PgGkk7ELhw7"
>>>>>       },
>>>>>       "user": {
>>>>>         "id": "mGMEUNgjTYA"
>>>>>       },
>>>>>       "attributeDimensions": [],
>>>>>       "translations": [],
>>>>>       "filterDimensions": [
>>>>>         "ou"
>>>>>       ],
>>>>>       "organisationUnitGroups": [],
>>>>>       "itemOrganisationUnitGroups": [],
>>>>>       "userGroupAccesses": [],
>>>>>       "programIndicatorDimensions": [],
>>>>>       "columnDimensions": [
>>>>>         "RFGJRT5bFaC"
>>>>>       ],
>>>>>       "organisationUnitLevels": [],
>>>>>       "dataElementDimensions": [
>>>>>         {
>>>>>           "filter": "IN:O28",
>>>>>           "dataElement": {
>>>>>             "id": "RFGJRT5bFaC"
>>>>>           }
>>>>>         }
>>>>>       ],
>>>>>       "periods": [],
>>>>>       "organisationUnits": [
>>>>>         {
>>>>>           "id": "JnEJ2mR2WlB"
>>>>>         }
>>>>>       ],
>>>>>       "rowDimensions": [
>>>>>         "pe"
>>>>>       ]
>>>>>     }
>>>>>   ]
>>>>> }
>>>>>
>>>>> Hope you can help me out with this.
>>>>>
>>>>> Best regards!
>>>>>
>>>>>
>>>>>
>>>>> *Sergio Valenzuela*
>>>>> Fundación EHAS
>>>>> Telemedicina para países en desarrollo -* www.ehas.org
>>>>> <http://www.ehas.org/>*
>>>>> E.T.S.I. de Telecomunicación A.101-9L. Ciudad Universitaria 30, 28040
>>>>> Madrid - España
>>>>> Tlfno. (+34) 91 488 87 41: (+34) 687 67 17 62
>>>>>
>>>>>
>>>>>
>>>>> 2016-06-29 5:18 GMT+02:00 Morten Olav Hansen <morten@xxxxxxxxx>:
>>>>>
>>>>>> @vanyas: Yes this was caught during the validation phase itself. The
>>>>>>> point here would be to catch such issues during configuring metadata
>>>>>>> itself. The use case was: We created some data set at HQ, synced to local.
>>>>>>> Then we created a custom attribute for data set and made it mandatory. Then
>>>>>>> when this version (with custom attribute info) syncs to local, we get this
>>>>>>> validation issues with the importer. Any general guideline for such cases.
>>>>>>>
>>>>>>
>>>>>> I don't disagree on that, but it's not really related to the
>>>>>> importer. Not sure we have any guidelines for that, in general you would
>>>>>> never actually change an attribute like that I think (I wouldn't mind it
>>>>>> being blocked), of course.. people make mistakes.. and we don't really want
>>>>>> to block edits either..
>>>>>>
>>>>>>
>>>>>>> We do not support any data approval types at this point (at least
>>>>>>>> nothing has been done to try and support them, it's untested)
>>>>>>>>
>>>>>>> @vanyas: Whats the plan for this in that case? If its part of
>>>>>>> metadata this association should get synced.
>>>>>>>
>>>>>>
>>>>>> We have a blueprint for adding support for this:
>>>>>> https://blueprints.launchpad.net/dhis2/+spec/exchange-data-approval
>>>>>>
>>>>>> It's currently set to 2.25, but nobody is assigned..
>>>>>>
>>>>>> --
>>>>>> Morten
>>>>>>
>>>>>> - when we updated the existing program with adding combination of
>>>>>>>>> categories and synched.
>>>>>>>>>
>>>>>>>>
>>>>>>>> This should be fixed now
>>>>>>>>
>>>>>>>> - while updating attributes in the program with registration.
>>>>>>>>> * ERROR 2016-06-21 21:23:24,325 ERROR: duplicate key value
>>>>>>>>> violates unique constraint ""programtrackedentityattribute_unique_key""
>>>>>>>>>   Detail: Key (programid, trackedentityattributeid)=(255, 240)
>>>>>>>>> already exists. (SqlExceptionHelper.java [taskScheduler-6])
>>>>>>>>> * ERROR 2016-06-21 21:23:24,385 Exception occurred while trying to
>>>>>>>>> import the metadata. could not execute statement
>>>>>>>>> (MetadataImportHandler.java [taskScheduler-6])
>>>>>>>>> org.hibernate.exception.ConstraintViolationException: could not
>>>>>>>>> execute statement at
>>>>>>>>> org.hibernate.exception.internal.SQLStateConversionDelegate.convert(SQLStateConversionDelegate.java:112)"Error
>>>>>>>>> on Edit Program Stage page. Press cancel and exception is thrown. Analytics
>>>>>>>>> Export Error. Process failed. null.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Please try again, I have done several fixes related to issues like
>>>>>>>> this (at least similar issues)
>>>>>>>>
>>>>>>> @vanyas : Thanks. Sure will check.
>>>>>>>
>>>>>>>>
>>>>>>>> - Charts, pivot tables, Report Table/ Pivot Table, Event Report,
>>>>>>>>> Event Chart, Validation Rule
>>>>>>>>> Metadata Sync failed for the above metadata With the below runtime
>>>>>>>>> exception.
>>>>>>>>> --- Exception occurred while trying to import the metadata. object
>>>>>>>>> references an unsaved transient instance - save the transient instance
>>>>>>>>> before flushing: org.hisp.dhis.dataelement.DataElement
>>>>>>>>> (MetadataSyncTask.java [taskScheduler-9])
>>>>>>>>>
>>>>>>>>
>>>>>>>> This should be fixed
>>>>>>>>
>>>>>>>> - Admin user when added to dashboard item is not syncing with
>>>>>>>>> metadat sync.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Will look into it
>>>>>>>>
>>>>>>>> - When deleted a legend at HQ and synced to local. The legend at
>>>>>>>>> Local also is deleted on UI (exists in DB). Also, legend is getting
>>>>>>>>> duplicated with a different UID in DB.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Will look into it
>>>>>>>>
>>>>>>>>
>>>>>>>>> - Metadata Filter (Import-Export --> Metadata Detailed Export)
>>>>>>>>> modification to properties like name, description is successfully
>>>>>>>>> synced but the selection is not synced, the payload also have the details
>>>>>>>>> of the updated data when synced.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Not sure how much time we should spend on this, the metadata filter
>>>>>>>> functionality should be replaced in future releases (it's not very stable,
>>>>>>>> and has not been updated to support new types etc)
>>>>>>>>
>>>>>>>> - custom forms are synced properly when created, but while Updation
>>>>>>>>> of custom form not reflecting on UI. However, payload has the full
>>>>>>>>> information of updates.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Will look into it, is the issue present for both data set and
>>>>>>>> program stages?
>>>>>>>>
>>>>>>> @vanya: This was tested with data sets only.
>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Morten
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Thanks & Regards,
>>>>>>>>> Nalinikanth M
>>>>>>>>> Quality Analyst
>>>>>>>>> Email nalinim@xxxxxxxxxxxxxxxx
>>>>>>>>> Telephone +91 9052234588 <+91+9052234588>
>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=archana-chillala-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> With Regards
>>>>>>> ThoughtWorks Technologies
>>>>>>> Hyderabad
>>>>>>>
>>>>>>> --Stay Hungry Stay Foolish!!
>>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Mailing list: https://launchpad.net/~dhis2-devs
>>>>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

Follow ups

References