data-platform team mailing list archive

[Enrico Deusebio <mp+480055@xxxxxxxxxxxxxxxxxx>]

The Integration tests have shown a few more errors developing in Hadoop, roughly doubling from 13 to 26+. 


+--------------------------------------------------------------+-------+--------+--------+---------+-------+-----------------------+
|                             Test                             |  Run  | Failed | Errors | Skipped | Total | Executed test modules |
+--------------------------------------------------------------+-------+--------+--------+---------+-------+-----------------------+
| 20250124H08M15_release-3.3.6-ubuntu4-protobuf2_7969_test.out | 24047 |   0    |   29   |   1590  | 25685 |          2880         |
| 20250124H21M51_release-3.3.6-ubuntu4-protobuf2_6809_test.out | 24047 |   0    |  102   |   1588  | 25753 |          2880         |
|            20250124H08M15_lp-3.3.6_21539_test.out            | 24131 |   0    |   13   |   1589  | 25747 |          2879         |
| 20250124H08M15_release-3.3.6-ubuntu4-protobuf2_153_test.out  | 24047 |   0    |   26   |   1588  | 25674 |          2880         |
+--------------------------------------------------------------+-------+--------+--------+---------+-------+-----------------------+


The changes are quite heavy and some tests using protobuf2 may not be very relevant anymore. Moreover, the main concern here is to have a stable hadoop-client artifact to be used in Spark, for which the failing tests are likely to not be critical. 

The release 3.3.6-ubuntu4 should be seen as edge, and in general should NOT be used directly, but only included in downstream compontents with care, with proper downstream testing. 
-- 
https://code.launchpad.net/~data-platform/soss/+source/hadoop/+git/hadoop/+merge/480055
Your team Canonical Data Platform is requested to review the proposed merge of soss/+source/hadoop:release-3.3.6-ubuntu4-protobuf2 into soss/+source/hadoop:lp-3.3.6.