← Back to team overview

lubuntu-qa team mailing list archive

How cadence weeks coincide with actual iso/upgrade testing

 

I've been trying to get my calendar straightened out and right off the bat I notice a few potential problems. I assume that our next cadence week for Lubuntu Quantal is 

 
  
  
  
  
  
  
  #toc, .toc, .mw-warning { border: 1px solid rgb(170, 170, 170); background-color: rgb(249, 249, 249); padding: 5px; font-size: 95%; }#toc h2, .toc h2 { display: inline; border: medium none; padding: 0px; font-size: 100%; font-weight: bold; }#toc #toctitle, .toc #toctitle, #toc .toctitle, .toc .toctitle { text-align: center; }#toc ul, .toc ul { list-style-type: none; list-style-image: none; margin-left: 0px; padding-left: 0px; text-align: left; }#toc ul ul, .toc ul ul { margin: 0px 0px 0px 2em; }#toc .toctoggle, .toc .toctoggle { font-size: 94%; }body { font-family: 'Times New Roman'; color: rgb(0, 0, 0); widows: 2; font-style: normal; text-indent: 0in; font-weight: normal; text-align: left; font-variant: normal; text-decoration: none; font-size: 12pt; }table {  }td { border-collapse: collapse; text-align: left; vertical-align: top; }
   August 20th thru August 24th but if things go as I've grown used to over the past few years Precise 12.04.1 iso/upgrade testing would also run from 

 
  
  
  
  
  
  
  #toc, .toc, .mw-warning { border: 1px solid rgb(170, 170, 170); background-color: rgb(249, 249, 249); padding: 5px; font-size: 95%; }#toc h2, .toc h2 { display: inline; border: medium none; padding: 0px; font-size: 100%; font-weight: bold; }#toc #toctitle, .toc #toctitle, #toc .toctitle, .toc .toctitle { text-align: center; }#toc ul, .toc ul { list-style-type: none; list-style-image: none; margin-left: 0px; padding-left: 0px; text-align: left; }#toc ul ul, .toc ul ul { margin: 0px 0px 0px 2em; }#toc .toctoggle, .toc .toctoggle { font-size: 94%; }body { font-family: 'Times New Roman'; color: rgb(0, 0, 0); widows: 2; font-style: normal; text-indent: 0in; font-weight: normal; text-align: left; font-variant: normal; text-decoration: none; font-size: 12pt; }table {  }td { border-collapse: collapse; text-align: left; vertical-align: top; }
   August 20th thru August 23rd.

I realize that Lubuntu does not have a 12.04.1 point release but it's been my experience that LTS point releases do get much less attention from us testers :^( 

This time there are a few bugs that I hope to see addressed by the devs (even if it's via a "won't fix" or just a mention in the release notes) so I tend to think I need to make 12.04.1 testing a priority.

Beyond the week of August 20th I'd assume that cadence testing week and 

 
  
  
  
  
  
  
  #toc, .toc, .mw-warning { border: 1px solid rgb(170, 170, 170); background-color: rgb(249, 249, 249); padding: 5px; font-size: 95%; }#toc h2, .toc h2 { display: inline; border: medium none; padding: 0px; font-size: 100%; font-weight: bold; }#toc #toctitle, .toc #toctitle, #toc .toctitle, .toc .toctitle { text-align: center; }#toc ul, .toc ul { list-style-type: none; list-style-image: none; margin-left: 0px; padding-left: 0px; text-align: left; }#toc ul ul, .toc ul ul { margin: 0px 0px 0px 2em; }#toc .toctoggle, .toc .toctoggle { font-size: 94%; }body { font-family: 'Times New Roman'; color: rgb(0, 0, 0); widows: 2; font-style: normal; text-indent: 0in; font-weight: normal; text-align: left; font-variant: normal; text-decoration: none; font-size: 12pt; }table {  }td { border-collapse: collapse; text-align: left; vertical-align: top; }
   Quantal Beta 1 actually both fall in the week of #toc, .toc, .mw-warning { border: 1px solid rgb(170, 170, 170); background-color: rgb(249, 249, 249); padding: 5px; font-size: 95%; }#toc h2, .toc h2 { display: inline; border: medium none; padding: 0px; font-size: 100%; font-weight: bold; }#toc #toctitle, .toc #toctitle, #toc .toctitle, .toc .toctitle { text-align: center; }#toc ul, .toc ul { list-style-type: none; list-style-image: none; margin-left: 0px; padding-left: 0px; text-align: left; }#toc ul ul, .toc ul ul { margin: 0px 0px 0px 2em; }#toc .toctoggle, .toc .toctoggle { font-size: 94%; }body { font-family: 'Times New Roman'; color: rgb(0, 0, 0); widows: 2; font-style: normal; text-indent: 0in; font-weight: normal; text-align: left; font-variant: normal; text-decoration: none; font-size: 12pt; }table {  }td { border-collapse: collapse; text-align: left; vertical-align: top; September 3rd so that should be fine. I'm guessing that actual
 iso/upgrade testing simply takes precedence over cadence if they fall in the same week.

Beyond that I'm a bit confused. I'd sort of expect cadence testing from 

 
  
  
  
  
  
  
  #toc, .toc, .mw-warning { border: 1px solid rgb(170, 170, 170); background-color: rgb(249, 249, 249); padding: 5px; font-size: 95%; }#toc h2, .toc h2 { display: inline; border: medium none; padding: 0px; font-size: 100%; font-weight: bold; }#toc #toctitle, .toc #toctitle, #toc .toctitle, .toc .toctitle { text-align: center; }#toc ul, .toc ul { list-style-type: none; list-style-image: none; margin-left: 0px; padding-left: 0px; text-align: left; }#toc ul ul, .toc ul ul { margin: 0px 0px 0px 2em; }#toc .toctoggle, .toc .toctoggle { font-size: 94%; }body { font-family: 'Times New Roman'; color: rgb(0, 0, 0); widows: 2; font-style: normal; text-indent: 0in; font-weight: normal; text-align: left; font-variant: normal; text-decoration: none; font-size: 12pt; }table {  }td { border-collapse: collapse; text-align: left; vertical-align: top; }
   September 17th thru the 21st, but then actual iso/upgrade testing for Quantal Beta 2 falls the week of the 24th. So we'd test images two weeks right in a row?

If we then went two weeks after Beta 2 with another round of cadence testing we'd end up with a similar situation; cadence testing the week of October 8th and then Quantal final testing the week of October 15th?

That's a whole lot of testing ;^)

As I've tried to point out before there are actually some flaws in our test cases regarding the live images. We offer only "entire disc", "auto-resize", and "manual partitioning" but ubiquity actually offers additional options, and to be completely thorough it's important to complete some tests with two internal drives connected.

It all gets quite complicated and I'd prefer using an open forum thread to discuss the options but two options that are often overlooked are "using largest free space" and "upgrade via live CD".

When you factor in the fact that it's not uncommon to have 2, 3, or even 4 re-spins in a 24 hour period during actual iso testing those of us who still use actual CD's or DVD's can burn through several dollars worth of discs during each iso-testing cycle if we're testing both live and alternate images and testing multiple flavors ;^)

I'd change to using only flash drives/live USB but one of my test machines has a funky BIOS that recognizes all flash drives as hard drives on boot so I have to enter BIOS and edit the hard drive boot order. That would be OK but then the flash drive sometimes shows up as /dev/sda which totally muddies the water as far as testing grub and ubiquity :^(

I'm just not convinced that testing every two weeks is a sane approach :^(

Lance