Dick,
All you said is true.
Changes it pcbnew involve changes in .brd format.
.brd format is 15 years old, and was a compromise between a clear and
readable format (opposite to a binary format)
and the time to read a file (for a large boards) with PCs existing 15
years ago.
It can be changed now.
(We can to stay with the current format forever only if forever does not
take a long time to finish)
Which is mandatory is only the ability for a recent pcbnew version to
read all the old board designs.
I have no preference for XML syntax or SPECCTRA grammar.
But i know what are some features for a new format:
A) It would be largely self documenting. : mandatory.
B) It would be easily parsed with standard software tools. : Sure...
C) It would have the capability to represent all the constructs in a PCB
design file.
Not all constructs would be present in each file, but the capacity
to represent them if needed is desirable.
Obvious.
I can add:
Format must be easily human readable (Edif is not easily readable...)
Data must be coded without any reference to its internal representation
in kicad.
This means:
Obviously, sizes and positions can be coded in inches or mm but not in
internal units
diam="12.5mm" or diam="0.5inch"
or something like
unit=mm
diam="12.5"
other example:
angle = "34.0" and not angle = 340 like now
This is very important in others items like layers, flags, options:
layer[0] is bad, but
layer[copper] or layer.copper is better.
or something like:
layer[0] = copper
before using layer[0].
This is true for all items like pads vias, tracks with are on one or
more layers.
And of course mainly true to code flags and options (like pad shapes,
locked footprints, texts justification ...)
I also believe pcbnew internal units will be changed in a next future
from 1/10000 inch to a smaller unit (1/100000 inch or 1/10000 mm)
to handle properly small pad and track sizes in inches and mm because
modern components are smaller and smaller and use a small metric grid.
This also is a reason to change the .brd file format