maria-developers team mailing list archive

[Kristian Nielsen <knielsen@xxxxxxxxxxxxxxx>]

Vadim Tkachenko <vadim@xxxxxxxxxxx> writes:

> If you can share your Buildbot  configuration that would be perfect!
> As for platforms we see demand for Debian/Ubuntu/CentOS both 32bit and
> 64bit. Also quite often are mentioned FreeBSD, MacOS and Windows.

Ok, it's attached. Just let me know if you have any questions on it.

I'm using the Debian/Ubuntu buildbot package, which runs buildbot as user
`buildbot`. I found it useful to set $HOME to the buildbot home directory in
/etc/default/buildbot. Without this, buildbot tended to pick up the wrong
~/.bazaar directory and use the wrong configuration, causing me problems.

I also run a `bzr init-repo` on the build slave directories before starting
them. This makes bzr only download the new changes from Launchpad, not the
whole history for every build.

> For CFLAGS / configure I found combination from MySQL .spec for RedHat 5
> works almost fine. The changes I made for CFLAGS I am adding next
> combination:
>
> -O2 -g -fno-omit-frame-pointer
>
> it makes life to debugs hangs / crashes easier.

Ok, thanks a lot for the information.

I am still not sure whether generic (.tar.gz) binaries should be build
statically (and to what extend).

I am BTW. also talking with Arjen (OurDelta / Open Query), he also has some
ideas about what to do for binaries. I'm not sure how much Percona is working
with him currently.

 - Kristian.

# -*- python -*-
# ex: set syntax=python:

# This is a sample buildmaster config file. It must be installed as
# 'master.cfg' in your buildmaster's base directory (although the filename
# can be changed with the --basedir option to 'mktap buildbot master').

# It has one job: define a dictionary named BuildmasterConfig. This
# dictionary has a variety of keys to control different aspects of the
# buildmaster. They are documented in docs/config.xhtml .


# This is the dictionary that the buildmaster pays attention to. We also use
# a shorter alias to save typing.
c = BuildmasterConfig = {}

####### BUILDSLAVES

# the 'slaves' list defines the set of allowable buildslaves. Each element is
# a tuple of bot-name and bot-password. These correspond to values given to
# the buildslave's mktap invocation.
from buildbot.buildslave import BuildSlave
c['slaves'] = [BuildSlave("valgrind", "xxx", max_builds=1)
              ,BuildSlave("pcrews-win", "xxx", max_builds=1)
              ,BuildSlave("centos5", "xxx", max_builds=1)
              ,BuildSlave("archivist-cnc", "xxx", max_builds=1)
              ,BuildSlave("archivist-amd64", "xxx", max_builds=1)
              ,BuildSlave("adutko-amd64", "xxx", max_builds=1)
              ,BuildSlave("adutko-alpha", "xxx", max_builds=1)
               ]

# to limit to two concurrent builds on a slave, use
#  c['slaves'] = [BuildSlave("bot1name", "bot1passwd", max_builds=2)]


# 'slavePortnum' defines the TCP port to listen on. This must match the value
# configured into the buildslaves (with their --master option)

c['slavePortnum'] = 9989

####### CHANGESOURCES

# the 'change_source' setting tells the buildmaster how it should find out
# about source code changes. Any class which implements IChangeSource can be
# put here: there are several in buildbot/changes/*.py to choose from.

from bzr_buildbot import BzrPoller
bzr_5_1 = BzrPoller(url="http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1";, poll_interval=5*60, branch_name="5.1")
bzr_5_2 = BzrPoller(url="http://bazaar.launchpad.net/%7Emaria-captains/maria/5.2";, poll_interval=5*60, branch_name="5.2")
bzr_6_0 = BzrPoller(url="http://bazaar.launchpad.net/%7Emaria-captains/maria/6.0";, poll_interval=5*60, branch_name="6.0")
c['change_source'] = [bzr_5_1, bzr_5_2, bzr_6_0]

# For example, if you had CVSToys installed on your repository, and your
# CVSROOT/freshcfg file had an entry like this:
#pb = ConfigurationSet([
#    (None, None, None, PBService(userpass=('foo', 'bar'), port=4519)),
#    ])

# then you could use the following buildmaster Change Source to subscribe to
# the FreshCVS daemon and be notified on every commit:
#
#from buildbot.changes.freshcvs import FreshCVSSource
#fc_source = FreshCVSSource("cvs.example.com", 4519, "foo", "bar")
#c['change_source'] = fc_source

# or, use a PBChangeSource, and then have your repository's commit script run
# 'buildbot sendchange', or use contrib/svn_buildbot.py, or
# contrib/arch_buildbot.py :
#
#from buildbot.changes.pb import PBChangeSource
#c['change_source'] = PBChangeSource()


####### SCHEDULERS

## configure the Schedulers

from buildbot.scheduler import AnyBranchScheduler
c['schedulers'] = []
c['schedulers'].append(AnyBranchScheduler(
    name="mariadb", branches=["5.1", "5.2", "6.0"],
    treeStableTimer=1, # 1 sec for bzr
    builderNames=["valgrind", "centos5-debug", "archivist-cnc",
                  "archivist-amd64", "adutko-amd64", "adutko-alpha"]))


####### BUILDERS

# the 'builders' list defines the Builders. Each one is configured with a
# dictionary, using the following keys:
#  name (required): the name used to describe this bilder
#  slavename (required): which slave to use, must appear in c['bots']
#  builddir (required): which subdirectory to run the builder in
#  factory (required): a BuildFactory to define how the build is run
#  periodicBuildTime (optional): if set, force a build every N seconds

# buildbot/process/factory.py provides several BuildFactory classes you can
# start with, which implement build processes for common targets (GNU
# autoconf projects, CPAN perl modules, etc). The factory.BuildFactory is the
# base class, and is configured with a series of BuildSteps. When the build
# is run, the appropriate buildslave is told to execute each Step in turn.

# the first BuildStep is typically responsible for obtaining a copy of the
# sources. There are source-obtaining Steps in buildbot/process/step.py for
# CVS, SVN, and others.

cvsroot = ":pserver:anonymous@xxxxxxxxxxxxxxxxxxx:/cvsroot/buildbot"
cvsmodule = "buildbot"

from buildbot.process import factory
from buildbot.steps.source import Bzr
from buildbot.steps.shell import Compile, Test

f1 = factory.BuildFactory()
f1.addStep(Bzr(baseURL="http://bazaar.launchpad.net/%7Emaria-captains/maria/";, defaultBranch="5.1", mode="copy"))
f1.addStep(Compile(command=["BUILD/compile-pentium64-valgrind-max"]))
f1.addStep(Test(command=["sh", "-c", "cd mysql-test && exec perl mysql-test-run.pl --mem --parallel=2 --valgrind --force --skip-ndb"]))

bld_valgrind = {'name': "valgrind",
                'slavename': "valgrind",
                'builddir': "valgrind",
                'factory': f1,
                }

f_dbg_2_64 = factory.BuildFactory()
f_dbg_2_64.addStep(Bzr(baseURL="http://bazaar.launchpad.net/%7Emaria-captains/maria/";, defaultBranch="5.1", mode="copy"))
f_dbg_2_64.addStep(Compile(command=["BUILD/compile-pentium64-debug-max"]))
f_dbg_2_64.addStep(Test(command=["sh", "-c", "cd mysql-test && exec perl mysql-test-run.pl --parallel=2 --force --skip-ndb"]))

f_dbg_1_32 = factory.BuildFactory()
f_dbg_1_32.addStep(Bzr(baseURL="http://bazaar.launchpad.net/%7Emaria-captains/maria/";, defaultBranch="5.1", mode="copy"))
f_dbg_1_32.addStep(Compile(command=["BUILD/compile-pentium-debug-max"]))
f_dbg_1_32.addStep(Test(command=["sh", "-c", "cd mysql-test && exec perl mysql-test-run.pl --force --skip-ndb"]))

bld_linux_debug = {'name': "centos5-debug",
                   'slavename': "centos5",
                   'builddir': "centos5-debug",
                   'factory': f_dbg_2_64,
                   }

bld_archivist_cnc = {'name': "archivist-cnc",
                     'slavename': "archivist-cnc",
                     'builddir': "archivist-cnc",
                     'factory': f_dbg_1_32,
                     }

bld_archivist_amd64 = {'name': "archivist-amd64",
                     'slavename': "archivist-amd64",
                     'builddir': "archivist-amd64",
                     'factory': f_dbg_2_64,
                     }

bld_adutko_amd64 = {'name': "adutko-amd64",
                     'slavename': "adutko-amd64",
                     'builddir': "adutko-amd64",
                     'factory': f_dbg_2_64,
                     }

f_dbg_alpha = factory.BuildFactory()
f_dbg_alpha.addStep(Bzr(baseURL="http://bazaar.launchpad.net/%7Emaria-captains/maria/";, defaultBranch="5.1", mode="copy"))
f_dbg_alpha.addStep(Compile(command=["BUILD/compile-alpha"]))
f_dbg_alpha.addStep(Test(command=["sh", "-c", "cd mysql-test && exec perl mysql-test-run.pl --force --skip-ndb"]))

bld_adutko_alpha = {'name': "adutko-alpha",
                     'slavename': "adutko-alpha",
                     'builddir': "adutko-alpha",
                     'factory': f_dbg_alpha,
                     }

c['builders'] = [bld_valgrind, bld_linux_debug, bld_archivist_cnc, bld_archivist_amd64, bld_adutko_amd64, bld_adutko_alpha]


####### STATUS TARGETS

# 'status' is a list of Status Targets. The results of each build will be
# pushed to these targets. buildbot/status/*.py has a variety to choose from,
# including web pages, email senders, and IRC bots.

c['status'] = []

from buildbot.status import html
c['status'].append(html.WebStatus(http_port=8010, allowForce=True))

# from buildbot.status import mail
# c['status'].append(mail.MailNotifier(fromaddr="buildbot@localhost",
#                                      extraRecipients=["builds@xxxxxxxxxxx"],
#                                      sendToInterestedUsers=False))
#
# from buildbot.status import words
# c['status'].append(words.IRC(host="irc.example.com", nick="bb",
#                              channels=["#example"]))
#
# from buildbot.status import client
# c['status'].append(client.PBListener(9988))


####### DEBUGGING OPTIONS

# if you set 'debugPassword', then you can connect to the buildmaster with
# the diagnostic tool in contrib/debugclient.py . From this tool, you can
# manually force builds and inject changes, which may be useful for testing
# your buildmaster without actually commiting changes to your repository (or
# before you have a functioning 'sources' set up). The debug tool uses the
# same port number as the slaves do: 'slavePortnum'.

#c['debugPassword'] = "debugpassword"

# if you set 'manhole', you can ssh into the buildmaster and get an
# interactive python shell, which may be useful for debugging buildbot
# internals. It is probably only useful for buildbot developers. You can also
# use an authorized_keys file, or plain telnet.
#from buildbot import manhole
#c['manhole'] = manhole.PasswordManhole("tcp:9999:interface=127.0.0.1",
#                                       "admin", "password")


####### PROJECT IDENTITY

# the 'projectName' string will be used to describe the project that this
# buildbot is working on. For example, it is used as the title of the
# waterfall HTML page. The 'projectURL' string will be used to provide a link
# from buildbot HTML pages to your project's home page.

c['projectName'] = "MariaDB"
c['projectURL'] = "https://launchpad.net/maria";

# the 'buildbotURL' string should point to the location where the buildbot's
# internal web server (usually the html.Waterfall page) is visible. This
# typically uses the port number set in the Waterfall 'status' entry, but
# with an externally-visible host name which the buildbot cannot figure out
# without some help.

c['buildbotURL'] = "http://askmonty.org/buildbot/";