Meeting on irc.gimp.org:#build-brigade
Meeting started  November 20 2006 16:00 UTC
Meeting finished November 20 2006 17:00 UTC

In attendence:
------------------------------

Thomas Vander Stichele (thomasvs)
Fernando Herrera (fer)
Juan José Sánchez Penas (juanjo)
José Dapena Paz (dape)
Iago Toral Quiroga (iago)

Meeting log
-----------------------------

nov 20 17:00:40 <iago>  hi all
nov 20 17:00:54 <juanjo>        hi
nov 20 17:00:59 <iago>  it is time to start the meeting :)
nov 20 17:01:18 <fer>   hi
nov 20 17:01:23 <iago>  I'll upload the minutes
nov 20 17:01:45 <iago>  to live.gnome.org in cade someone is missing
nov 20 17:01:49 <iago>  and for future reference
nov 20 17:02:05 <dape>  yes
nov 20 17:02:08 <dape>  first thing
nov 20 17:02:16 <dape>  I have to leave in 25-30 minutes
nov 20 17:02:29 <iago>  dape: ok
nov 20 17:02:37 <iago>  then I guess it is better you start
nov 20 17:02:39 <dape>  so I would beg we start with jhbuild+buildbot related things
nov 20 17:03:04 <fer>   do you know if F.Peters is coming?
nov 20 17:03:24 <dape>  no news about that :S
nov 20 17:04:01 <dape>  as some of you know, frederic doesn't agree with using buildbot
nov 20 17:04:43 <dape>  but no news appart from that
nov 20 17:04:58 <fer>   oki
nov 20 17:05:31 <iago>  dape: then let's start with buildbot issues
nov 20 17:05:55 <iago>  can you talk a little about its current state?
nov 20 17:05:58 <dape>  ok
nov 20 17:06:01 <iago>  so people can know...
nov 20 17:06:03 <dape>  yes
nov 20 17:06:15 <dape>  I've integrated jhbuild (with some custom patches) with buildbot
nov 20 17:06:35 <dape>  and now I've got a buildbot that configures itself from jhbuild modulesets
nov 20 17:07:00 <dape>  and made some changes to prevent buildbot getting all resources because of starting one server per gnome module
nov 20 17:07:27 <dape>  and I would like to deploy this with gnome 2.16, and, if possible, gnome 2.17
nov 20 17:07:52 <dape>  thomasvs, what about the foundation machines?
nov 20 17:09:03 <iago>  in the email I sent to the list, there was this URL, with a little demo of that buildbot running to build gtk+
nov 20 17:09:06 <iago>  http://gtktests-buildbot.igalia.com/
nov 20 17:09:27 <dape>  oh ok
nov 20 17:09:40 <dape>  that's because the machine is running for other projects
nov 20 17:09:52 <dape>  and I considered I shouldn't run all gnome moduleset
nov 20 17:10:24 <fer>   dape, did you also extend jhbuild to be able to run tests? 
nov 20 17:10:29 <dape>  anyway, I think Igalia has offered another machine for this, and I can try with it in case we can't get the foundation machines
nov 20 17:10:40 <dape>  fer, yes
nov 20 17:10:50 <fer>   cool
nov 20 17:10:54 <dape>  in fact I implemented a simple patch to add a "pathrun" command
nov 20 17:11:03 <dape>  that enables me to run an arbitrary command in a project path
nov 20 17:11:15 <dape>  then I can run standard make check or whatever I need to do
nov 20 17:11:24 <dape>  this gives me more flexibility
nov 20 17:11:43 <fer>   great, have you seen Xan's graphics of cairo performance over the gtk-theme-torturer?
nov 20 17:11:59 <fer>   http://blogs.gnome.org/xan
nov 20 17:12:24 <dape>  yes
nov 20 17:12:28 <fer>   we could hook that in some way that we can get an xml-ouput of every continous build
nov 20 17:12:41 <fer>   and then plot grapchics comparing arbitrary builds
nov 20 17:12:54 <dape>  any output, with my patch we can decide any bash/scripting magic we want
nov 20 17:13:06 <dape>  in fact, the code coverage reports are generated this way
nov 20 17:13:27 <fer>   great
nov 20 17:13:50 <dape>  we should add the code to generate the reports we want in the scripts at the end of compilation
nov 20 17:13:55 <dape>  currently there are two scripts
nov 20 17:14:09 <dape>  one is make-check.sh, that runs the tests, and clean coverage info
nov 20 17:14:34 <dape>  and other is module-reports.sh, that currently simply generate coverage info from tests logs
nov 20 17:14:42 <dape>  but this script could implement more stuff
nov 20 17:15:45 <iago>  there are a lot of things that can be done, and probably more after we talk to maintainers and they give us feedback
nov 20 17:15:54 <dape>  yes
nov 20 17:15:58 <fer>   how do you integrate that output with the html output?
nov 20 17:16:06 <iago>  but we would need some developer work on buildbot to achieve them
nov 20 17:16:29 <dape>  any report tool should generate html, but they should be case per case
nov 20 17:16:51 <dape>  for example, we can get projects with check getting specific html output, performance tools getting their one, etc
nov 20 17:17:07 <dape>  I wouldn't add more than linking this info in a structured way in a first stage
nov 20 17:17:27 <dape>  then we can begin to think in cumulative information, in order to get stats and time charts
nov 20 17:17:48 <dape>  but first, getting the output is a good task itself
nov 20 17:17:55 <iago>  dape
nov 20 17:18:02 <iago>  can you point out 
nov 20 17:18:11 <iago>  some important
nov 20 17:18:20 <iago>  short-term issues
nov 20 17:18:26 <iago>  regarding buildbot
nov 20 17:18:27 <iago>  ?
nov 20 17:18:38 <iago>  I mean, tasks that need to be done in buildbot
nov 20 17:18:41 <dape>  oh ok
nov 20 17:18:56 ---     dmalcolm_away is now known as dmalcolm
nov 20 17:18:56 <dape>  I think that short-mid term tasks should be
nov 20 17:19:24 <dape>  try to make patchs in jhbuild for buildbot go upstream
nov 20 17:19:35 <dape>  as many as possible, in order to make maintenance easier
nov 20 17:20:01 <dape>  of course, deploy the buildbot with all the current gnome moduleset
nov 20 17:20:12 <iago>  mmm...
nov 20 17:20:16 <dape>  2.16 at least, and 2.17 also if we can get hardware for this
nov 20 17:20:40 <iago>  we would need a machine for that
nov 20 17:20:40 <dape>  integrate test results for some projects (I think we can try with the tests you get in gtk)
nov 20 17:21:15 <dape>  and cosmetic tasks: better css's in buildbot, maybe with gnome web look and feel
nov 20 17:21:22 <iago>  wedape: yes
nov 20 17:21:34 <iago>  we need to fix the view
nov 20 17:21:39 <dape>  and the other cosmetic task, adding the new rss feed support that's been sent to buildbot mailing list
nov 20 17:21:42 <fer>   so we need a volunteer for that :)
nov 20 17:21:53 <iago>  I guess thomas already has some expirience with that
nov 20 17:21:58 <fer>   or are you guys good with rss? :)
nov 20 17:22:05 <fer>   css I mean
nov 20 17:22:29 <dape>  mmm I have some ideas, but I'm far from being an expert O:)
nov 20 17:22:32 <juanjo>        maybe we can talk to the gnomeweb people for those design tasks
nov 20 17:22:51 <dape>  yes, and they're preparing the new web design
nov 20 17:23:05 <dape>  maybe there can be some ideas on what should we do to make the view kick the ass
nov 20 17:23:30 <dape>  I would like myself to collaborate in the deployment of the current work
nov 20 17:24:14 <dape>  and I would pray for some help to get jhbuild patches upstream
nov 20 17:24:41 <dape>  the ones I implemented need more work to avoid james henstridge get frightened
nov 20 17:26:55 <iago>  I think making the deployment is important
nov 20 17:27:00 <iago>  as soon as we do it
nov 20 17:27:07 <iago>  as sooner we get feedback
nov 20 17:27:54 <thomasvs>      back, sorry
nov 20 17:28:40 <iago>  thomasvs, do you have expirience with the view of buildbot?
nov 20 17:28:54 <iago>  I mean CSS and so
nov 20 17:29:09 <dape>  I have to leave now
nov 20 17:29:24 <iago>  bye dape!
nov 20 17:29:32 <dape>  iago, I think we can use that new development machine here at igalia for deployment, I could deploy the buildbot scripts there
nov 20 17:29:38 <thomasvs>      iago: a little, but my experience is from older buildbot code
nov 20 17:29:47 <thomasvs>      dape: I could use some info on what exactly I should deploy on these build machines here
nov 20 17:29:59 <thomasvs>      dape: if you have an easy recipe for me I can get those machines started
nov 20 17:30:13 <dape>  oh ok
nov 20 17:30:14 <dape>  mmm
nov 20 17:30:29 <dape>  then we can try to get this working
nov 20 17:30:41 <dape>  :( I have to leave
nov 20 17:30:59 <thomasvs>      dape: fine, just send me a mail about what I can do and I will make some time for it
nov 20 17:31:06 <dape>  ok, iago, thomasvs, I can help thomasvs deploying the buildbot stuff in the foundation machines
nov 20 17:31:24 <iago>  dape: ok, that's fine
nov 20 17:31:25 <dape>  take this into account when you make the meeting conclusions O:)
nov 20 17:31:42 <iago>  dape: sure, I won't forget it ;)
nov 20 17:32:33 <dape>  ok, then I'll go
nov 20 17:33:10 <iago>  thomasvs, regarding the view, the buildbot demo that we set up is quite ugly
nov 20 17:33:24 <iago>  you can take a look at it here:
nov 20 17:33:26 <iago>  http://gtktests-buildbot.igalia.com/
nov 20 17:33:58 <thomasvs>      this is a different view from the waterfall view ?
nov 20 17:34:19 <thomasvs>      this is our waterfall for example: http://build.fluendo.com:8080/
nov 20 17:34:49 <dape>  thomasvs, if you click in any module you get the waterfall for that project
nov 20 17:34:50 <thomasvs>      the one dape set up is with each project as its own master inside one common process right ?
nov 20 17:34:55 <dape>  yes
nov 20 17:35:08 <dape>  (still leaving O:)
nov 20 17:35:20 <thomasvs>      heh
nov 20 17:35:29 <thomasvs>      iago: well, someone needs to decide what would be a "nice" view
nov 20 17:35:33 <thomasvs>      I am no HTML wizard
nov 20 17:35:52 <thomasvs>      there are some ideas that would be simple to do
nov 20 17:35:59 <thomasvs>      like, "idle" should go under the builder name
nov 20 17:36:07 <thomasvs>      and the table should be outlined correctly for it
nov 20 17:36:16 <thomasvs>      since this is a view that I assume dape created, it shouldn't be hard to make it look better
nov 20 17:36:16 <--     dape has quit (arg late!!!)
nov 20 17:37:03 <iago>  thomasvs: yes
nov 20 17:37:21 <iago>  I will talk to dape
nov 20 17:37:38 <iago>  to know the details of the current view
nov 20 17:37:58 <iago>  and I send the conlusions to the list
nov 20 17:38:13 <iago>  so we can talk about it along with him
nov 20 17:38:29 <iago>  cause I don't know what he did to get that view
nov 20 17:39:20 <iago>  I think he was talking about a css
nov 20 17:39:43 <iago>  but I'm not sure if that's enough with the current design of the view 
nov 20 17:40:38 <thomasvs>      no, it probably needs some more splitting into the table
nov 20 17:40:41 <thomasvs>      and after that a css
nov 20 17:41:31 <iago>  ok
nov 20 17:41:41 <iago>  there is another issue
nov 20 17:42:10 <iago>  which is the integration of the tests 
nov 20 17:42:28 <iago>  currently
nov 20 17:42:44 <iago>  there is only a stdout flush
nov 20 17:42:48 <iago>  http://gtktests-buildbot.igalia.com/gtk%2B/gtk%2B-sarge/builds/92/step-gtk%2B%20make-check.sh/0
nov 20 17:43:18 <thomasvs>      what should I see ?
nov 20 17:43:49 <iago>  in that url? you should see the result of a "make check" 
nov 20 17:44:03 <thomasvs>      right, but what shows the problem you talk about ?
nov 20 17:44:06 <iago>  ah
nov 20 17:44:15 <iago>  I think it would be nice
nov 20 17:44:24 <iago>  to know in the waterfall view
nov 20 17:44:31 <iago>  if there are failed tests for a module
nov 20 17:44:42 <thomasvs>      right
nov 20 17:44:42 <iago>  maybe the number of passed/failed tests
nov 20 17:44:45 <thomasvs>      I think we do that for gst
nov 20 17:44:52 <iago>  and probably a better view of all that mess
nov 20 17:44:57 <iago>  ah, interesting
nov 20 17:45:00 <thomasvs>      it's a matter of writing some code for the specific step that checks the output of the tests
nov 20 17:45:09 <iago>  yep, the problem
nov 20 17:45:13 <iago>  in the gnome case
nov 20 17:45:17 <iago>  is that probably
nov 20 17:45:28 <iago>  people use diferent tools for their unit tests
nov 20 17:45:32 <thomasvs>      right
nov 20 17:45:44 <thomasvs>      so the step would need to know how to do this.  but we can push people in the direction of using check
nov 20 17:45:57 <thomasvs>      that's one of the reasons why we chose to standardize on check for gst - so that we could use the same way of parsing the info at the end
nov 20 17:46:17 <thomasvs>      I can't remember if I ended up writing the buildbot step to look at it, and I do not have one deployed that has it it seems
nov 20 17:47:09 <thomasvs>      I did it for flumotion and coverage
nov 20 17:47:11 <thomasvs>      http://build.fluendo.com:8071/
nov 20 17:47:19 <thomasvs>      <-- the orange blocks (some of them at least) show coverage status
nov 20 17:47:48 <thomasvs>      and it parses the output to find the percentage and displays it as part of the waterfall.  we can do this too for gnome, for failed tests and coverage
nov 20 17:47:55 <iago>  I see
nov 20 17:48:09 <iago>  the problem is that some people will not use check :/
nov 20 17:48:19 <iago>  currently I'm trying to convince people in gtk+ to use it
nov 20 17:48:34 <iago>  but seems they prefer doing something from scratch
nov 20 17:48:41 <iago>  to avoid a new dependency
nov 20 17:48:42 <thomasvs>      which I think is silly, but hey
nov 20 17:48:53 <thomasvs>      it's a devel-time dependency, so it shouldn't be an issue
nov 20 17:48:56 <iago>   :)
nov 20 17:49:11 <thomasvs>      but my plan of attack was to improve the gstreamer use of it and add these things to our buildbots and use the output from it to convince other people
nov 20 17:49:16 <thomasvs>      just haven't had much time to do that
nov 20 17:49:24 <thomasvs>      I want to show graphs over time of coverage data and test result data
nov 20 17:49:27 <thomasvs>      all from our buildbot
nov 20 17:49:45 <iago>  yes, we also added coverage to our demo:
nov 20 17:49:45 <thomasvs>      but it takes work :/
nov 20 17:49:59 <juanjo>        thomasvs, it would be nice to get your opinion in the gtk-list thread, cause Tim Janick is proposing to do something from scratch and it is difficult to go on with check if some of the maintainers are not convinced
nov 20 17:50:06 <iago>  http://gtktests-buildbot.igalia.com/gnomeslave/gtk+/lcov/gtk/index.html
nov 20 17:50:13 <thomasvs>      juanjo: hm, I'm not on that list
nov 20 17:50:38 <thomasvs>      iago: yeah, I have something like that for gst, I think dape used my template to get to that point
nov 20 17:50:51 <thomasvs>      iago: I still need to integrate it to make sure it gets run on every build and then uploaded somewhere though
nov 20 17:50:54 <juanjo>        thomasvs, we can CC you if you want to get into the discussion anyway ;-)
nov 20 17:51:04 <thomasvs>      juanjo: yes, sure
nov 20 17:51:12 <thomasvs>      or subscribe me to the list :)
nov 20 17:52:12 <iago>  thomasvs: I guess we can make the tests run under Check look nice under buildbot
nov 20 17:52:31 <iago>  that would be good point to push maintainers to use check
nov 20 17:52:35 <thomasvs>      iago: yes, exactly
nov 20 17:54:09 <iago>  ok, so I think we talked about all 
nov 20 17:54:12 <iago>  summarizing
nov 20 17:54:26 <iago>  dape and you will work on the buildbot deployment
nov 20 17:55:14 <iago>  I can try to play a little bit with the view
nov 20 17:55:45 <iago>  and meanwhile I'll try to keep unit tests for gtk+ rolling
nov 20 17:56:19 <iago>  thomasvs: btw, I think that your expirience could be valuable in the gtk-devel debate on unit tests
nov 20 17:56:53 <iago>  I'll send you an email
nov 20 17:57:04 <iago>  pointing to the thread in case you cant to participate
nov 20 17:57:11 <thomasvs>      ok
nov 20 17:58:10 <juanjo>        once we have a cool demo working, we could focus in other things like getting the collaboration of maintainers, doing some more marketing about the build brigade work (gnomejournal,etc.), and all the social side of the work... but for now, I think the main goal is to get in a couple of months a cool demo of what can be done
nov 20 17:59:01 <iago>  juanjo: yes, definitely
nov 20 17:59:49 <iago>  ok, so I guess this is all, not bad for a first meeting :)
nov 20 18:00:16 <iago>  I'll upload the minutes to l.g.o and send an email to the list to keep all people informed
nov 20 18:00:17 <juanjo>        should we schedule a meeting every month for tracking the work? 
nov 20 18:00:23 <juanjo>        is this day and hour ok for everyone?
nov 20 18:00:54 <--     Casanova has quit (http://prashblog.com -- One day I am going to find this `peer' and reset his connection)
nov 20 18:01:23 <iago>  juanjo: it is ok for me and dape
nov 20 18:01:28 <iago>  I think it would be nice
nov 20 18:02:44 <juanjo>        btw, i will talk with josh about handling the channel with burrito, in order to be able to keep a topic and gather people interested here :)
nov 20 18:03:14 <iago>  juanjo: yes, good point :)
nov 20 18:05:54 <juanjo>        ok, it seems the meeting is over :) I think we can have the next one by mid-december to see how things are going
nov 20 18:05:57 <thomasvs>      juanjo: mondays in the middle of a working day is very hard for me
nov 20 18:06:08 <thomasvs>      but I will adapt if that's what other people want
nov 20 18:07:12 <juanjo>        thomasvs, would it be better for you to do it later/earlier? 
nov 20 18:07:55 <thomasvs>      juanjo: yeah, I'd prefer outside of work hours.  like for example 20.00 GMT, or 19.00 spanish time
nov 20 18:08:52 <iago>  that time would be ok for me
nov 20 18:09:08 <iago>  I can talk to dape and check if it ok for him too
nov 20 18:09:18 <juanjo>        that would be ok for me too
nov 20 18:11:01 <juanjo>        ok guys, need to leave now, see you later!
nov 20 18:11:05 <--     juanjo has quit (Leaving)
nov 20 18:11:20 <thomasvs>      later!

BuildBrigade/MeetingMinutes20Nov06 (last edited 2008-02-03 14:47:14 by anonymous)