14:36:33 #startmeeting 14:36:33 Meeting started Thu Jun 30 14:36:33 2011 UTC. The chair is joanie. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:36:33 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:36:53 #topic 1.1 Call for volunteers: Quantifying improvement from Mike's change to only emit events if an AT is listening. 14:37:16 #info Mike has made the changes needed to only emit events if an AT is listening. 14:37:55 #info This change might in theory solve much of the broader community's concerns about enabling AT support by default due to performance problems. 14:38:22 #info It would be ideal if someone could verify this in some proven, respectable, convincing, with numbersy sort of way. 14:38:27 * joanie opens floor up 14:38:31 It sounds like a great fix. Are you looking for quantifying some of the performance improvements? 14:38:54 Thanks you answered my questions and type faster than me. 14:39:06 I would like to have data that says "There is no performance hit whatsoever if AT is enabled by default but no ATs are listening." 14:39:15 So how can we get this data? 14:40:17 * joanie reminds everyone that she is a teacher and she will start calling on people. :-P 14:40:26 xDD 14:40:45 joanie:I wonder if some of the existing mago tests could verify this. 14:40:46 gtk-perf could be usefull for to check the performance 14:41:04 isn't it? 14:41:09 bnitz: you first than jhernandez. Please elaborate 14:41:10 jhernandez:I thought that might be at too low of a level. 14:41:44 The mago test community maintains some scripts which do things for various applications. 14:42:03 I think it's well maintained and works well for ubuntu, less so for other distros. 14:42:09 * bnitz looks for link. 14:42:27 jhernandez: While bnitz is looking for a link.... 14:42:31 it would also be interesting to measure memory in addition to cpu - that is doable with valgrind --tool=callgrind 14:42:52 do you have knowledge about gtk-perf sufficient to write such a test? 14:43:05 fregl: makes sense 14:43:07 joanie: no i don't 14:43:49 fregl: could valgrind be *the* tool (memory+cpu)? 14:44:04 http://bazaar.launchpad.net/~mago-contributors/mago/mago-testsuite/files 14:44:10 thanks bnitz 14:44:42 i know about gtk-perf and since the main problem is the performance, I was suggesting gtk-perf as a quick/easy/first approachment 14:44:45 joanie: memory definitively. cpu maybe with a different tool but rather not. 14:45:18 fregl: you know enough about valgrind to create the memory test? 14:45:53 sorry, but I don't have time nor enthusiasm. but if someone wants to run this I can tell the command line basics how to do this. 14:46:00 Any BSD people here? I have some dtrace based launch performance scripts, they look for when an application maps to the X server. 14:46:08 fregl: understood. And thanks. 14:46:51 As much as I love dtrace, the "typical" gnome environments now are Fedora 15 and Ubuntu. 14:47:34 I don't think it's that hard to figure out valgrind--it has a manpage, anyway--I think the hard part will be figuring out what to test 14:47:36 This patch looks cool https://bugzilla.gnome.org/show_bug.cgi?id=618189 A facility for scripting the (gnome)-shell to generate performance events, and then replaying the log to collect "metrics" 14:47:36 04Bug 618189: normal, Normal, ---, gnome-shell-maint, RESOLVED FIXED, Framework for performance measurement 14:47:42 backing up a bit for clarification: improving performance implies a comparison -- is the comparison between (1) AT enabled by default vs. (2) AT enabled only when at least one AT is listening? Or (1) no AT enabled vs (2) AT enabled when one AT is listening? Or both? 14:47:51 great minds... 14:48:08 tota11y I think this could be the most useful/easy to use. 14:48:08 bnitz: Error: "I" is not a valid command. 14:48:31 note that ubuntu doesn't use gnome-shell.. 14:48:45 First and foremost, clown, I think we want to compare: AT support disabled and AT support enabled but no ATs listening 14:48:52 clown: oneiric has it 14:49:16 but to back up for everyone for clarification 14:49:34 the broader (not us) GNOME community (including Release Team, etc.) have the following claim: 14:49:53 I stand corrected, collegues tell me valgrind is supposed to be good for cpu testing also 14:49:54 "We cannot enable AT support by default because it drags the desktop to a halt even when no ATs are being used." 14:50:15 I would like to make a case that boils down to "Your assertion is now bogus." ;-) 14:50:33 But we need to know if it is indeed bogus before we make our own bogus claims. :-) 14:50:40 mgorse did the work 14:50:46 Now we need the testing and data 14:50:52 fregl: cool, thanks for the update 14:51:14 So valgrind sounds like it might be the tool and mgorse doesn't think it would be that hard to learn 14:51:33 As much as I like valgrind, I don't think this can be our one tool, it may give us useful bits of information though. CPU+memory doesn't necessarily correlate to user-perceived performance. 14:51:55 bnitz: fair enough 14:52:07 how do you propose we measure user-perceived performance? 14:52:09 bnitz: it's about numbers not perception I thought 14:52:11 other than by user testing? 14:52:32 p/c 14:52:47 If we were to have the numbers, we could go to the RT and say "look, all fixed!" 14:52:53 and they could then see what they perceive 14:52:55 #info what about ShellPerfLog (the tool I mentioned ealier) https://bugzilla.gnome.org/show_bug.cgi?id=618189 14:52:55 04Bug 618189: normal, Normal, ---, gnome-shell-maint, RESOLVED FIXED, Framework for performance measurement 14:52:56 For Joanie's assertion, wouldn't numbers actually be the better thing? 14:53:46 Well, that tool has Owen's name all over it. So perhaps valgrind plus that. 14:53:49 ;-) 14:54:00 Anyhoo I don't want to spend the whole meeting on this topic. 14:54:07 mgorse: This is your fix we're testing and you know what we're looking for. What's your time these days like? 14:54:19 i.e. could you look into valgrind 14:54:21 numbers are a good thing. still, note that they will probably show some greater use of resources -- for what value do you say that this greater use == "drags the desktop to a halt"? 14:54:23 to get us these numbers 14:54:36 joanie:One step down from manual testing with a stopwatch. Automate launch and other user activity. Timestamp 14:54:48 Look at times between timestamps. 14:54:54 bnitz: we could do that 14:55:06 At this point I need volunteers. :-) 14:55:19 Who can do what -- not just in spirit and knowledge, but in time? 14:56:03 I think I should write to some list (desktop-devel maybe), explain the change, and ask if people have things in particular that seem slow / that should be tested 14:56:31 mgorse: +1 14:56:49 I can investigate the options but I don't have a good/popular test execution environment 14:56:52 of course, they might answer : "the desktop is slow". 14:56:54 We know the culprits though: Trees :-) 14:56:59 clown: yup 14:57:21 <|Lupin|> hello, there 14:57:23 Unless our A11yTest distro running in a virtual box displayed via Sunray will be our gold standard ;-) 14:57:34 hahaha 14:57:36 anyhoo let's move on 14:57:43 bnitz: fabulous benchmark, that! 14:57:56 yep 14:58:32 #info Valgrind might be a good solution. The tool for gnome-shell from bug 618189 might as well. Lastly, just timestamping typical activities. 14:58:32 04Bug https://bugzilla.gnome.org/show_bug.cgi?id=618189 normal, Normal, ---, gnome-shell-maint, RESOLVED FIXED, Framework for performance measurement 14:58:37 must run that distro from a 1x CD drive. 14:58:49 #info No one at the meeting could volunteer their time for these tasks. 14:58:54 I can probably do some kind of testing as long as it doesn't require me to actually read the screen without Orca running :) In that case I'd need to figure out what needs doing and could come up with a plan at least 14:59:18 #action Joanie will investigate what other resources we have/can draw upon to achieve this work. 14:59:28 mgorse: perhaps we can tag team it 14:59:32 I dunno valgrind 14:59:45 mgorse: didn't you have a basic pyatspi test, give me all children of this accessible 1000 times or something like that? 14:59:45 but if you get me up to speed and provide a test which theoretically should work, I can run it. 14:59:50 any idea what the learning curve is for valgrind? 14:59:58 Maybe too far from the real world use. 15:00:29 bnitz: I don't think I've do at the moment; I've written things like that before but wouldn't help with what we're trying to do now 15:00:32 anyhoo, 25 minutes into this meeting, I'd like to move on. 15:00:35 sorry!! 15:00:49 #topic 1.2 call for volunteers: Writing tests for the Gail into Gtk merge. 15:01:07 # Action brian to investigate gnome-shell --perf=