Adblock Plus and (a little) more

Overview for Mozilla's add-on performance measurements · 2011-04-11 16:55 by Wladimir Palant

I got tired of digging through logs so I created an overview page for AMO’s add-on performance testing results. This shows both the absolute slowdown values as well as percentages for each operating system, along with a link to the corresponding logs. It also shows the standard deviation for each test and flags results that are affected by issues known so far. This week this means:

• 9 add-ons that weren’t tested because of being platform-dependent (bug 648225)
• 2 add-ons (Google Toolbar and Memory Fox) weren’t tested because they have no stable version for download on addons.mozilla.org
• 1 add-on (Tab Mix Plus) wasn’t tested because Talos couldn’t understand its install.rdf file (bug 648978)
• 4 add-ons where some of the tests timed out, typically because of first-run pages that couldn’t be closed (bug 648222)
• 6 add-ons that were tested disabled because of not being compatible with Firefox (typically Thunderbird add-ons)
• 30 add-ons that were tested disabled because of not being explicitly compatible with Firefox 4 (bug 648229)
• 11 add-ons with test results probably considerably skewed by bug 648734 if I count correctly (standard deviation above 10% of the total Firefox start-up time). A lot more results were marked with a warning because of standard deviation above 2% of the total Firefox start-up time but I won’t count those.
• Almost every add-on has its Windows results skewed by bug 647954. This apparently works in both directions, for some add-ons the Windows score has been increased due to errors, others got an advantage because their initialization didn’t run.

I guess I will have to re-run that script weekly until AMO fixes the bugs and starts providing affected add-on authors with useful information.

Tags: mozilla

Comment [9]

1. Thomas Stache · 2011-04-11 18:21 · #

   Good stuff! I think this is great work from your side, that I’d like to be valued a bit more by the AMO people, than Jorge demonstrated here in the comments…
   Keep it up!

2. Stellan Klebom · 2011-04-11 18:47 · #

   Very good information!

   Indeed is the percentage slowed down very misleading to the degree of being almost meaningless. I’m glad you are as thorough Wladimir.

   However I have a startup time well above 10s for my firefox due to a large amount of addons (61 enabled + 11 disabled + 20 plugins). If these measurements contribute to shortening this rather large startup time I’ll be a little bit happy…

3. Dan · 2011-04-11 19:42 · #

   Great stuff, very detailed.

   You’re doing someone’s job for them. I hope they’re embarrassed.

4. Dave Garrett · 2011-04-11 23:35 · #

   Wow, you’ve done a lot of work here. Thanks immensely for digging into this!

5. Aaron · 2011-04-11 23:51 · #

   IMHO, you should have the browser redirect to your home page (or an “Updates” page) when you push out an update of your code. This way visitors can learn more about the ABP world. Also, you will generate substantial traffic. People might be willing to donate money and spread the word. You could at least sell a site sponsorship for enough money to pay for your server, for example.

   Regardless, I appreciate your hard work on ABP.

   Go ahead and delete this message if you would like. I could not find your email address.

   Thanks!

6. pd · 2011-04-12 13:40 · #

   This is brilliant stuff. It’s exactly what we should be seeing on AMO somewhere. Just one tweak: what do the background colours (pink, yellow) indicate? Small key or legend would be ace :)pd

   Reply from Wladimir Palant:

   There are tooltips explaining what these colors indicate.

7. henry · 2011-04-19 04:46 · #

   sorry if this is off task but can some one help me here?When i was watching youtube it said block the ad i pressed it and now i cant watch anymore videos :( HELP ME PLEASE!

8. casquette rockstar · 2011-05-04 13:10 · #

   ruban à mesurer remplir en utilisant la bande, car il est enveloppé près de la tête? sans avoir besoin de tout chevauchement pour le ruban à mesurer, rapport dans les deux pouces ou en centimètres, la circonférence de votre tête.
   La circonférence de votre esprit pourrait être la portée de chaque de la manière dont près

9. discount ugg boots · 2011-05-05 07:15 · #

   These boots take place in gray or dark and element equally stripes and dots. The foot and shaft are covered with bright polka dots, and there is positively a strap of stripes in the bottom belonging toward the foot, just above the dark sole. an additional strap of stripes surrounds the leg in the best of every boot.

Commenting is closed for this article.