Archive: stats

Silverstone’s new ‘Wing’ pit complex has been getting a bit of press recently as the circuit has been showing off the progress so far to journalists.

Whenever I have seen designs of it, I have felt like it reminded me of something, but I could never quite put my finger on what.

Then I logged into the stats for my blog and found the answer.

Blog stats

Silverstone Wing complex

While perusing the stats for my blogs, I noticed that one of the referrers was this URL: http://www.charlesgordonmsp.com/stats/usage_200902.html. I clicked through to see what it was all about. To my astonishment, I was taken directly to the Webalizer stats for Charlie Gordon’s website.

This seems quite unusual to me. To access these stats for my websites, I need to log in with a password. Surely most other people do for their websites as well. But for the most expensive website for an MSP, such basic security measures do not seem to be in place. When you consider the possibility that search logs may contain constituents’ sensitive information, it seems to be quite an oversight.

There is one upside though. This free access to Charlie Gordon’s stats does give us the ability to calculate just how much value for money the taxpayer is getting out of his website.

For those who missed it, last month the Scottish Parliament released MSPs’ expense claims. The Scottish Parliament website allows you to search for expense claims by category. One of the categories is ‘Website Costs’, giving us the ability to see just what MSPs are spending on their websites.

It made the news that Charlie Gordon’s website was the most expensive of all the MSPs — by a very long way. Duncan Cumming conducted a full analysis. Charlie Gordon claimed £12,822.62 in website costs for the financial year 2007–2008. The next largest claim was by John Wilson, who claimed £2,291.25 — less than a fifth of what Charlie Gordon claimed.

For what it’s worth, Charlie Gordon released a statement on his website. There is no permalink for it, so you will have to scroll down — it’s (erroneously) dated 23 January 2008. It says: “My website costs for 2007/08 were around £1,700; not £12,900 as stated erroneously on the Scottish Parliament’s website!”

The MSP claims that only 20% of the costs outlined by the Scottish Parliament went on the website itself, the rest being paid for “call handling”. It is worth pointing out that even if we take Charlie Gordon’s claims at face value, a £1,700 claim would still make his website the second most expensive MSP’s website.

Here are the full details of the expense claims as laid out by the Scottish Parliament:

Claim Month: November 2007
Payee: GMG SOLUTIONS
Amount: £1,709.38
Additional Info: ADMINISTRATION AND WEBSITE MAINTENANCE

Claim Month: October 2007
Payee: GMG SOLUTIONS
Amount: £1,441.61
Additional Info: ADMINISTRATION AND WEBSITE MAINTENANCE

Claim Month: November 2007
Payee: QUEENS PARK FC
Amount: £11.80

Claim Month: September 2007
Payee: GMG SOLUTIONS
Amount: £1,200.00
Additional Info: ADMINISTRATION AND WEBSITE MAINTENANCE

Claim Month: August 2007
Payee: GMG SOLUTIONS
Amount: £1,932.00

Claim Month: July 2007
Payee: QUEENS PARK FC
Amount: £11.80

Claim Month: June 2007
Payee: GMG SOLUTIONS
Amount: £1,152.00

Claim Month: July 2007
Payee: GMG SOLUTIONS
Amount: £1,032.00

Claim Month: April 2007
Payee: QUEENS PARK FC
Amount: £11.80

Claim Month: April 2007
Payee: GMG SOLUTIONS
Amount: £804.00

Claim Month: May 2007
Payee: GMG SOLUTIONS
Amount: £708.00

Claim Month: March 2008
Payee: GMG SOLUTIONS
Amount: £144.00

Claim Month: January 2008
Payee: GMG SOLUTIONS
Amount: £1,464.00

Claim Month: December 2007
Payee: GMG SOLUTIONS
Amount: £1,044.43

Claim Month: September 2007
Payee: QUEENS PARK FC
Amount: £11.80

The pongy whiff intensifies when you read the press reports which noted that GMG Solutions is in fact run by Charlie Gordon’s son, Gavin. As Heather from Idea15 noted, GMG Solutions “does not have a web site, a portfolio, or any basic contact information, and from that we can infer that they do not exist.”

Heather was none too impressed by the website:

It’s done in table layout, its base colour is flamingo pink, it uses Flash for basic navigation buttons, and it has 45 basic coding errors. Worryingly, there are no analytics counters or codes, which means the MSP neither knows nor cares why people might be reading his site.

Moreover, the poor design of the website means that it actually may be in breach of the Disability Discrimination Act.

As Heather pointed out, the navigation buttons are Flash files. This is totally unnecessary, limits web accessibility and makes it more difficult for Google and other search engines to find pages.

Indeed, Charlie Gordon’s stats show that in January 2009, while the home page accounted for 1,792 hits, the eight navigation buttons (which appear on every page of the website, not just the home page) accounted for an average of just 1,324 hits. This is a clear indication that many users are unable to properly navigate through the site. This could be easily diagnosed by a quick look at the statistics (as I have just done), yet no action has been taken to remedy it.

In fairness, there are plain text links at the bottom of the page. But why should users be made to scroll all the way to the bottom of each page just to navigate through the website? The plain text links should instead be at the top of the page, where the Flash buttons currently are.

Charlie Gordon's Webalizer stats
Guess when people became interested in Charlie Gordon’s website?

January’s stats for Charlie Gordon’s website show a huge spike on 23 January, the day the expense claims were released. Traffic did not return to normal levels until the very end of the month, so I will look at the period 1 January 2009–22 January 2009.

Between those dates, Charlie Gordon’s website received an average of just 54.8 visits per day. The maximum was 80 visits on 5 January. The minimum was 0 visits, achieved on both 17 and 18 January. These are outliers, so I assume that the website was down on these days. So even with Charlie Gordon spending £13,000 £1,700 per year, he can not arrange a vaguely reliable service. Considering the website is supposed to be a valuable resource to his constituents, this is a poor show.

The statistics for the whole of December 2008 are not much better. The website received just 63.7 visits per day that month.

We don’t yet know what Charlie Gordon claimed in website expenses for January 2009 or December 2008. But we do know that his largest claim in one month for the 2007–2008 financial year was £1,932.00 in August 2007. The public also has access to his web stats for that month, allowing us to calculate just how much value for money his constituents are getting out of his website.

Charlie Gordon’s website received 561 visits throughout the month of August 2007. This translates to just 18.1 visits per day. It is worth remembering that all Webalizer stats include robots (i.e. non-human visitors) such as Googlebot. As such, all of these visitor statistics are generous estimates!

Making the calculation, we can see that Charlie Gordon spent £3.44 per visit on his website that month. Even if we accept Charlie Gordon’s assertion that the website costs were in fact 20% of what the Scottish Parliament lists, this is still 69p per visit to the website (including robots). This is quite simply extortionate.

For comparison, I will use the same methodology to analyse the costs of my websites. I actually make more money on my websites than I spend on them, but I understand that advertising may not be an option on a publicly funded MSP’s website. So I will look solely at the costs of running my websites. This, too, is slightly flawed because I don’t pay anyone any wages to maintain my websites. This is purely my blood, sweat and tears, and maybe MSPs are too busy to do that. It is, nonetheless, an interesting exercise that will bring Charlie Gordon’s figures into perspective.

For the month of December 2008 I paid £7.67 (and £1.50 of this was a charge for using my debit card) for webhosting to last me for that month. I ran six websites during that month. During that time, these websites received 75,849 visits in total according to the same Webalizer package. This translates to a cost of £0.0001 (one hundredth of a penny) per visit. This is infinitesimal compared to Charlie Gordon’s figure of £3.44 69p per visit.

Incidentally, figures provided by Webalizer are much larger than any figures provided by any other stats package which excludes robots. Google Analytics, for instance, counts only human visits. It says that my sites collectively received 11,184 visits during the month of December 2008. This is just 14.7% of the figure given to me by Webalizer.

Assuming Charlie Gordon receives the same ratio of robot visitors to human visitors as I do, this would give him just 2.7 visitors per day for August 2007. As Heather pointed out, there appear to be no analytics codes installed on Charlie Gordon’s website, so we’ll never know just how many visitors Charlie Gordon gets or got. But it really could be as few as three per day or less.

I am not an MSP who is providing a potentially vital public service to his constituents. Nor am I a professional web designer. Yet I manage to get many more visitors, and spend much less money. £1,700 per year for a website is, quite frankly, a rip off. Taxpayers would have every right to be furious — especially since the taxpayer seems to be less than attracted to his website.

I previously covered Charlie Gordon’s website on the Scotweb2 blog.

Around a year ago I wrote a post that analysed the year’s activity on Last.fm. For those who don’t know, Last.fm is a website that tracks your music listening habits. It produces lovely graphs and churns out recommendations as well as providing tailored radio stations for you to listen to at your leisure. I adore the site.

This year, instead of looking just at the past year’s statistics, I have decided to look at my entire Last.fm history. A couple of weeks ago, I hit my 100,000th scrobble (instance of listening to a track). It’s a suitably big landmark.

My 100,000th scrobble happened on 7 December, just over four years after my first scrobble on 18 November 2004. By that time I had listened to 730 different artists. Of these, 18 had 1,000 plays or more. 196 artists had over 100 plays.

My top thirty artists chart looked like this:
My top 30 artists

And my top thirty tracks were:
My top 30 tracks

There are a few problems with this chart. The top track, ‘untitled (live)’ by Boards of Canada, is actually several different tracks from bootlegged gig recordings. I am quite sure that ‘Xmd 5a’ by AFX should not be that high, as one day I logged in and it showed many more plays than there should have been. It’s still a good track though.

John Cage tracks figure highly because I own three different recordings of Sonatas and Interludes for Prepared Piano. In fact, many of these tracks are high up simply because I own multiple versions, normally because I have the single as well as the album. Shining’s ‘To Be Proud of Crystal Colors is to Live Again’ is actually two different tracks with the same title. All of the Autechre tracks and most of the Jaga Jazzist tracks are here purely on their own steam.

It is obvious that, interesting though they are, Last.fm statistics are far from scientifically rigorous. For one thing, one track counts as one scrobble whether it’s 31 seconds long or 31 minutes long. One website, Last.fm Normaliser, attempts to get round this by weighting your artists by the average length of their tracks. This is also completely unscientific, but it is interesting nonetheless.

Top 20 artists (normalised)

This table makes my obsession with Autechre even clearer. Even in the normal Last.fm table they have a huge lead. But by this measure I like Autechre twice as much as any other artist. The biggest climber in the top twenty is Steve Reich, who is number 20 in this table, but number 37 in my original Last.fm chart.

My favourite thing to do with Last.fm data, though, is to analyse it using LastGraph. I did this last year, looking at my Last.fm activity throughout 2007. This time, I am looking at my Last.fm activity as far back as the data goes — March 2005, just a few months after my first scrobble.

The graph is so huge that I can’t include a readable version on this page, but a miniaturised version appears below. Click on it to view it at its original size (Warning: It’s a large file).

LastGraph

I love looking at these graphs. They tell a story about my developing taste in music. But they also, in a way, tell a story about what is happening in my life at a certain point. I can glance at the graph and remember that I had exams during a certain period, or I was working lots in that summer, or whatever. It takes me back. I’m also quite surprised sometimes at which artists appear where on the graph. It appears that my memory was a bit out in a few places.

So there we have it. 100,000 scrobbles; four years of tracking my music listening habits.

First things first. I have upgraded to WordPress 2.5. The new admin panel takes a bit of getting used to, and it is a little bit buggy for my liking. But then again that is probably because I am using so many plugins.

For the first time I upgraded using the astonishing WordPress Automatic Upgrade plugin. I’ve been meaning to use it for a while, but forgot about it until James O’Malley reminded me. So thanks for that James. Upgrading vee8 and doctorvee was flawless, although something funny happened to Scottish Roundup. Fixed it in the end (I hope), but it did make me scratch my head, especially as the other two upgrades went so smoothly.

Another thing to point out is that I have finally got that OpenID plugin installed. It doesn’t work exactly how I’d like it to, but it will do. Don’t be freaked out by it if you leave a comment and you don’t know what OpenID is. You can leave the OpenID field blank.

You might be wondering if it was even worth me upgrading this blog. It is rather shit of me to have posted next to nothing for the past three weeks and come back with a dull admin post. Well here’s what’s happening.

Last week in the comments of this increasingly quiet blog, a very public sociologist wrote:

Looks like F1 has stolen you away from us.

It’s kind of true. When I launched vee8, originally I had every intention of posting here (almost) as often as before.

What I was forgetting was that because of my mad hectic busy important 24/7 lifestyle and / or laziness, I was blogging less and less here anyway. In all seriousness, I am in my final year at university. And while I still have luxuries such as not having to get up before lunchtime, it does mean that I get shards of guilt searing through my conscience every time I write a blog post or open Google Reader. After all, I should be studying.

For around — ooh, let’s see — the past year, I have had hardly any time to blog, or indeed read blogs. Google Reader always has 1000+ items for me to read. I think I’ve only got it down to zero about twice in the past year.

Plainly, even pretending that I can keep on top of all my RSS feeds is a nonsense. I have come to realise that I don’t have the time to read blogs in the same way as I used to. I have probably gone for weeks without even reading blogs actually (excepting Scottish blogs which I have to read for the Roundup). And the thing is that I don’t really miss the blogosphere — especially the politics blogs. (My years at university studying politics have ironically made me deeply apathetic.)

“Boo, hiss,” I hear you cry. But that’s the way it is. Once I got fed up with Guido et al, it was just the start of the ball rolling and reading hundreds of posts like this is no longer my idea of fun.

This is not to say that I will retreat from politics or political blogging — and definitely not blogging as a whole — altogether. But I have to face up to the fact that as a student I have increasingly found that I do not have enough time to engage in it properly.

So many of the posts I have written over the past few months have been about topics that were lingering in my head for weeks or even months. For instance, the one about road tolls was written in my head in December as a response to Calum Cashley. I didn’t get the chance to actually write it until March. See if you can spot more (a fun game for long journeys, I’m sure)!

And that’s what it’s like when I am a lazy student bum! So what on earth is it going to be like when I actually get a proper job?!

At the same time, last month I launched vee8, a dedicated Formula 1 blog. The original intention was to spare the many readers here who do not like F1 from having to read what can at some points during the year become a blog almost exclusively about F1.

But in its first month I think vee8 has quite unexpectedly taken a life of its own. I am enjoying every minute of it. It is such a refreshing feeling to be blogging about something that actually matters rather than that politics nonsense! :P Seriously though, I have been staggered by how much fun I am having with it and how successful it has been.

I try to avoid talking about stats because inevitably someone takes offence at the showing off. So I’ll say this up-front. The following may be a reflection of how bad this blog is. Readership here has, after all, stagnated over the past 2 or 3 years which shouldn’t really happen (as someone once told me, telling me off for showing off my stats, “it’s a viral thing”).

But at vee8 — which, I remind you, is little over a month old — I am already getting as more “returning visitors” than I am on this blog. As I say, that is probably partly down to the fact that I post here far less often than I used to, while there is usually daily content at vee8. But I’m still amazed at how quickly it has got a solid readership. Obviously it helps that I had plenty of F1 fans reading here originally, but boy — if only I found it this easy to get readers the first time round!

Long story short. I am now running three major blogs. Scottish Roundup has to have a new post every Sunday, so a lot of my Fridays and Saturdays are spent making sure that happens. vee8 is fresh, new and exciting and this season looks like it’s going to be a corker, so a lot of my attention is now focussed there. This one is my personal blog, so I don’t feel like I owe it much attention.

Just two years ago this was my only blog. Now it is just part of my wider blogging activity. With that fact along with impending adulthood, I am having to steer a new path for this blog.

I am probably being melodramatic (it is 4am), so I will say that probably not much will change. In fact, the changes have already happened and I just need to adapt to it.

I stopped being part of the conversation in the wider blogosphere a long time ago without ever meaning that to happen. I just don’t have the time to follow it. So that probably means writing fewer, more in depth posts on a miscellany of subjects.

You might well have noticed that already. The previous five posts here were about coffee, Autechre, income tax, Freeview and Radio 5 Live — quite a mixture. And that takes us practically to the beginning of March. To think that I used to write an average of six pithy posts per day about the day’s current subjects!

It won’t pick up any time soon. Those shards of guilt will be extra painful as it’s exam time. But I have just three exams, and then it will all be over! The difficult part comes after that — looking for a job. (My status as a person, incidentally, is another thing that it making me more reluctant to blog here… Google and all.)

I just remembered that almost a year ago I hilariously joked about giving up blogging. Now I am looking back on the past year thinking it was actually quite prescient.

Anyway, please forgive the navel gazing. I am planning to return tomorrow with another post here, but whether it will interest you is a different matter.

(Yes, every post I write about RSS must contain the hilarious “‘RSS’ sounds a little bit like ‘arse’” pun.)

I have a request for those people who publish RSS feeds. Make them full feeds!

I know there is a supposedly a debate about whether partial or full feeds work best. Well, that is not really the right way to put it. Everybody knows that full feeds work better than partial feeds. I mean, it is like saying that a sandwich is better than the crumbs. It’s just obvious.

But some website owners are, for some reason, sniffy about full feeds. Some people publish partial feeds for relatively superficial reasons, for instance because they can’t bear for any readers to be reading it in an environment other than their lovingly handcrafted web page design. Others have more serious suspicions: that full feeds rob them of page views and rob them of advertising revenue.

Earlier this year, the rather good Freakonomics blog moved to The New York Times website. At the same time, the full feeds were snatched away from the blog’s many readers. Apparently, it is NYTimes policy.

Immediately there was an angry reaction from readers. It (mostly) wasn’t from readers concerned about NYTimes itself or even due to the fact that the URLs had changed, that there was an entirely new navigation system to accustomise to, or anything like that. They were almost all from people who were angry that the full feed had overnight turned into a partial feed. Many readers even said they were unsubscribing.

The comments to the initial post were just the start of it. Several subsequent threads descended into similar “outraged of Bloglinesville” mobs, and it has become a recurring topic on the blog ever since. This is one plus side — at least the authors are open about the problems and the reasons why they can no longer offer a full feed.

While I wouldn’t go so far as to get angry, I would guess that I have read a lot less of the Freakonomics blog since the move. This is entirely down to the fact that it no longer offers a full feed.

I am aware that a lot of people simply cannot believe that (or understand why) full feeds generate as many clickthroughs as (or sometimes even more clickthroughs than) partial feeds do. It doesn’t seem to make sense, right? If people can read the entire content without leaving their RSS reader, why on earth would they visit the website?

But it doesn’t work like that. FeedBurner say so — and they would know. To me, it is just common sense. I have been reading RSS feeds for a few years now, so I think I have a pretty good idea of the reasons why partial feeds just do not work.

Think about why people use RSS feeds as opposed to visiting the different web sites all the time. It’s obvious: people who use RSS feeds do so because it makes it easier and quicker to read everything they want to read.

So immediately we have run into the problem with partial feeds — they do the precise opposite of what the reader wants. They make it more difficult and slower to read what you want to read. If you have begun reading and want to read the rest of the content, it involves clicking through and waiting for the (probably bloated) web page to load. It is a needless, unwanted, time wasting, inefficient hassle.

That explains why readers generally don’t like partial feeds. But what about the clickthrough rate? First of all, it is worth pointing out that page views are falling out of favour as a meaningful web metric thanks to the increasing use of Ajax and other kinds of magic. In a funny way, more page views usually means it’s a worse website. (Ask users of MySpace and Facebook about the navigation of those sites, and see which site has the happiest users.)

But let us say that page views (and certainly visits) are a good thing. So why should you use full feeds? Once again, for me it is down to convenience. I use RSS feeds because it allows me to squeeze more reading into a shorter space of time. Imagine sitting there in front Google Reader. You have a list of items waiting to be read. So you get on with it and start scrolling through, scanning for anything interesting.

By now, you may have realised why partial feeds do not automatically generate clickthroughs. It is because there is less of the content for me to scan-read and evaluate. Typically, a partial feed will contain the headline and the first couple of dozen words. This simply is not enough to give me as a reader an idea of how good the rest of the article is. Neither is it long enough for the author to sell the article.

There is one site that falls victim to this more than any other if you ask me. Tim Worstall, one of the most widely-respected British bloggers. His RSS feeds simply do not do his blog justice.

I will sit there with Google Reader and scroll through the many posts he has written that day, and all too often I find myself not being enticed by a single one of them. That is not because they are not interesting. It’s because his partial feeds simply do not give me any confidence that clicking through to read the rest of the post will be worth my time.

If Tim Worstall writes ten posts in a day (which is my conservative estimate of what he averages), he is asking me to read ten summaries, click ten times, wait for ten web pages to slowly load, then read ten full posts. What a waste of time!

This is especially annoying if the partial feed stops in the middle of a sentence, which is almost every time. When the partial feed stops at the end of a sentence, then there is the confusion over whether I had read the full post (just a really short one), or if it was just a fluke that the feed finished in a neat position.

If Tim Worstall provided full feeds in the first place, I could have just read them all there instead of going through all of that hassle. Who knows, I might even have clicked through and left a comment. I might have bookmarked one of his posts in Delicious, letting other people know how good the post is. I might even have blogged about it. I might even have clicked on an advert!

As it is, I just scroll through the summaries and ignore them all. I have, in the past, unsubscribed from his blog because of the frustration over this. I recently subscribed again, but can’t say I read a good deal more of his blog as a result.

Some other blogs provide “summaries” instead of partial feeds. This is where, instead of the first few words of the post, the author has instead specially written a summary designed for the feed. The problem with this is that sometimes it is made up of a random paragraph taken from the middle of the article. Even worse, it might give away the conclusion before I have even read what it was the conclusion for!

If I am enticed by such a summary, I will click through and find myself reading the post and thinking, “This isn’t what I thought I was reading.” Then I will come across that paragraph in the middle. Ah, and that introduction in the summary? I have found out that it was actually a conclusion. It is like forcing somebody to read the last page of the novel before reading the rest of it!

There is another more fundamental reason why people should offer full feeds. It is just plain rude not to. RSS subscribers are your most dedicated readers. They are people who have decided that your content is good enough to have it effectively delivered straight to them on a regular basis.

Yet, how are these dedicated readers paid back? By getting a mangled fraction of the content that they asked for. It is like subscribing to your favourite magazine only to find the publisher sending out cuttings rather than the whole magazine. What a way to treat your regular readers!

I can hear the howls already: “What about all of the beautiful adverts that I have lovingly placed on my blog / newspaper / whatever? If I offer full feeds, nobody will look at the adverts and I won’t make any money!” Again, there are several responses.

I have already explained why full feeds do not lead to a reduction in clickthroughs. So people will see your adverts just as much as they always did.

There is an even more obvious answer: what is stopping you putting adverts on your feed? Plenty of big websites already do this. It is perfectly possible. People who are refusing to offer full feeds because “they don’t contain my adverts” are simply shoving their heads in the sand.

Even if there was a legitimate concern about adverts, it has to be remembered that your regular readers (the sort who would subscribe to your RSS feed) are the very people who are the least likely to click on the adverts anyway.

Let us not forget also that a lot of adverts are not even designed for human eyes as much as they are designed for SEO. These kinds of adverts would not even mind not being seen (just as long as Googlebot sees it).

Maybe you are concerned about stats. Let’s face it, as bloggers we all are. We want to know how many people are reading. What would be the point if you had no way of knowing if people were reading or not. Gordon McLean (whose recent post on RSS is an interesting read) falls into this group.

Admittedly, this is one downside to RSS as it becomes impossible to find out precisely how many people are reading. Mind you, web stats are not generally the most reliable things anyway. Run four different stats counters and you are bound to get four different — sometimes wildly varying — figures. RSS further muddies the waters.

As it happens, I recently moved over to having this blog’s feeds provided by Feedburner (combined with the absolutely vital FeedSmith WordPress plugin), partly because it would give me some fairly accurate (but not precise) statistics. I was pleasantly surprised to find that around 140–150 people are subscribed to this blog. (Hello to you good people. I hope you are enjoying the full feed!)

Beforehand I had vague ideas of who was reading this blog’s webpages and why. But I had no idea of how many people were actually subscribed to this blog’s RSS feed. But now I do have some fairly interesting and meaningful stats about my RSS feed. So even the stats issue with RSS feeds is resolved to an extent.

All of this is not to say that partial feeds do not have their place. For instance, they are perfect for news websites. This is because of the way they work. We are used to just scanning through a front page containing only a headline and a (very) brief summary of each story. From here we choose which stories we want to read. This is how news websites work, and partial feeds can reflect this.

Blogs, however, do not work in this way. Very few blogs offer just a summary of each post on the front page. The blog format does not usually lend itself well to this approach. Rather, the vast majority of blogs’ front pages contain either the full content of the most recent posts, or at least a huge chunk of them.

As far as I can see, there is no reason why the vast majority of web sites should be forcing their most dedicated users to put up with shoddy, sub-standard partial feeds. For me, the fears that website owners have surrounding full feeds are mostly unfounded.