Archive: Yahoo! Pipes

You may know that I run a Formula 1 blog called vee8. It’s just one of a number of websites I am now running. It’s a lot to have on my plate and recently I have been looking at ways to save time.

Last week I asked my readers if they thought I should continue with the daily roundup of F1 links. I was bowled over by the overwhelmingly positive response. But I was still unsure about constantly using the same few sources all the time.

Websites dedicated to Formula 1 tend to be very good for day-to-day gossip and news. They have a very good feel for what is going on generally in the F1 world. But occasionally a major media company, which doesn’t necessarily churn out a great deal of F1 content, will get a big scoop. In fact, I can’t think of a quality or mid-market newspaper which doesn’t, from time to time, have interesting stories that the dedicated F1 sites have missed.

In an attempt to try and catch these stories before reading them elsewhere, but without getting overwhelmed with boring, samey or irrelevant stories, I decided to try and construct a Yahoo! Pipe. My idea was to pull in the F1 feeds from a wide variety of media websites, but filtering out stories containing words like ‘Hamilton’ or ‘Button’ so that I didn’t get overloaded with nationalistic puff-pieces.

Unfortunately, this is proving difficult. Most media websites are simply unwilling to supply me with the content I want. Honourable exceptions are guardian.co.uk (which even has a feed dedicated to Lewis Hamilton, for all your stalker needs), the Telegraph and (amazingly) the Daily Express. Other websites’ approaches towards RSS are disappointing.

Times Online doesn’t appear to have a dedicated Formula 1 or motorsport feed. It has a Sport feed. Confusingly, rugby and tennis get their own feeds. But no other sport does — not even football. The rationale behind this isn’t very clear, and having seen that two sports do have their own feeds, I feel like going on the hunt for the others. But they aren’t there. Strangely, the rugby and tennis feeds are displayed completely separately, not as a sub-category of sport.

FT.com doesn’t have any sport feeds at all. I suppose that is understandable in a sense, as the FT is due to cut back its already rather scant sports coverage. But it does mean that I will miss out on the F1 stories it does have from time to time.

The Daily Mail website lumps Formula 1 content in the ‘other sports’ section. This has its own RSS feed, but unfortunately it is shared with tennis, horse racing and, er, yet more ‘other sports’. I somehow doubt that fans of any of these sports will find this RSS feed particularly useful, unless by some fluke they are a fan of all of them.

Daily Mail RSS feeds The paper is, however, happy to cater for the niche needs of football fans. 28 separate football clubs have their own RSS feed. More creepily, the Daily Mail offers dedicated RSS feeds containing the latest news on a number of different celebrities, for the stalker in you. Quite good for stained raincoats, but not so good for anoraks like me.

These websites are surely missing a trick. It shouldn’t be a problem to provide RSS feeds for any topic, no matter how niche. WordPress certainly offers this functionality, and every category and tag has its own RSS feed. But some websites’ approaches to RSS feeds seem arbitrary at best. It seems particularly inexcusable in this increasingly long tail-aware age.

Presumably newspapers want people to read their content. But some of their websites are sticking to the old model of content delivery — chucking it all in one place and making its readers browse through everything until they come across an article they’re interested in. That was all very well when the most efficient way of disseminating news was to print it on a dead tree. But that was last the case at least ten years ago.

Now we have more efficient and cost-effective ways to get to the information we want, but newspapers seem dead set on not offering them to us. Bandwidth isn’t an excuse. guardian.co.uk not only offers RSS feeds for a huge variety of topics, it offers full RSS feeds for them. Plus, with a nifty bit of URL hacking, you can access highly specialist RSS feeds that aren’t even advertised at all.

So why are some websites still asking me to subscribe to an “other sports” feed filled with a baffling mish-mash of unrelated stories? What makes the editors of these websites think that I am going to hunt down their F1 content by spending my time trawling through their badly designed website all the time, or read through a thousand RSS items that don’t interest me?

The thing is, someone looking for niche content is probably more likely to subscribe to an RSS feed. This is specifically because they don’t want to go through the entire site’s content. Yet these websites only supply RSS feeds containing a large range of the content. For the content consumer, this doesn’t save much more time than visiting the website.

If these websites offered an RSS feed for F1, they would be guaranteed at least one reader — and then more when I link to interesting articles from vee8. As it stands, I am tearing my hair out and finding it easier not to think about these websites at all.

I know this sort of thing bores most people to tears, but I wanted to point out a change I’ve made to this blog. For a long time I’ve wanted to bring more attention to the stuff I do elsewhere — my other blogs, Twitter and the like. This blog still gets more visitors than my other blogs even though I can go quiet here for weeks.

At first I put up two different solutions on the one page (lifestream). But that was still out of the way, and it wasn’t very good either.

So instead I have decided to sweep up the sidebar and put in what I’m calling a ‘sideblog’. Note that if you’ve come here from an RSS reader, it only appears on the homepage.

The sidebar aggregates my content from all sorts of different places — my other blogs, Twitter, Delicious, Last.fm, Flickr and more. Comments that are posted on this blog also now reside there — although I haven’t yet worked out if this is a mistake or not. Everything else in the sideblog is ‘my’ content, but the comments are clearly not. So I might separate them out again later on. Any thoughts?

The sideblog is arranged in chronological order, but to save it from getting bombarded with content from one place (for instance, I uploaded 40-odd photographs to Flickr today), I’ve limited each site to having five entries at a time. The exceptions are Delicious which is limited to 10 and Last.fm which is limited to 1.

I built the sideblog using Yahoo! Pipes (which I found very difficult to get to grips with at first, but I eventually got it to do more or less what I wanted to do) and SimplePie. Some pretty desperate CSS magic got the icons appearing kind-of where I wanted them to.

Any thoughts on it? Hopefully it will be a good way of getting more fresh content here for the times when I am posting more at other places. I’ve kept a copy of the old sidebar though in case anyone is offended enough to want the old one back.

Jeff at SNP Tactical Voting took the baton from me and listed his top 10 blogs (although unlike me, he concentrated just on Scottish political blogs). In the process, he accused this place of having “a scarcity of posts of late”.

Guilty as charged. A number of elements have conspired against me when it comes to updating this blog.

First of all, I set up a separate F1 blog — immediately robbing this place of around half its content! Then there was the fact that I was in my final year at university. I didn’t want to mess it up as the dissertation deadline passed, then essay deadlines, then the exams came along.

Even since the exams have finished, though, it hasn’t quite worked out. I always find the transition from busy (!) student to lazy summertime bum difficult for some reason that I can’t put my finger on. Blogging always takes a back seat for a week or two as I grab some rest and get those summer jobs dealt with. I have been — gasp — reading books for leisure (which I never get the time to do during term time). I have been listening to that pile of unlistened-to CDs that has built up since last summer. The pile is now down to six which is very exciting. I have also tidied my room from top to bottom, sorting through stuff to work out if I should chuck them out or not.

Then there is the small matter of finding a job. Or, more accurately, working out what my career is going to be. Now that university is over for good (and I doubt I will be darkening the doors of academia again), I can now — belatedly — devote more of my brain power towards researching careers. I have not got very far forward. Every time I seem to get closer to finding a path that I find acceptable, something comes along to put me off. For this and various other reasons, I still find myself running around Edinburgh from time to time.

Also, for the past seven or eight months I have routinely been taking daily walks round the park and suchlike. This was partly to get me out of the house and into the sun. It is also with one eye on my slowly-but-surely expanding belly. A good side-effect is that I spend the walks listening to podcasts that I would never otherwise manage to listen to. However, it’s possibly fair to assume that this time may otherwise have been spent blogging which is why things have been a lot quieter here over the past year or so.

Then, just when I was ready to get back into the swing of things, all of my websites were knocked out by that exploding transformer. Then a different issue put my websites out of action on Tuesday as well! All-in-all, I lost about three days of possible blogging activity.

And then I got some good news. I’ve got a degree, and it’s a 2:1. It was such a relief — I was genuinely worried that I was headed for a 2:2 which would have been seriously demoralising. I would really have kicked myself for a few things if that happened, but somehow I have escaped.

I still don’t know the marks for all of my courses yet, which is quite frustrating. Of the scores that I know, I was on course for a 2:2. And I am sure I muffed up one of the exams that I haven’t had back yet. I’d love to think it was my dissertation that pulled the whole lot up. Anyway, I shouldn’t worry about that now. What matters is that I’ll be doing the silly dressing up thing with the stupid hats and scroll things later this month. (Incidentally, does anyone know where the hell you get a white bow tie in this area? That is the rubbish I am being asked to wear for this thing.)

All of this is just a really long-winded way of saying: yes, I know, it’s quiet round here. Jeff said that the scarcity posts is made up for with thorough detail. That is really a side-effect of the fact that it takes me so bloody long to get round to writing anything. By the time I’ve reached this little screen my head has collected so many thoughts on the issue that I end up writing a bloomin’ essay. Even this post is probably about 2,000 words long now.

The thing is, just because I’m not posting much on this blog doesn’t mean I’m not posting much at all. There are four other major outlets of mine. Twitter is the main one where I post anything that will fit into the 140 character limit. Then there is Delicious where I post interesting links, often along with a pithy comment. Then there are the two other blogs, Scottish Roundup and vee8.

These all have a presence on the sidebar here, but I thought it would be good to have an area where all of these various updates are gathered on one page. I started with a lifestream (launched a few weeks ago, though I kept it quiet). But I wanted something a bit different so I spent a bit of time in Yahoo! Pipes to create what I have modestly called the “megafeed“. For the time being I’ve placed it just above the lifestream on… the lifestream page.

Neither of them is exactly perfect. The lifestream just contains the headlines of each item. It incorporates Last.fm as well, but it’s pretty rough and ready really. Meanwhile, the megafeed just looks like a big list of stuff. There’s no way to tell whether it’s a Twitter update, a blog post or what. I tried to make it more obvious, but either there isn’t a way to do it in Yahoo! Pipes or I am too much of a n00b to work out how to do it. Just thought I’d mention it since I spent a bit of time on it. Think of it as a stalking opportunity.

Now that I have sorted that out, it is time to post not just in the four other places but here as well. Now I have drawn up a little list of posts I want to write. My calendar for this week looks fairly empty. I should probably be looking for a job but I will try to get some stuff up here too.

This is something that I mention over and over again, but it is a fact that one of the most common things people say about my blog is along the lines of, “Of course, I skip past all of the F1 posts.”

Those people would be doing a lot of skipping this weekend. The F1 season reaches its climax tomorrow, and the repercussions are sure to continue into the weeks ahead.

Just in time for the end of the season though (!) I have finally set up an RSS feed that contains none of the F1 posts! I created it using Yahoo! Pipes. Unfortunately, I can’t work out a way to make it a full feed. No matter what I try, it always comes out as a partial feed. This goes against my principle of being in favour of full feeds, but it’s better than nothing.

So if you like this blog but can’t stand F1, grab the doctorvee F1-free feed here.

I’ve been pondering this issue for at least a year now. There is still a bit of me that is tempted to completely remove the F1 content and create a separate F1 blog. I’m not too keen on the idea on the one hand. The F1 posts have become part of the character of the blog, and most importantly it would be a bit odd for my personal blog not to contain anything about one of my main interests.

I’m not sure a separate blog would be able to punch its weight either. It would be a bit difficult to justify setting up a separate blog if I am only going to post intermittently to it (my plan would be to post little, if any, more than what I already do).

Also, maintaining yet another blog would be rather time consuming. Imagine that — whenever a new version of WordPress came out, I would have to upgrade it for three blogs! Just the one is hassle enough.

However, come the start of next season I should hopefully have a bit more time on my hands. And I am still too proud of the ‘vee8′ name to let it go unused!