Ben Lobo

Conveyor article on Culture 24

2009-04-09T07:46:00.002Z

As lead developer of Conveyor, a web service to enable small museums and galleries to develop kiosk-based presentations, I feel justified in plugging a Culture24 article about the project.

eHive - Odd name for a Collections Management System

2009-03-26T09:19:00.003Z

Last night I went to a Culture Geeks talk about eHive, a collections management system (CMS) which the makers say is the first web based system of its kind. It was designed with small museums and galleries in mind as they often find themselves unable to use other CMSs because they're too expensive and/or they don't have the resources to manage and maintain it.

I can see the potential of this service for small museums and galleries but I'm not sure if eHive has got it right just yet. It's got a reduced set of the features that would be available in a full blown CMS, and this is a deliberate move to make the product more easy to use, but it still seems quite complex to me and this puts it somewhere in between being easy to use and being a good CMS.

Perhaps more CMS features could be sacrificed for the benefit of usability but I know how much importance museums give to correctly cataloguing their objects so I think I can understand eHive's predicament.

I would certainly recommend giving eHive a try out if you have a collection of objects that you want to catalogue and make available on the web. It's free for the first 200 objects.

I'm not sure I would have called it 'eHive' though.

Practical Plone 3 (pre review)

2009-03-24T06:17:00.003Z

I've just started reading Practical Plone 3 which touts itself as a beginners' guide which teaches you how to get a working Plone site up and running quickly if you don't want to get involved in programming.

It's got an impressively long list of 13 authors including Martin Aspeli and Jon Stahl, with each author being responsible for individual chapters.

This seems like a good idea on the face of it as the combined knowledge and experience of that many people has got to be broader than that of a single author. But will it suffer from a lack of consistency as a result and will that affect the message?

I don't know yet but I'll post the answers here as soon as I do.

Tim Berners Lee on "The Next Web"

2009-03-20T16:13:00.003Z

Plone workshop, London, August 2007

2007-06-28T09:50:00.000Z

For anyone interested in learning how to develop Plone sites there's a 5-day Plone workshop in London on 13-17th August 2007.

There's a fairly steep initial learning curve when it comes to developing and extending Plone. Although there's a lot of support available in the form of mailing lists, chat rooms, books and documentation on the Plone website itself, it takes quite a while on your own to get your head around such a large content management system.

That's why this workshop sounds like it would be useful to anyone with not much prior knowledge of Plone but who wants to get up to speed quickly. At nearly £1000 it's a significant investment. but I reckon it's worth it for the time it's likely to save doing it by yourself.

Plone used by Friends of the Earth

2007-06-28T09:32:00.000Z

Friends of the Earth International (FOEI) unveiled their new Plone site back in April and I'm just getting round to having a look at it now. Visually it's quite plain, a little bit too blocky and it feels very flat on the page to me. I'm not a visual designer, but I probably would have at least thrown the odd gradient in there to soften it a bit.

One of the good things about Plone is the speed at which a fully functional content-managed site can be deployed but I think more effort should be put into skinning the public appearance. If nothing else, this would at least show others that it can be done. See the British Postal Museum and Archive site for example.

Interestingly, the FOEI site uses PloneMultisite to deploy content from a single editing base to multiple sites. I'm not up to speed on exactly how this product works but it sounds like something that's worth further investigation.

ReadSpeaker in action

2007-06-07T17:24:00.000Z

Following on from my ReadSpeaker without nasty page reloads post, the nice way of implementing ReadSpeaker that we developed has now gone live on the British Postal Museum and Archive's website.

Comments and suggestions about how to make it better are welcomed.

Demand Led Standards-based Development

2007-05-29T23:33:00.000Z

I think Peter-Paul Koch's recent article on A List Apart –
Evangelizing Outside the Box: Web Standards and Large Companies – ought to make more of the power that clients have in steering the progress of web standards.

The main thrust of the article, that high profile employees of large companies could and should be highly vocal evangelists for web standards in order to add momentum to the movement in general, is totally valid and I certainly wouldn't argue against it. Such evangelism is bound to have an influence on a significant number of developers who are yet to recognise the benefits of web standards.

But the incentives to adopt the good practices of their peers may not be strong enough to enduce most late adopters to put in the work to make the jump to web standards. Why should they bother if they can maintain a viable business using the same methods as they've always used?

However, if their clients demand the use of web standards, these same developers will have to adapt their methods or risk going out of business.

So its down to the larger companies (and everyone else) to educate their clients about the benefits of web standards so that, eventually, there'll be no demand for non-standards based development and anyone who doesn't adapt will become extinct.

ReadSpeaker without nasty page reloads

2007-05-29T11:00:00.001Z

Readspeaker's a great service that makes it easy for any website owners to provide audio versions of their content on the fly. This is clearly preferable to re-recording content manually every time a couple of words get changed and the quality of the synthesized voice is actually very natural and lifelike.

Every implemetation of ReadSpeaker that I've seen works by providing a link near the text which, when clicked, either forces a page reload so that an audio player can be embedded or - and this is my personal anti favourite - opens a new page containing only the audio player and shrinks the browser window to the size of the player. Take a look at the O'Reilly Radar (click on the 'listen' link) or any number of examples on ReadSpeaker's site to see what I mean.

While in most cases it's probably true that having a badly implemented audio version of a page is better than no audio version, it is possible to implement ReadSpeaker in a nice, elegant and accessible way.

The reason why it's difficult to find any examples is that the ReadSpeaker documentation doesn't make it very clear that it's possible. However, it is possible to retrieve the URL of the generated mp3 file.

This means that it's possible to pass the mp3 url to an audio player that's embedded in the page when it first loads. If this is implemented with a suitable Flash mp3 player, the mp3 won't be downloaded unless the user decides to play the audio.

The way to retrieve the un-encoded URL of the mp3 is to make the following call to ReadSpeaker (if you want the URL to be encoded, set the 'type' parameter to 101):

http://asp.readspeaker.net/cgi-bin/[CUSTOMER_NAME]rsone?customerid=[CUSTOMER_ID]&url=[URL_OF_PAGE_TO_READ]&type=100

where CUSTOMER_NAME and CUSTOMER_ID are supplied to you by ReadSpeaker when you open an account.

Your Flash player may be capable of using this URL as it is but if you need to pass the player an actual mp3 URL, you'll need to write a script to retrieve the URL of the mp3 up front.

Here's a Python script that I wrote for use with Plone but it should be easy to adapt to any other platform:

# Python script to retrieve the URL of an MP3 audio file from readspeaker.com.

# Import required functions
from urllib import urlopen, quote

def getReadSpeakerURL(customer_name, customer_id, page_to_read_url):
  url_to_open = "http://asp.readspeaker.net/cgi-bin/%srsone?customerid=%s&url=%s&type=100" % (customer_name, customer_id, page_to_read_url)
  mp3file = ''

  try:
      fp = urlopen(url_to_open) # this retrieves a page containing the url of the mp3 file
      mp3file = fp.readline() # this retrieves the mp3 url itself

  # check for errors
  except IOError:
      mp3file = ''

# return two versions of the mp3 url, one with the URL encoded and one without
return (mp3file, quote(mp3file))

Then place the following HTML into any pages that you want to be ReadSpeaker-ed (this example is written for Plone so uses Template Attribute Language (TAL) syntax. Sorry if you're not familiar with this but I hope you can still follow it):

<div class="readspeaker" define="customer_name string:[CUSTOMER_NAME]; customer_id string:[CUSTOMER_ID]; rs_url_array python: here.getReadSpeakerURL(customer_name, customer_id, here.absolute_url() + '?hidereadspeaker=1'); rs_url_unquoted python:rs_url_array[0]; rs_url_quoted python:rs_url_array[1];">
 <h2>Hear this page read out loud</h2>
 <object type="application/x-shockwave-flash" define="flashplayer string:/flash/emff_comments.swf?src=${rs_url_quoted}" attributes="data flashplayer" align="middle" height="28" width="200">
   <param value="" name="movie" attributes="value flashplayer">
   <p>To hear this page read aloud, get the Flash Player from <a href="www.adobe.com">Adobe's web site</a></p>
 </object>
 <p><a href="" attributes="href rs_url_unquoted">Download</a> - <a href="" attributes="href string:${here/portal_url}/help/index_html#readspeaker-help">Help</a></p>
</div>

This way you can have an accessible method of providing audio content without nasty page reloads.

Apache rewrite recipe for usable URLs

2007-05-23T14:00:00.000Z

Here's a little mod_rewrite recipe for Apache that might be useful if you're developing a web app like StripMe which is a very simple service that takes a CSS file and returns a version of the file with all the comments and white space stripped out.

The location of the CSS file to be stripped is passed to the service in the query string of the URL. Normally, this URL would look something like this:

http://stripme.org/index.php?cssfile=http://mysite.com/style.css

We wanted to make the service easy to use by letting users pass the URL of their CSS files like this:

http://stripme.org/http://mysite.com/style.css

To do this, I ended up using the following rewrites in Apache:

RewriteCond %{REQUEST_URI} "http:\/\/"
RewriteRule "(.*)http:\/\/(.*)" "$1index.php?http:\/\/$2" [PT]

It's probably not the most elegant solution, but as long as there's a script in your root directory called index.php that knows what parameters to expect, it should work.

Please let me know if it doesn't work or if there's a nicer way of doing it.

One way to fix POSKeyErrors in Zope on Windows

2007-05-21T14:10:00.000Z

I just spent much longer than should have been necessary trying to fix a Zope problem so I'm going to document it just in case anyone else has the same problem in the future.

The problem started with Zope raising a POSKeyError exception whenever a certain object was accessed in the Zope Management Interface (ZMI). The object could not be removed from Zope using the ZMI in any way.

Investigation revealed that this exception signifies corruption of the Zope Database (ZODB) due to an object that has become browkn in some way.

We have backups (of course), but this worried me because it happened on our development server and we do so much development that even restoring a half a day old backup means losing a significant amount of work. So I looked for a way of fixing the problem without restoring a backup.

Further investigation revealed that this can be achieved using 'zopectl debug' to interact directly with the ZODB in a Python shell and delete the broken object.

The next hurdle was that zopectl doesn't work on Windows and no prizes for guessing what we use.

The solution was to use PloneShell, which does the same thing as zopectl but also works on Windows.

The final solution once I had my interactive PloneShell shell running and attached to the ZODB, was to replace the corrupt object with a new object:

container._setOb(idOfBrokenObject, someNewObject)

then delete the broken object:

container._delObject(idOfBrokenObject)

and then commit the changes to the ZODB:

get_transaction().commit()

Upscaling Zope with ZEO on Windows

2007-05-20T10:52:00.000Z

If you're using Plone for production level business applications and you're not yet using Zope Enterprise Objects (ZEO) I'd highly recommend switching over at your earliest opportunity.

If you've got a single server system with multiple CPUs or you want to be able to balance the application load over two or more servers, ZEO is the way to go.

I've recently switched over our Windows-based installation of Zope 2.7 (with Plone 2.0.5). The performance gains are easily worth the effort and I found a couple of resources on the Plone site that made the whole process easy to implement (see links below)

The added bonus is that new servers can now be added easily to the configuration as demand on the server increases making it a great long term solution for a production environment.

Here are the documents I found useful:

Setting up Plone on Ubuntu Feisty Fawn

2007-05-15T15:32:00.000Z

Recently I needed to set up Plone on an Ubuntu server. I wanted to run Plone behind Apache and I needed to be able to remotely administer the server on a Windows machine.

I don't have very much experience with linux so I was expecting all sorts of command line stumbling blocks but I was amazed at how easy everything was to set up, barring a couple of hiccups.

I thought I'd post a log of what I did to get the server working (mostly for my own benefit so I've got a permanent record in case I need to do it again). It's not massively detailed so don't expect a breakdown on how to install and configure things like the secure FTP client WinSCP.

I'm absolutely certain that there are better ways of doing it, and I welcome any comments about how I could have done things differently.

Install Log

On the windows machine

Download and install these useful remote administration tools:

Putty - For remote login to linux
WinSCP - For secure file transfer to and from linux

On the linux machine

Install Ubuntu desktop edition (I used a Pentium III, 1GHz CPU with 512MB RAM)
Install SSH server - sudo apt-get install openssh-server
Install Apache - sudo apt-get install apache2
Install Zope (see How to setup Plone from source for some pointers on this) - sudo apt-get install zope2.9 (if you leave off the 2.9 bit it will probably find the package containing the latest version)
Make a Zope instance - sudo /usr/lib/zope2.9/bin/mkzopeinstance.py

Provide the information requested:

Directory: /var/zope/instance001
Username: user
Password: pass

If necessary edit zope.conf to specify port number, etc (it may be necessary to use a terminal to change the owner of zope.conf before you can save the changes to files that you edit)

sudo chown user /var/zope/instance001/etc/zope.conf

and then back again when you have finished

sudo chown zope /var/zope/instance001/etc/zope.conf

Run zope - sudo /var/zope/instance001/bin/runzope (or, to run it in debug mode: sudo /var/zope/instance001/bin/runzope -X "debug-mode=on")

or:
sudo /var/zope/instance001/bin/zopectl start

sudo /var/zope/instance001/bin/zopectl stop

Install PIL - sudo apt-get install python-imaging
Download and install Plone 2.5.2 (you may have to change ownership on the Products folder before you can transfer the Plone files to the Products directory)

Apache setup - See HTTPD - Apache2 Web Server to see how Apache is configured in Ubuntu

to create a new virtual host, make a copy of the default site and then - sudo a2ensite site-name
To enable a module - sudo a2enmod module-name
Enable mod_proxy and mod_rewrite

sudo a2enmod proxy
sudo a2enmod proxy_http
sudo a2enmod rewrite

Edit proxy.conf to allow proxying (I could only do this by enabling proxying from the specific client I was accessing the site from but I need to find a better way as this opens up the server to general proxying which is bad)

Change 'Proxyrequests Off' to 'Proxyrequests On'
Add 'Allow from all' in tag

To restart apache:

sudo /etc/init.d/apache2 reload
or:
sudo /etc/init.d/apache2 force-reload

For accessing the ubuntu server using a remote windows environment:

On the Ubuntu machine, log in locally to the desktop and open System -> Adminstration -> Login Window

In the 'Remote' tab, select 'Same as Local' from the 'Style' drop down list

On the Windows machine, Install Cygwin and the X11 components
Edit [CYGWIN_INSTALL_DRIVE]:\cygwin\usr\X11R6\bin\startxdmcp.bat setting the IP address of the REMOTE_HOST to the IP address of the Ubuntu server
Launch [CYGWIN_INSTALL_DRIVE]:\cygwin\usr\X11R6\bin\startxdmcp.bat

Note - By default, this will only allow you to have one session running simultaneously but this can be configured in the Login Window settings in Ubuntu

For further help, see:

Brighton coding dojo

2007-02-08T00:07:00.000Z

I went along to the Brighton Coding Dojo for the first time today. I didn't really know what to expect so was nervous as a kitten and it turned out to be just as scary as I imagined. Well, almost.

Above: Coders going at it at the Brighton coding dojo

I'm not at all used to standing in front of a group of people and verbalising a programming problem while simultaneously trying to code the solution to the problem (and we were coding in Ruby using Eclipse, neither of which I had any experience of).

My usual methodology is to take my time, on my own, thinking about a problem, sometimes making notes and drawing diagrams and then coding in a not altogether best practice kind of way which gradually gets me to the end goal.

But that's exactly why I went - to learn about new techniques, improve my skills, share my (limited) knowledge - and it all took place in a relaxed, friendly kind of way (although someone did suggest that it seemed like a kind of geeky fight club).

So I'll definitely be going along to another dojo (if they'll have me).

I found it useful. You could too! - Firebug

2007-01-30T22:39:00.000Z

Today's useful thing is the Firebug extension for Firefox.

If you're a web developer Firebug's an absolute must have. It's like a mechanic's pit for web pages. It lets you get right underneath and have a good tinker with all the elements that make up the page.

Any one of its features would make a great tool in its own right. Like being able to edit the html code of a page in the browser and see immediately what effect the changes are going to have without even refreshing the page. But it's does so much more than that. You can edit, monitor and debug all the html, css and javascript that makes up any page - including data returned by Ajax calls. Take a look at Jesse Newland's Firebug 1.0 screencast.

If it's not already in your developer's toolkit, add it.

One little hiccup: Firebug 1.0 has recently been released but a lot of users are experiencing a bug which prevents the styles from being displayed and can only be fixed by uninstalling Firefox and reinstalling it in a new directory. There's a discussion about this on the Firebug blog.

I haven't done this yet as I'm hoping a better fix will be found and released soon and I don't fancy reinstalling Firefox.

Above: Screenshot showing Firebug 1.0's styles bug in the right hand pane.

Despite this, I'd still recommend upgrading if you're still using version 0.4.

Previous post in this series: Enlarge TextArea

Collaboration with Google Docs

2007-01-29T21:32:00.000Z

Following a recent heuristic evaluation, Yandle and myself put Google Docs collaboration capabilities to the test to write the report.

Above: Collaborating with silly faces.

We were working in the same room on separate workstations so we could easily communicate and in the beginning we were being really careful about making sure that we weren't working on the same part of the document at the same time in case one of us accidentally wiped out something that the other was working on.

However we quickly found that we didn't need to worry about this at all because the document was being autosaved so frequently. Every time it was saved the changes made by the other writer would be merged in seamlessly with our own changes. So in fact it was very rare for there to be any conflicts in what we were doing which gave us more time to shut up and get on with the task itself.

Even when there was a rare conflict and the most recent changes were lost, the amount of changes that had been made between autosaves were so few that it was very easy to recover from.

Additionally, if there had been a more serious loss of work, it would also probably have been easy to recover from as Google keeps multiple revisions of a document allowing you to go back and compare documents over time.

Possibly the most difficult part of working with Google Docs was learning to trust the system and remembering not to press Control-S to save the document every ten seconds in case the application crashed.

When one of the computers did crash there was no panic and we felt safe in the knowledge that, being an online application, the document wouldn't be lost even if the computer was dead forever.

I'd definitely recommend using Google Docs as a collaboration tool and even as a plain old non-collaborative word processor (although I'd like to test it out with a few more simultaneous collaborators in different rooms to see whether it would deserve such a glowing report under those conditions).

I found it useful. You could too!. (Pilot)

2007-01-24T23:27:00.000Z

This is a pilot for a series of posts I'm calling "I found it useful. You could too!". The ratings will decide its future. Or if there's no ratings I'll decide cos I rule.

Today's useful thing was introduced to me by Yandle. It's a simple bookmarklet that just increases the height of all the text area fields in a form on a web page. As most text areas in web forms are way too short for what you want to put in them, I found it useful. You could too! (now do you see where the title comes from?)

To use it, just drag the link below into your bookmarks toolbar:

Enlarge textarea

Now find a page with text areas in a form, click on the bookmarklet and hey presto!

Jump on the snowwagon

2007-01-24T23:05:00.000Z

Snow today in Brighton sent most of us into some kind of mental weather frenzy, including me. Use your eyes on these pics.

Postage to the BBC

2007-01-22T09:29:00.000Z

If you don't have your own blog (or even if you do) and you feel like airing an opinion or just chewing the fat with a chance of it being read out to millions of listeners worldwide, go and post an entry on the BBC Five Live radio's First Post site.

Yeah, it might just be a very cheap way for the BBC to get fresh content onto their site and keep it up in the search rankings but this is the BBC. It's not likely to be short of visitors, is it?

Virtual embarrassment for a Second Life virgin

2006-12-05T21:11:00.000Z

Today I created my first Second Life account. After five minutes I was floating in the clouds with no idea how to get back down. Hit the fly button - up, up and away.

Well, isn't that what every newbie does (right after stripping all your clothes off, turning yourself into a woman and running around in the nod like a nutter)?

So I logged out and in again (after waiting four minutes before it would let me back in for some reason) and found myself in some strange land full of non-newbies who all seemed to know what they were doing.

Gone was the safety of the learning island where everyone was stumbling around with the same carefree ignorance as me. It wasn't that I was frightened or worried, but I did feel physically uncomfortable in that place surrounded by all those knowledgeable strangers.

On reflection I put this emotional response down to real embarrassment and the need to fit in with the crowd. I didn't want others to see me for what I really was - an inadequate newbie.

Given that, at the time, "I" was Charlie Lupino, an androgenous, vaguely humanoid avatar with a blue mohican, white underpants and the power of flight, that's a pretty powerful emotion.

Movements towards web patterns

2006-08-15T09:30:00.000Z

This is an interesting set of statistics collected by Google that shows the most commonly used classes in web pages.

Apart from the fact that 'footer', the most common class, and quite a few of the others should probably be ids and not classes as you're not likely to have more than one occurrence in a page, this makes me think that perhaps we're not that far away from the types of web patterns that John Allsopp is talking about (mp3).

If most pages that use classes are already unknowingly using very similar naming conventions, maybe it wouldn't be too difficult to encourage and educate developers to adhere more closely to recognised and reusable patterns in their markup.

My developer's toolkit

2006-08-08T09:30:00.000Z

These are the tools that I currently use to develop websites. With the exception of Dreamweaver (which I'll be trying to migrate away from in favour of Nvu as soon as possible), they're all either open source or freely available services

Firefox web developer's extension - loads of tools for inspecting and testing web pages (Firefox extension)
Subversion - Source file versioning system
Tortoise SVN - Client for Subversion (Win)
Dreamweaver - Web authoring (not open source)
Gimp - Image editor
HTML-Kit - Text editor
HTML validator - HTML validation
CSS validator - CSS validation
W3Schools - Reference resource for CSS, XHTML, Javascript, etc)
Firebug - DOM inspector with great tools for debugging AJAX development (Firefox extension)
View Source Chart - Very accessible HTML source viewer

The following aren't really tools but incredibly useful open source applications that make life a whole lot easier:

Apache - Web server
Squid - Caching server
Zope - Application server
Plone - Content Management System (built on Zope)
Python - Object oriented programming language

The following are tools that I don't currently use but that I've heard good things about:

Nvu - Website authoring
Audacity - Audio editor
GMail Drive - Virtual hard drive using GMail (Win)
gDisk - Virtual hard drive using GMail (Mac) -
Rico - AJAX library
Prototype - AJAX library
Inkscape - Vector graphics

d.Construct schedule announced

2006-07-12T09:00:00.000Z

Following on from my geekish excitement about the news that dConstruct conference was staying in Brighton, imagine how happy I am now that the conference schedule's been announced.

I'm exaggerating of course, but I am looking forward to it - just hope I get a ticket.

Most notable for me about the schedule was the lack of a mention of "Web 2.0". It seems it's become pretty uncool to refer to it these days.

Perhaps it's because the "Web 2.0" buzzword has done its job and has become too restrictive for what is now "Web 2.1" (although to call it that would be even less cool than Web 2.0).

Maybe there are other reasons. I'd be interested to hear them.

Free the PAS 78 guide!

2006-07-07T07:50:00.001Z

Up until now, PAS 78 (Publicly Available Specification), a guide to good practice in commissioning accessible websites, should have been called PASTAWCAI 78 (Pubclicly Available Specification To Anyone Who Can Afford It) because you had to pay £35 to download it.

Fair enough - an honest day's pay for an honest day's work.

Anyway, I guess that the authors of the guide have now recouped their costs and maybe a little bit of profit on top and they've now made it free to download (although when I tried the link it was unavailable).

So if you're planning to commission a website and have any interest in web accessibility (which you should) or if you're involved in web development in any way, go and get it.

Choosing an open source CMS

2006-06-27T09:30:00.000Z

Personally, I'd recommend Plone to anybody looking for an open source content management system (CMS). But perhaps I'm a little biased towards it because I've done a lot of work with Plone and I know how good it is. So here's an unbiased article about how to choose an open source CMS.

Some argue that Plone is less suitable for small businesses and organisations but I disagree. Out of the box, Plone may be a little overblown for those who just need to get a small site up and running and want to be able to edit their own content.

But Plone's flexibility means that it can be customized to remove or hide a lot of it's features until they become necessary, making it very easy to use.

And, when the time comes to expand the site and add features and functionality (which it will), Plone can handle it.