9. GENERAL QUESTIONS
General questions related to overall aspects of using the web and the resources chosen. Users were asked what clues they look for to tell them that a page is loading, their first impressions of the websites' interfaces, and their preferred choice of resource.
9.1 How do you know the page is loading, or has finished loading?
Users were asked how they identified whether the page they were linking to was loading or had finished loading. One or more clues were generally mentioned and these remained consistent with users across each resource. Clues have been grouped into two main headings, visual clues and aural clues:
Visual clues:
· Status Bar: The coloured bar at the bottom of the page moves from
side to side or fills up as the page loads.
· Egg Timer: The egg timer appears on screen, telling you that something
is happening on screen.
· Percentage: A percentage is given in the status bar, indicating how
much of the page has loaded.
· On-screen Activity: The screen begins to load up bit by bit.
· Browser Icon: The Web Browser Icon moves around while the page is loading
and is still when the page has finished loading.
· Document Done: where the status bar says "Document Done" when
the page had loaded.
Aural Clues:
· Hard Drive: Noises from the Hard Drive indicate that something
is happening on screen.
· Keystroke: To activate the screen reader - for example it will read
out the URL if it has appeared in the location box.
· Document Done: Screen reader reads out "Document Done" when
the page had loaded.
· Read out: Screen reading software starts reading out from the top of
the page when it has loaded.
The sighted users all mentioned visual clues to tell them a page was loading or had finished loading, while one user said that they could also "hear the computer working". In total, the sighted users cited the status bar as the most popular indication that the page was loading (sixteen users), followed by on-screen activity (twelve users) and the Browser Icon (eleven users). Document Done was cited as the most popular way of telling a screen had actually finished loading (thirteen users).
Comments from the sighted users included:
I have a little box that fills up with purple and the bit at the bottom [status bar] that says finding page, or whatever.
... I might look to see if any graphics appear.
... what is happening on screen.
I was looking at the browser and the percentage that tells you how much of the page is loaded.
... image coming up bit by bit on screen.
.... When the page looks complete. Menu bar dropped down very quickly so we seem to be ready to go.
Most used a combination of clues such as on-screen activity in conjunction with the status bar or the Browser Icon in order to decide that a screen was loading or had loaded:
I look at the Netscape Icon and the status bar at bottom and
image coming up bit by bit on screen.
See if the url has come up in the address box. Also the
status bar (blue bar) and the percentage. Also I can see
the screen has loaded.
I can hear the computer working. There is some colour moving at the bottom (status bar), and I can see the page coming up, the wandering gauge at the bottom, see file information and the images are coming up, percentage loaded etc, details at bottom of the page.
The visually impaired users mentioned a number ways of telling the page was
loading, both visual and aural.
Aural clues included waiting for the assistive technology to start reading out. This was the most popular way to tell that either the page was loading or that it had loaded (twenty-one users). Four users mentioned using a keystroke to trigger the screen reader to read out the location and six users mentioned listening to noises from the hard drive to tell them that something was happening.
Visual clues mentioned by the visually impaired sample (i.e. those with some sight) were "looking at the status bar" (five users) and "general on-screen activity" (four users).
Comments from visually impaired users included:
... things flashing on screen
I have a bit of vision, so I look at the blue indicator at the bottom of the screen
Sometimes the thing at the bottom stops and also Done.
A keystroke I can use that tells me what is at the bottom of the page
.... the graphics have loaded up although I can't really tell the page has finished loading.
... I can tell [it's loaded] when I've got a screen full.
Starts reading from the top. If status bar is on then it will read out Document done. Sometimes reads bits of information out, jumping all over the place. When it settles down a bit you can usually tell the page has loaded and you can tab through the links if there aren't too many.
Sometimes I just need to hear a few characters read out then I know the page has loaded.
One user who had difficulty interpreting text mentioned three things to watch out for: "... the turning globe, the things flashing on screen and the bar thing" but went on to say that "some of the visual clues can be misleading".
9.2 Comments about the interface
Users were asked to briefly describe the layout of the page, indicating the type of information provided and their overall first impression of the interface. Answers given were very varied. Some users just commented briefly on the type of site, e.g. a shopping site, or that it was a page with a lot of links. Others went into more detail, describing the features offered and their opinion of the layout of the page.
9.2.1 Search Engine
The sighted users mentioned a range of features offered by the Search Engine, such as the search facilities, the choice of directories, files and links to other options. Generally, the sighted users appeared more interested in either the search facility or the links provided on screen. Fifteen users mentioned the search facilities and eleven mentioned the links provided. Comments included:
There is a lot of information on it, which I don't really look at because I know where I want to be - in the search box (sighted user).
Lots of information and a search box which is quite small (sighted user).
I spotted straight away where the Help is and where to type something in, but I really wouldn't take any notice of anything else (sighted user).
It offers the opportunity to browse things like the web directory and different topics I could go into if I wanted to browse (sighted user).
They also made general comments about their overall impression of the interface. Comments included:
Everything seems quite straight forward, help is available if I need it. You have to scroll down to see the whole page, but I don't really have a problem with this (sighted user).
Too many links, it is quite confusing and unorganised (sighted user).
Maybe if I read some of the information I would find things quicker, but I don't (sighted user).
I don't really like flashing stuff, but that's just me (sighted user).
The visually impaired users also mentioned a range of features offered by the Search Engine and again, the majority mentioned the search facilities and the links provided. Comments included:
The fact that it is a search engine is not immediately apparent - searching bit is hidden quite a way down (visually impaired user).
There's categories I can use and an edit field here where I can search, a combo box and a search button (visually impaired user).
They have departments, but they have mixed up with this with financial reports and accounting information. It repeats links as well (visually impaired user).
I get a rough idea what's on the page, some links I can read some I can't (visually impaired user).
There is a search facility and links to all their departments as well and there may be a search facility within each department as well (visually impaired user).
The visually impaired users also made some general comments about the interface. These included:
I know I can find things by tabbing through (visually impaired user).
I imagine it is a vertical line, but there's no reason it should be! (visually impaired user)
It tells me that there is a text-only version, I tend to steer clear of them because they are often not as up to date as the graphical version (visually impaired user).
It is a very busy site, there is a load of crap on it - you know, it's full of adverts really (visually impaired user).
A lot of it means nothing to me (visually impaired user).
It would be more useful for just a menu, to dump all this link image information (visually impaired user).
I can see where to type in a search but I can't read any of the text, it's all broken up (visually impaired user).
If I get to a complicated site like this I would go into properties and fonts [to change the settings] (visually impaired user).
Overall, users (both sighted and visually impaired) found the Search Engine interface to be rather a busy one with a wide variety of different options and categories to choose from. Because the interface was a very visual one, the sighted users were better able to quickly pin-point areas such as the search box or relevant links, which would help them undertake the task. In contrast many of the visually impaired users found moving through the page quite laborious. A comment that summed up this frustration was:
... you've got a lot of things to get through before you get to the subject matter. I don't like all this http this and http that. That's what I like about Google, it puts you straight into an edit field (visually impaired user).
(Note: the search engine used for the task was not Google, but might be regarded as one of its competitors).
9.2.2 Directory
Comments about the Directory interface from the sighted sample were generally positive, for example:
Apart from telephone numbers and things on the bottom, the page is entirely on one screen (sighted user).
Nice and easy on the eye, quite gentle colours. Looks quite neat (sighted user).
although one sighted user commented that it did not offer much more than "just a load of categories and no search boxes".
Positive comments after using the Directory were also made by the visually impaired sample, such as:
Quite good descriptions to each of the services and what each one does but do get the impression that when it comes to looking for anything it might be a bit messy (visually impaired user).
Seems accessible, all the links are speaking to me (visually impaired user).
I can tell there are links as soon as I look at it. It has a lot better contrast and I can read this much better (visually impaired user).
Very clear, says what it is (visually impaired user).
However, other visually impaired users were less happy with their first impressions of the interface, for example:
I hate all this rubbishy logo stuff - it doesn't mean anything to me ... (visually impaired user).
Still too cluttered - especially the top menus (visually impaired user).
It didn't give me any kind of an edit field, which is my favourite thing (visually impaired user).
Hopeless! I'm assuming there are links but I can't read them. I can read some of the links but not the descriptions. I can't read the links at the top (visually impaired user).
Users from both samples commented that the headings and terms used did not always fully explain to them what the site was about, for example:
There are various links but it doesn't really tell you what (the site) is (sighted user)
I would have to click on a lot of the links to see what it was offering (sighted user).
I am getting links and figuring out for myself what information it has, but it is mixed up with a lot of organisational information - at one point I think it is a company, then at the next I think it is a database (visually impaired user).
Doesn't always describe what the links are for (visually impaired user).
9.2.3 Online Shopping
Comments about the Online Shopping site were quite mixed. Positive comments included:
Offers lots of choices (sighted user).
Clean and not tacky - not too busy (sighted user).
Not bad at all, quite neat really for one that is selling something (sighted user).
It's pretty bold, pretty striking really. Usually on an opening page you don't get many pictures, but these are quite big, it's the first thing that strikes you (visually impaired user).
Looks quite good, links are quite clear (visually impaired user).
Some users thought the interface was quite cluttered, or that the information was badly arranged. Comments included:
I now have quite a lot of info on screen, including two windows (sighted user).
Now I can see a lot of graphics and quite small text (sighted user).
Seems to be quite a busy site (visually impaired user).
This could be structured better, information seems all over the place (sighted user).
Pictures with very small writing. I'm not entirely sure what I am suppose to be clicking on (sighted user).
It repeats links as well, are they the same link? Which do I choose? (visually impaired user).
The colours are horrible. Some bits are more contrasting and you've got proper words so that's better. But text is often broken, it's readable but I think my eyes are getting tired (visually impaired user).
Despite offering a search facility on the Home Page, only two users (one sighted and one visually impaired) mentioned this with their initial comments about the interface. Although some users tried the search facility after some initial browsing, all the users (sighted and visually impaired) chose to follow links to look for the information required by the task. The range of options offered on the Online Shopping site were mentioned by users included:
Information is good as there are a lot of options and I can just pick what I want (sighted user).
Various areas you need to go to, like basket and checkout (sighted user).
There is a search facility and links to all their departments as well and there may be a search facility within each department as well (visually impaired user).
I get a rough idea what's on the page, some links I can read, some I can't (visually impaired user).
Occasionally pop-up windows appeared on screen, advertising new collections or new services. Apart from one user (visually impaired) who commented that pop-up windows were usually informative, but "not always easy to close", most of the users seem unanimous about their dislike or disregard of pop-up windows. Comments included:
I will close that as I don't like them (sighted user)
The first thing I can see - and one I usually close immediately - is the pop up window and this blocks out the main site, I'll close it down (sighted user)
There's an advert coming up so I'll get rid of that (visually impaired user).
9.2.4 OPAC
Users' first impressions of the OPAC interface were generally positive. Comments mainly related to the choice of information provided. For example:
Has a number of choices (sighted user).
Very neat and tidy, says quite clearly what it is and gives an index on the left hand side (sighted user).
Headings and text are a good size (sighted user).
Tells me everything I need to know to look up anything in the library really (sighted user).
Seems quite good, lists at the top of the page the various things you can do - the various searches (visually impaired user).
Well labelled, quite easy from the beginning to go straight to wherever. Right frame appears to me first, but don't know what the layout would look like (visually impaired user).
A basic description of what it is and a load of links (sighted user).
I get a very rough idea, but to be honest, sometimes if I can't read it I will just click on it to see what happens (visually impaired user).
It's got my preferred format for links, within an image and there is ALT text. It shows me all of the page (visually impaired user).
Specific comments were made about the search facility provided and about the hypertext links to information given, such as:
You have got the types of searching down the left hand side - author, title, keyword, classification number..... and near the bottom left is Help (sighted user).
Just before the link it seems to describe what the search is, like author or book (visually impaired user).
There are separate searches for each kind of thing you might want to search for (visually impaired user).
However, one user expressed confusion about hypertext links to search screens:
I expected to hear an edit field first of all, but there wasn't, I have to tab down to find the search box (visually impaired user).
Some of the design features presented on the interface, which were commented on as pleasing for sighted users, were less accessible for the visually impaired sample. Examples included the use of frames and the highlighting feature over hypertext links. Comments included:
These are quite good because they light up, or highlight when you move onto them (sighted user).
I don't like the tones when you put the cursor over some of the text, it changes (visually impaired user).
Now, this sort of thing frightens me [frames]. If I use the Virtual PC I can hear what is in each frame, so I might try and find out what's there (visually impaired user).
Some negative comments were made about the interface. The majority of these were made by the visually impaired sample and related to accessibility issues. For example:
Well, it's not accessible, as there appear to be no links at all (visually impaired user).
I had a problem there because it wasn't maximised so it wasn't reading the correct information (visually impaired user).
It is full of unsupported scripts and link images. Can't tell what the page is about, don't think I will be able to read it (visually impaired user).
It gives me different categories to search using categories like author search. It tells me that there are different options on the left, but I can't find them at the moment! (visually impaired user).
There are some links but I can't read them. I could probably guess at some of them - that's what I usually do (visually impaired user).
Some users made general comments about the layout of information in two frames, commenting that although they looked at the links provided on the left, they did not really bother with the information provided about the site in the middle of the screen:
My eyes are drawn to the menus on the left and not really to the centre of the screen (sighted user).
It has some information - which I never read! (sighted user).
I don't read the description of the site, I know the options are down the left hand side (sighted user).
9.3 Which electronic resource would you have used for this task?
Users were asked what electronic resource they would use if given the choice. A variety of resources were named and these have been grouped into the following categories:
· Same resource as used in the task.
· Search engine.
· Bookmarked (or "favourite") site.
· Would not use the web at all (for example, some users said that they
would not shop online but just go straight to the shop. For other tasks users
said they might use printed versions).
9.3.1 Task 1: to find the national and regional weather forecast
Users were asked to find out the national UK weather forecast and then the regional forecast for Manchester.
Three of the users said they would use the Search Engine that was used for the task (all sighted users).
Fourteen users said that they would go straight to a bookmarked or "favourite" site (nine sighted and five visually impaired). The BBC website was mentioned by 10 of the users. Other sites mentioned included Annaova, Ask Jeeves, and the Met Office and Capernic.
Twelve users (nine sighted and three visually impaired) said that they would use another search engine to the one used for the task. Search engines mentioned included Yahoo (mentioned by four of the sighted users), Google (mentioned by two sighted and two visually impaired users), Metacrawler and AlltheWeb.
Three users said that they would not use the Web at all (one sighted and two visually impaired). Instead they would:
Probably just look it up on the TV teletext.(Sighted user).
Just ring someone up! (Visually impaired user).
9.3.2 Task 2: to find any resources relating to the Solomon Islands
Users were asked to look for any resources relating to the Solomon Islands. Although most users said they would have used other resources than the stated one, this was possibly due to the fact that many were unaware of this particular resource until undertaking the task. One user (visually impaired) said he/she would use the Directory used in the task. Four of the users (all sighted) said that now they had used the Directory they would probably use it again, perhaps in conjunction with another resource. Comments included:
Now that I know what (this site) is I might use it. Prior to this I would have probably used Google. (Sighted user)
I would probably use (this site) or a search engine. (Sighted user).
I would probably have gone to Google and type in Solomon Islands, but I suppose this site might guarantee quality. (Sighted user)
Seven users (four sighted, three visually impaired) said they would go to a bookmarked or "favourite" site. Sites mentioned included KnowUK, Mytravelguide.com, Lonely Planet and the online CIA World Factbook. Directories that have been edited by humans for quality assured results were also mentioned.
Twenty-seven of the 40 users mentioned search engines as their preferred method of finding resources on the Solomon Islands (15 sighted and 12 visually impaired). Search engines mentioned included Google (mentioned by 6 sighted and 5 visually impaired users), Yahoo (mentioned by 4 sighted and 1 visually impaired user), Mama, MetaCrawler, AltaVista and Web Ferret.
Five users said that they would not use the Web at all (4 sighted, 1 visually impaired). Given the choice most said they would generally use a printed encyclopaedia or a CD-Rom encyclopaedia because, as one user put it:
At present it is a chore, a struggle and a bore to use the Internet. (Visually impaired user)
9.3.3 Task 3: to look for men's suits in a specific price range
Users were asked to find a selection of men's suits within a specific price range. Given the choice, nine of the users would have used the stated resource (six sighted and three visually impaired). Comments included:
I haven't shopped online before but this was encouraging. I'd rather go to the shop still, but it would be good to look up what there was first (visually impaired user).
Yes, I think I would go to a shop's web site (sighted user).
Eight users (three sighted, five visually impaired) said they would have gone to a bookmarked or "favourite" site, which included references to other online shopping sites.
Only two users (both sighted) said they would have searched for this information using another search engine, such as Yahoo's directory or shops listed on AltaVista, although one user said they would go to any site that provided a box to search.
Twenty-two of the users (thirteen sighted, nine visually impaired) said they would not use the Web at all. The most common alternative suggested was to go to the actual shop rather than trying to buy something online (although one user said that they hated clothes shopping anyway!). Typical comments included:
I wouldn't shop online, never have done and certainly wouldn't try at the moment, I'd rather go to the shop (visually impaired user).
I would go to the shop, not the website (sighted user).
9.3.4 Task 4: to find details of the British Journal of Visual Impairment
Users were asked to look for a specific journal, find its publisher and identify its former title. When asked what resource they would have used to find out this information, given the choice, a fairly mixed response was given.
Twenty-one said that they would use the OPAC used in the task (nineteen sighted and two visually impaired).
Eight said that they would use a favourite or bookmarked site (three sighted and five visually impaired). Sites mentioned were KnowUK, Visugate, Capernic, RNIB, NLB, and the British Library.
Fifteen users (five sighted, ten visually impaired) said they would use a search engine for this task. Search engines mentioned were Google, Web Ferret, or just a "bog standard search engine".
Ten users (six sighted, four visually impaired) said that they would not have used the web at all. Alternatives suggested were:
I might just go into the library and ask the librarian (sighted user).
I might try a printed source (sighted user).
I would ring up the library and ask them (visually impaired user).
I think I would just phone someone up for this question (visually impaired user).
I'm old fashioned, I might just walk into the library (visually impaired user).
[ Previous Section: Serial & Parallel Steps ] [ Next Section: Usability Questions ]