Tales from the Terminal Room

May 2003, Issue No. 43

Home About RBA Business Resources Search Strategies for the Internet Tales from the Terminal Room Training Contact Us

Please Note: This is an archive copy of the newsletter. The information and links that it contains are not updated.


Archives

 


 

Creative Commons License.

Tales from the Terminal Room ISSN 1467-338X
May 2003, Issue No. 43
Editor: Karen Blakeman
Published by: RBA Information Services

Tales from the Terminal Room (TFTTR) is a monthly newsletter, with the exception of July and August, which are published as a single issue. TFTTR includes reviews and comparisons of information sources and search tools; updates to the RBA Web site Business Sources and other useful resources; dealing with technical and access problems on the Net; and news of RBA's training courses and publications.


In this issue:

  • News on the Web Compared
  • KillerInfo
  • Information Resources
    • Google News Launches Country News Services
    • Faust Information - National, International Directories and Mailing Lists
  • Gizmo of the Month
    • Web2Text - HTML to plain text converter
  • Meetings and Workshops
    • Advanced Internet Search Strategies (Manchester Business School) 11th June 2003

News on the Web Compared

Introduction

With so many online newspapers starting to charge for content and search engines providing free current news from across the world, keeping up with what is available and at what price has become increasingly difficult. This review looks at what some of the "content aggregators" and the individual publishers are offering. The selection is a personal one and UK biased. My apologies if I have omitted your favourite newspaper but there is not enough space to do them all justice.

I have concentrated on 8 UK based news sources (BBC, Evening Standard, The Financial Times, Guardian, Independent, Telegraph, Times and the Scotsman). I also looked at some of the content aggregators both free and priced (AlltheWeb, Google News, LexisNexis Europe, Newsbase BBC World Monitoring, NewsNow, Yahoo! News, Worldchambers - Dialog). In all cases, I was interested in the free and pay-as-you-go options.

The criteria for comparison were:

  • coverage/sources
  • time span
  • search options
  • sort options availability of alerts
  • cost

Summary and Conclusions

Rather than bore you with all the details at the start of this review, I have cut straight to the summary and conclusions. Details for each of the services are towards the end of this survey. There is no overall best service so I have assessed the usefulness of the services in providing current news, alerts, free archives and priced archives.

Current News

If you are looking for searchable current news, then there are plenty of free options.

The most comprehensive free current news service is Google (http://news.google.com/). It has over 4,500 news sources, worldwide coverage and now has some country specific news sites including one for the UK. The only one of my UK news sources not covered by Google is the Evening Standard. The last 30 days of news are covered but you will not be able to access articles covered by subscriptions, for example Financial Times stories older than 3 days. These are clearly marked in the results list as such. The default is to sort by relevance and there is an automated grouping process that pulls together related headlines under one entry. The search options are limited (keyword searching of full text only) but that is not generally an issue as results are, on the whole, highly relevant.

AlltheWeb (FAST)(http://www.alltheweb.com/), which predates Google in providing a news service, has failed to keep up in terms of coverage and time span (7 days) but it does have some interesting local and regional content. There are also advanced search features that I would have expected Google to support.

NewsNow (http://www.newsnow.co.uk/) currently has 9527 sources and goes back one month. NewsNow is fine for browsing headlines but the free search only supports a single term search of the headlines. To get the most out of this service, including more flexible searching, alerts and news feeds, you need to subscribe. (There are no prices on the Web site.)

The BBC (http://www.bbc.co.uk/news/) is a very popular current news service with links to related BBC news stories and relevant third party sites. (Articles go back to 1997 but you may find that some of the internal and external links no longer work with the older articles.)

Yahoo! News UK (http://www.yahoo.co.uk/) has 7-10 days of searchable current news.

If you have a favourite newspaper, most of them offer at least a few days free content:

  • Evening Standard - mid 2000 to date
  • Financial Times - last 3 days.
  • Guardian - September 1 1998 to date
  • Independent - last 7 days
  • Telegraph - April 1996 to date
  • Times - last 7 days
  • Scotsman - January 2002 to date

Alerts

Current awareness and alerting services come in a variety of forms and levels of customisation:

  • Newsbase BBC World Monitoring - 5 free alerts, totally customisable. You are notified when the database has new articles but have to run your search on the database yourself. Articles are charged for on a pay-as-you-go basis.
  • NewsNow - part of the subscription service.
  • Financial Times - part of the Level 2 subscription service, totally customisable.
  • Independent - free, predefined bulletins. No customisation.
  • Telegraph - free, predefined bulletins. No customisation.
  • Scotsman - 3 free, predefined bulletins. No customisation.
  • Times Online - free, predefined bulletins. No customisation.

Free Archive News

For the coverage of free "archive" news, I looked for stories that are older than 3 months. Starting with the most comprehensive archive, the findings were:

  • Telegraph - April 1996
  • BBC - 1997
  • Guardian - September 1998
  • Evening Standard - mid 2000
  • The Scotsman - January 2002

Priced Archive News

The clear winner here was LexisNexis by credit card (http://www.lexis-nexis.co.uk/). It has a time span of 20 years and covers over 5000 sources, including all of the newspapers covered by this review. There is even a separate option for searching the FT and Global News Wire. As well as a general news search, there are options for searching for news on companies, people, products and within industry sectors. You do have to be very specific, though, in your search: if your results exceed 1000 you are told to refine your search further.

Be careful how you structure your strategy. LexisNexis automatically treats your search terms as a complete phrase so, for example, richard branson balloons will be searched as Richard immediately followed by branson immediately followed by balloons. You need to use Boolean operators such as 'and' 'or' in your search strategy (details of this are in a help file on the LexisNexis Web site).

Articles cost US$ 2.50 each and payment is by credit card.

If you are more interested in the emerging markets, the BBC World Monitoring Service is an excellent starting point and available as a pay as you go option at http://www.newsbaseworldmonitoring.com/. This service covers 3000 sources from 150 countries and includes newspapers, press releases, TV and radio broadcasts. Foreign language reports are translated into English without any interpretation or "spin". As with LexisNexis you must use Boolean 'and', 'or', otherwise your terms are treated as an exact phrase. BBC World Monitoring is covered by LexisNexis but articles from the Newsbase service are generally cheaper and start at an average of 6-7 pence each.

Service Details

Content Aggregators

(The news source codes referred to under "Coverage" are: BB=BBC News, ES=Evening Standard, FT=Financial Times, GU=The Guardian, ID=The Independent, TE=The Telegraph, TI=The Times Online, SC=The Scotsman)

Service: AlltheWeb
URL: http://www.alltheweb.com/
Coverage: "Thousands" of news sources. Includes GU, SC, some BB. Good selection of UK regional Web based news sources.
Time span: 7 days
Search options: Keyword searching of the full text. Advanced search options enable you to select type of news source (International, finance, local, business, technology, entertainment); include or exclude results from specific domains; and pages indexed within the last 2, 6, 12, 24 hours, 2 days and last week.
Sort options: Defaults to relevance but can be changed to sort by date.
Alerts: No
Costs: Free

Service: Google News
URL: http://news.google.com/
Coverage: 4,500 news sources worldwide. Includes FT, TI, GU, ID, TE, TI, SC, BB.
Time span: 30 days
Search options: Keyword searching of the full text.
Sort options: Defaults to sorting by relevance. Can be changed to "sort by date". The automated grouping process that pulls together related headlines under one entry only applies under "sort by relevance".
Alerts: None
Costs: Free
Additional Comments: Country versions available for Australia, Canada, India, New Zealand, UK and the US.

Service: LexisNexis Europe
URL: http://www.lexis-nexis.co.uk/ (click on LexisNexis by credit card)
Coverage: 5,000 sources. Includes FT, ES, GU, ID, TE, TI, SC
Time span: 20 years
Search options: Automatically treats your search terms as a complete phrase. Use Boolean 'and' 'or' in your search strategy. Can select sources by region and language. Also limit options to "major stories only" and by date. As well as a general news search, there are options for searching for news on companies, people, products and within industry sectors.
Sort options: By date
Alerts: No
Costs: US$ 2.50 per article
Additional Comments: Free registration required - password must be periodically changed. Useful option for searching just UK or European newspapers. If your search returns more than 1000 results you are prompted to modify your search.

Service: NewsBase - BBC Monitoring
URL: http://www.newsbaseworldmonitoring.com/
Coverage: 3000 sources from 150 countries, including newspapers, press releases, TV and radio broadcasts.
Time span: ?
Search options: Keyword searching of full text combined with date. Must use Boolean 'and', 'or', otherwise your terms are treated as an exact phrase.
Sort options: By date
Alerts: Yes - limited to 5. These are free and you are sent an email telling you when there are new articles that meet your search criteria.
Costs: Searching is free. Average article costs start at 6-7 pence and are added to your account. You pay once your account has reached a pre-set "trigger level" (default is £10).
Additional Comments: Foreign language reports are translated into English without any interpretation or "spin". Particularly strong in sources from the emerging markets.

Service: NewsNow
URL: http://www.newsnow.co.uk/
Coverage: 9527 sources heavily UK/Europe biased. Includes ES, GU, ID, TE, TI, SC,BB
Time span: 1 month
Search options: Free service allows you to search the headlines for a single term only. Phrase and full text searching available as part of the subscription service
Sort options: By date
Alerts: Yes, as part of the subscription service
Costs: Basic single keyword search of headlines is free. Access to the full service is priced (no prices available on the Web site). 2 week free trial available.

Service: Yahoo! News UK
URL: http://www.yahoo.co.uk/ - click on the News link
Coverage: Coverage varies depending on the country version of Yahoo and section that is used. For the UK and Ireland version, the main sources are currently Reuters, AFP, SkyNews and The Scotsman.
Time span: 7-10 days
Search options: Keyword search of the full text
Sort options: By date
Alerts: No
Costs: Free

Service: Worldchambers - Dialog
URL: http://www.worldchambers.com/
Coverage: Selected news files from Dialog (http://www.dialog.com/)
Time span: ?
Search options: Keyword search title or full text. Also search on company name, industry, country, date.
Sort options: By date
Alerts: No.
Costs: Searching is free. Prices for displaying/printing articles vary from US$ 2.90 to US$ 4.70 per article.
Additional Comments: Extremely slow and erratic service. Sometimes does not work at all.

Individual News Sources

Service: BBC News
URL: http://www.bbc.co.uk/news/
Coverage: Current news from the BBC
Time span: 1997 to date
Search options: Keyword search of the full text. Advanced search allows you to keyword search, limit by topic and date.
Sort options: By date. Advanced search has sort options for either relevance or date.
Alerts: No
Costs: Free
Additional Comments: Sometimes provides links to related stories and/or relevant 3rd party Web sites. (Note: these links may no longer work with older stories).

Service: Evening Standard (London)
URL: http://www.thisislondon.co.uk/
Coverage: Includes news stories from all sections of the London Evening Standard, including the Business section.
Time span: Mid 2000 to date.
Search options: Keyword search, limit by newspaper section, and date (last 24 hours, 7 days, last month, anytime).
Sort options: By relevance.
Alerts: No.
Costs: Free

Service: Financial Times
URL: http://www.ft.com/
Coverage: Financial Times
Time span: Some of the last three days' articles are free. Archives going back to 5 years available on subscription only.
Search options: Keyword search full text. Can modify search results by searching in the headline, article, company name, by journalist and limit by date. "Power Search" available to subscribers only.
Sort options: By date
Alerts: Yes. As part of the Level 2 subscription service.
Costs: Some of the last three days' articles are free. Level 1 subscription costs £70/year. Level 2 subscription costs £195/year.
Additional Comments: Global archive of 500 sources other than the FT available to Level 2 subscribers.

Service: Guardian Unlimited
URL: http://www.guardian.co.uk/
Coverage: The Guardian and The Observer
Time span: September 1998 to date
Search options: Keyword search of the full text. "Archive search" enables you to limit your search by date.
Sort options: By date. Under "Archive search" you can choose to sort by relevance or by date.
Alerts: No
Costs: Free.

Service: The Independent
URL: http://www.independent.co.uk/
Coverage: The Independent and Independent on Sunday.
Time span: September 1999 to date. Some of the last 7 days' articles are free.
Search options: Keyword search of full text. "Search again" that appears with the results list allows you to limit your search by newspaper section and date.
Sort options: By date.
Alerts: Yes. Top stories from the UK, around the world, sport and business delivered before 8am UK time by email. Free.
Costs: Some of the last 7 days' articles are free. The priced "Independent Portfolio" covers all articles by regular columnists and commentators, leading articles from The Independent and Independent on Sunday, all articles by Middle East Correspondent Robert Fisk, all articles more than seven days old in the news and sport channels, Cryptic Crossword and the six-month archive of crosswords. Rates are £1/item pay as you go access for 24 hours; £5 monthly subscription per section (first trial month free); £30 annual subscription per section; £60 annual subscription to all Portfolio content.
Additional Comments: Payment has to be made using a BT Click&Buy account.

Service: The Scotsman
URL: http://www.scotsman.co.uk/
Coverage: The Scotsman, Scotland on Sunday
Time span: January 2002 to date.
Search options: Keyword search full text.
Sort options: By relevance.
Alerts: Yes. Three email bulletins available: top stories, sport and business.
Costs: Free.

Service: The Telegraph
URL: http://www.telegraph.co.uk/
Coverage: The Telegraph and Sunday Telegraph
Time span: April 1996 to date
Search options: Keyword search the full text. An advanced search, which appears with your results list, enables you to search the text, writer's name or headlines. You can also limit your search by date and newspaper section, and choose to sort by relevance or date.
Sort options: Default is to sort by date. An advanced search, which appears at the bottom of your results list, gives you the option to sort by relevance.
Alerts: Yes. A range of email bulletins are available: sport, travel, personal finance, city news, reader offers, motoring, expat, arts, gardening checklist, small business. Free of charge.
Costs: Free. (Crossword Society is subscription only)
Additional Comments: The first UK newspaper to take the Web really seriously and provide free access to their content. Links to related news stories and relevant external sites. Matt and Alex cartoons available.

Service: Times Online
URL: http://www.timesonline.co.uk/
Coverage: The Times and The Sunday Times
Time span: Last 7 days free of charge. Priced text archive going back to 1995.
Search options: Keyword search full text.
Sort options: By relevance.
Alerts: Yes. Email news bulletins including personal finance, "Breakfast News", films, travel, arts, gardening, shopping, books, "Pick of the Month". Free of charge.
Costs: Vary from £1 per article down to 10p per article (bulk user 20000 downloads). Minimum payment £10.


KillerInfo

KillerInfo (http://www.killerinfo.com/) is a relatively new meta search tool. (A meta search tool takes your query and runs it across several search engines at once.) Meta search tools are nothing new but this one has some useful features and, on the whole, comes back with relevant results.

Every search automatically generates a "Search Result Guide" that is displayed to the right of the Web site listings. This acts as a "Table of Contents" and clusters the results by topic and Web site, making it easier to find relevant pages. In addition, the Quick Peek link to the right of every site in the results opens up a preview of the page below the listing title. Rather than having to open and close new browser windows to look at a page you can quickly preview multiple sites "in-line". For some reason, though, the Quick Preview link does not display in Mozilla and some Netscape browsers, so this feature is only available to Explorer and Opera users.

KillerInfo claims to access more than 13,000 sites, including databases that are usually missed by other tools. These are divided into "channels" such as "Web", Business, Research, Health, Science and Government. Apart from the Web channel, which is International in coverage, these are either heavily or totally US biased. There are, though, links to some country specific search tools.

Is it in any good? Having tried out a number of test searches I have found that it does appear to come up with relevant results most of time. The clustering is a big plus, but you may find with some searches that "sponsored links" - paid for placements - appear at the top of the results list. I doubt that it will replace Google as the number one search tool, but it comes a close second and is worth considering when Google fails.


Information Resources

News http://www.rba.co.uk/sources/news.htm

Google Launches Country News Services
http://news.google.com/

Google has launched country versions of its popular news service. As well as news tailored for Australia, Canada, India, New Zealand and the US there is also one for the UK (http://news.google.co.uk/)

The search and display features are the same as news.google.com but the stories that are automatically shown when you log on are biased towards the country that it is serving.

Company Directories (http://www.rba.co.uk/sources/directs.htm)

Faust Information - National, International Directories and Mailing Lists
http://www.faust-information.com/

Faust is a distributor of international address data CD ROMs, phonebooks and Yellow Pages. Products include residential listings, business (yellow) pages, mailing lists, listings by country and importers. Importers products include the well known International Importers Directory, and industry listings ranging from the agricultural sector to woodworking equipment. Prices vary depending on the level of detail and type of directory.

There is no free information available on this Web site. If, though, you are trying to track down products for mailing applications or company information, particularly in more obscure industries and by country, this is a good place to start.


Gizmo of the Month

Web2Text - HTML to plain text converter

http://www.jetman.dircon.co.uk/software/web2text.html

If you ever need to convert a Web page or HTML document to plain text, try Web2Text. Yes, Microsoft Office and Internet Explorer have options for doing exactly this, but both have a nasty habit of mangling the layout of the original document.

Web2Text is a freeware tool that does what it says on the tin. Much of the structure of the HTML document can be retained after the conversion, for example paragraphs, header emphasis, URLs and you can mark italicised words with an * and bold with an underscore. (Both italics and bold markers can be customised).

An excellent and very useful program - what more can one say?


Meetings & Workshops

Workshop: Advanced Internet Search Strategies
Organiser: Manchester Business School
Course leader: Karen Blakeman
Venue: Manchester Business School
Date: Wednesday, 11th June 2003
URL: http://www.mbs.ac.uk/corporate/bis/html/training.cfm
Cost: GBP 250 + VAT; GBP 215 + VAT (BINN/MBS Members)


TFTTR Contact Information

Karen Blakeman, RBA Information Services
UK Tel: 0118 947 2256, Int. Tel: +44 118 947 2256
UK Fax: 020 8020 0253, Int. Fax: +44 20 8020 0253
Address: 88 Star Road, Caversham, Berks RG4 5BE, UK

Archives

TFTTR archives: http://www.rba.co.uk/tfttr/archives/index.shtml

Subscribe and Unsubscribe

To subscribe to the newsletter fill in the online registration form at http://www.rba.co.uk/tfttr/index.shtml

To unsubscribe, use the registration form at http://www.rba.co.uk/tfttr/index.shtml and check the unsubscribe radio button.


Privacy Statement

Subscribers' details are used only to enable distribution of the newsletter Tales from the Terminal Room. The subscriber list is not used for any other purpose, nor will it be disclosed by RBA or made available in any form to any other individual, organisation or company.


Creative Commons License
This work is licensed under a Creative Commons Attribution 2.5 License.

You are free:
  • to Share - to copy, distribute, display, and perform the work
  • to Remix - to make derivative works
Under the following conditions:
  • Attribution. You must attribute the work to Karen Blakeman, and cite Tales from the Terminal Room as the source and include the year and month of publication.
  • For any reuse or distribution, you must make clear to others the license terms of this work.
  • Any of these conditions can be waived if you get permission from the copyright holder.

This page was last updated on 2nd June 2003  2003