Category Archives: Search Strategies

Workshop on Advanced Search Strategies, London

Several people have asked me when I am next running my workshop on advanced search strategies (sometimes known as Google and Beyond) in London. The next date for London is Wednesday, 18th February and there are still some places left. The venue is InTuition House, Borough High Street, London SE1 1JX, which is close to Borough tube station and London Bridge. The cost is £150 + VAT (total: £172.50) and includes refreshments and a buffet lunch.

Full details of the workshop together with a booking from are on my web site at http://www.rba.co.uk/training/searching.htm . You can pay by credit card, PayPal or request to be invoiced for the event.

For those of you who live in the Manchester area, I am running a similar event for UKeiG on April 1st. Details are at http://www.ukeig.org.uk/training/2009/April/GoogleandBeyondManchester200904.html

The Research Practioner Skills Day Presentation

Those of you who attended The Research Practitioner Skills Day at Chelsea Football Club on 26th November should have received all of our presentations by email. If not, mine (Using the Web) can be viewed or downloaded from either Slideshare or authorSTREAM.


Uploaded on authorSTREAM by karenblakeman

Allplus search tool

Allplus is yet another search tool that searches Ask, Google, Live and Yahoo in one go. As well as web pages, you can also search the News, Image, Video and Blog databases of the search engines. Moreover is added to the mix for News. In addition to displaying the results for your selected type of information, it  gives you items from the other resources on the right hand side of the page.  On the left hand side of the screen, it organises your results into a ‘cluster tree’ and you can also view a ‘cluster graph’.  Clicking on the topic in the tree or graph brings the pages in that cluster to the top of the results list and is a useful way of focussing your search.

Allplus

Top Search Tips

I ran another advanced search workshop (Google and Beyond) for UKeiG on June 11th, this time in London. Twenty people attended the event and came up with the following list of top search tips at the end of the day.

1. Use the Advanced Search screen. There are lots of goodies to be found on the advanced search screens: options for focussing your search by file format (e.g. xls for data and statistics, ppt for expert presentations, pdf for industry or government reports); site and domain search to limit your search to just one web site or a type of organisation (e.g. UK government, US academic); and in Google there is a numeric range search.

2. Google Custom Search Engines (Google CSE) at http://www.google.com/coop/cse/. This made its first appearance in the Top Tips from the Liverpool workshop earlier this year. Ideal for building collections of sites that you regularly search, to create a searchable subject list, or to offer your users a more focused search option.

3. See what Google does with your search string.

a) If you use the default search box and Google comes back with odd results, click on Advanced Search to see what it has done with your search terms.

b) If you use the Advanced Search screen and fill in the boxes, see how Google formats the search strategy by looking the search box at the top of the results page. By learning the commands and prefixes you can build more specific searches more quickly on the default search page.

4. Cached copies. Look at the search engines cached copy of a web page if you can’t find your search terms in the document or if the page is nothing like the description in the results list. You will see the version of the page that has been used by the search engine for indexing and with your terms highlighted.

5. Use tools such as Intelways and Zuula for quick and easy access to a wide range of search tools covering different types of information. Enter your search once, click on the tab for the type of resource for which you are searching (video, images, reference, news etc.), and then work your way through the list of search engines.

6. Alacrawiki. The Alacra Spotlights section is a good starting point for evaluated sites and information on industry sectors. It is also a good example of what to look for when assessing the quality of a wiki and how easy it is for anyone to edit the pages. In the Spotlights sections there is no edit option , not even if you register for an account and login. Only the Alacra editors can edit the pages.

7. Open access journals. Google Scholar sometimes leads you to copies of journal articles in institutional repositories and open access journals, but there are also directories of open access journals. For example: http://www.doaj.org/ , http://www.wsis-si.org/oa-journals.html, http://www.abc.chemistry.bsu.by/current/fulltext.htm . This is not my area of expertise so comments on other directories are welcome.

8. Social bookmarking sites. Try social bookmarking sites, not only for creating your evaluated lists of sites but for searching other peoples. For example FURL, Del.icio.us, Connotea, 2Collab . Connotea (owned by the Nature Publishing Group) and 2Collab (owned by Elsevier) are aimed at researchers and scientists.

9. Search results visualisation. Try out some of the newer search tools that present results and search options in a different way. For example Cluuz, Kartoo, Kvisu, Quintura. [Some of the participants specifically mentioned Cluuz and Kvisu].

10. The Internet Archive (Wayback Machine) at http://www.archive.org/ for pages, sites and documents that have disappeared. Ideal for tracking down lost documents, seeing how organisations presented themselves on the Web in the past, and for collecting evidence for a legal case (e.g. ‘passing off’, copyright infringement).

Top Search Tips – May 2008, Liverpool

UKeiG’s recent Liverpool Internet search workshop was filled to capacity. It was a packed day with a significant amount of new content and plenty of time for participants to try out the tools and techniques for themselves. At the end of the day they were asked to compile a list of their top tips. There were the usual suspects but the Google Custom Search Engine was new. It is the first time that we have covered Google CSE in the workshop and it generated so much interest that UKeiG will be producing a fact sheet on it. The full list of top tips is as follows:

1. Use the ‘site:’ command to search individual web sites that have appalling navigation and useless site search engines.

2. Search for file formats to narrow down and focus your search. For example search for Word documents or PDFs if you are looking for government or industry reports; xls for data and statistics; ppt or pdf for presentations.

3. Try something else other than Google. Have one Google free day or hour a week. Change the home page in your browser if it is set to Google.

4. Use the OR command in combination with the site: command to search more than one site or type of site. For example,

"carbon emissions trading" filetype:ppt site:ac.uk OR site:gov.uk

5. Don’t believe all you see, especially when it comes to people searches and mashups. [Mashups combine information from several different sources to produce a single new resource.]

6. If the information is critical, always cross and double check the accuracy of the information with independent sources.

7. Books are still relevant. For example, if you are new to a subject or industry sector try and find an introductory text that can help you with the terminology. They are also excellent for historical information. As well as Amazon, try Google Books (http://www.google.com/books/) for older texts, and Live Books (http://search.live.com/books/).

8. Use services such as Zuula or Intelways to remind you of the different types of information that are available and their appropriate search engines. Type in your search once and click on the search tools one by one.

9. Build your own Google Custom Search Engine for collections of sites that you regularly search, to create a searchable subject list, or to offer your users a customised, more focused search option.

10. Try good old fashioned Boolean. Yahoo, Exalead and Live support AND, OR, NOT and ‘nested’ searches, but don’t go overboard. Remember to type in the operators as capital letters. otherwise the search engines will ignore them as stop words.

11. Make use of proximity searching.

a) Double quote marks around your search terms to force a phrase search works in all of teh search engines. For example

"carbon emissions trading"

b) In Google, use the asterisk (*) to find your terms separated by one or more terms but close to one another. There is no information in the help files on the maximum separation. Increasing the number of asterisks is not supposed to make a difference but it does and it appears that one asterisk stands in for one word.

c) The Exalead NEAR command finds words within a maximum of 16 terms within each other. You can control the degree of separation by using NEAR/n where ‘n’ is a number specified by you. For example

climate NEAR/3 change

12. Try social bookmarking services to track down other people’s research lists on a subject. For example del.icio.us, Furl, Connotea, Citulike,

13. If you are looking for formatted files search Yahoo as well as Google. One participant tested several searches on both and found that Yahoo consistently came up with more. This could be due to different coverage of the two services but is more likely to be down to the fact that Google indexes the first 100K of a document but Yahoo indexes 500K. [Karen Blakeman comments: also search in Live.com. I recently found two unique documents via Live.com that contained vital information on a company that I was researching].

14. The Internet Archive (Wayback Machine) at http://www.archive.org/ for pages, sites and documents that have disappeared. Ideal for tracking down lost documents, seeing how organisations presented themselves on the Web in the past, and for collecting evidence for a legal case.

15. Partially Answer your question in your search strategy. For example

"A hippopotamus can run at"

Top Business Research Tips (2)

Yes, it’s another Business Information workshop Top Tips. This one was a rerun of the UKeiG event held on 2nd April, 2008. The participant mix was half private, half public sector. At the end of the day they were asked to come with a list of top sites and search tips. Between them, those attending the workshop spent half the day trying out hundreds of web sites – some of them not even mentioned by me. This is their collective list of sites that they felt were worth considering as key resources. In some cases I have also included the comments from the people nominating the site. It is interesting that there are only two sources that appear in both lists, and one of them does not really count: it was my own site, from which some of the course notes were derived so you might consider the delegates to have been brainwashed!

1. Silobreaker.com http://www.silobreaker.com/. One of the two sites that appears in both the April 2nd and this list. A relatively new service pulling together information from newspapers, journals, blogs, video and audio. In addition It offers geographical hotspots, trends and a network visualisation tool that was singled out by several workshop participants as being particularly useful.

2. OFFSTATS http://www.offstats.auckland.ac.nz/ The new set of web pages for the University of Auckland Library providing information on Official Statistics on the Web and at a new address. An excellent starting point for official statistics by country and subject/industry. As well as the makeover, there have been many additions to the collection of resources.

3. Research Wikis http://www.researchwikis.com/. This is a wiki covering market and industry data that is in the public domain; several workshop delegates commented that it looks promising. The content is variable in quality. Some reports are highly structured and detailed while others are just a “stub”, many are US biased, and the sources of the data are not always cited. Nevertheless, the reports do give you an idea of the issues affecting the sector and the terminology that is used. One of the University based delegates thought that the site’s recommended structure and headings for a report would be useful to students who are new to carrying out industry and market research.

4. Bureau van Dijk’s (BvD) “A Taste of Mint” http://mintportal.bvdep.com/ A free directory from BvD giving basic information on companies world-wide. Comment from one experienced researcher: “It found the company I have been looking for when every other directory has failed!”

5. Google Finance http://www.google.co.uk/finance/, http://www.google.com/finance/ [This was not covered in the 2nd April workshop. Until now, it has been so awful and unreliable hat I have ignored it]. This is a possible competitor to Yahoo Finance. It has been steadily improving over the last 18 months since its initial launch but still does not quite have the authoritative “feel” of Yahoo Finance. Also it does not appear to have the individual stock exchange coverage of Yahoo. It does, though, beat Yahoo when it comes to the share price graph and historical downloads options. The share price graphs are ‘annotated’ with labels at the appropriate time on the graph and these link to news articles that are listed to the right of the graph. Yahoo Finance’s downloadable historical share price data in figures goes back 5 years: Google’s goes back to 1996.

6. Google News. For the UK go to http://news.google.co.uk/ but there are a plethora of country versions. Good coverage of the last 30 days of free world-wide, national, local and industry news resources. One workshop participant said that Google News found a breaking story that the industry press and her subscription services had not yet picked up.

7. The Wayback Machine – The Internet Archive http://www.archive.org/. The Wayback Machine takes periodic snapshots of the Internet. Ideal for seeing how a company portrayed itself on the Internet in the past and for tracking down sites, pages or documents that have disappeared.

8. Chipwrapper http://www.chipwrapper.co.uk/ a Custom Google Search Engine that searches across the UK’s major national newspapers: The Daily Express, Daily Mail, Daily Mirror, Financial Times, The Guardian, The Independent, The Sun, The People, News of the World, The Scotsman, Daily Star, The Telegraph and The Times. It also searches the BBC News web site, ITN and Sky. There is a review of Chipwrapper on my blog at http://www.rba.co.uk/wordpress/2007/12/29/chipwrapper-search-uk-newspapers/

9. UK National Statistics http://www.statistics.gov.uk/ We will not go into the confusion users suffered when UK government official statistics web sites were re-organised on 1st April 2008 [No, it was not an April Fool’s]. Work your way through the new menus and you will eventually end up on the on the old statistics.gov.uk pages. Even without the frequent design changes, the site can be difficult to navigate. Nevertheless, there is an incredible amount of good quality data here. For the web based ‘stuff’ and formatted documents (PDF. DOC, XLS, PPT) it is often easier to go to the Google Advanced Search page, type in your terms in the search box at the top of the page and in the ‘Search within a site or domain’ box type in statistics.gov.uk . If you want to look for specific file formats, select the file extension from the drop down menu under ‘File type’. The ‘Time Series’ data have to be search from within the statistics.gov.uk site itself.

10. Companies House http://www.companieshouse.gov.uk/. The UK official companies registry. This is the closest you can get to the original company documents that a registered company has to file. Some information is provided free of charge (Use the Webcheck service). Documents are charged for on a pay as you go basis.

11. RBA Sources of Business Information http://www.rba.co.uk/sources/. Selected sources of business information organised by type e.g. statistics, share prices, company registers.

Top 10 Search Tips from Edinburgh – March 2008

CILIPS organised an advanced search workshop in Edinburgh, which I led. The participants were from a variety of types of organisation including academic, publishers, public sector, health and commercial. At the end of the workshop they compiled a group Top 10 Search Tips. This is their list:

  1. Yahoo! Finance – http://finance.yahoo.co.uk/ for the UK version. Yahoo! Finance gives an overview of quoted companies on the major stock exchanges around the world. Information includes current share price information, downloadable historical share price figures, charts, recent news, company profiles and director dealings.
  2. Make use of the file format search available in Google, Yahoo, Live and Exalead (but not Ask). Use the advanced search screens, the filetype: command in Google, Exalead and Live, or originurlextension: in Yahoo. For example filetype:ppt . Search for ppt or pdf when looking for presentations; PDF for government, official and industry/market reports; xls for spreadsheets containing statistical data; and rss or xml to locate RSS feeds.
  3. Looking for papers by an academic? Find out where they currently work, or have worked in the past, and conduct a site search to see if any of their articles are in an institutional repository.
  4. People are an invaluable source of information and help. Join discussion lists to tap into their knowledge, for example JISCmail at http://www.jiscmail.ac.uk/ has a wide selection of lists covering many different topics.
  5. Use the site or domain search to look for difficult to find information on a particular web site, or to limit your search to types of organisation for example gov.uk for UK government or ac.uk for UK academic pages. Use the advanced search screens of the search engines or the site: command for example site:statistics.gov.uk car ownership.
  6. Make more use of the advanced search screen options including intitle, inurl and search engine specific features. For example Google’s numeric range search and Exalead’s phonetic and approximate spelling options.
  7. Combine commands in the main search box for more complex search strategies, for example: carbon emissions trading ~forecasts site:gov.uk 2012..2015 filetype:xls OR filetype:pdf
  8. Use the link commands to find pages that link to a known page or web site. This usually helps you find pages of similar content and type. Live.com’s link commands have been de-activated but Yahoo’s still work. To find pages that link to a specific page on a site use link: followed by the full URL of the page, for example link:http://www.rba.co.uk/sources/stats.htm . To find pages that link to anywhere on a site use linkdomain: followed by the domain, for example linkdomain:rba.co.uk. Live.com’s linkfromdomain command, which is still working, lists all the external links on a site, for examle linkfromdomain:rba.co.uk
  9. View the search engines’ cached copies of pages to highlight and locate your search terms in long documents.
  10. Try the Wayback Machine at http://www.archive.org/ for lost pages, documents or sites.