Category Archives: Search Engines

Forthcoming workshop: Effective online search tools and techniques (Sheffield)

If you want to make Google behave or learn about alternative search tools, I am running a workshop for SINTO next week in Sheffield. It is a one day hands-on workshop to be held at Sheffield Hallam University on Tuseday 1st May (10 am – 4 pm).

This workshop will start with how Google works, important changes that are affecting search results, and how to make use of Google search features to improve and focus your search. It will then move on to other options for general web search and specialist tools for different types of information (for example statistics, social media, research) and subject areas. This workshop is suitable for all levels of experience and the techniques covered can be applied to all subject areas.

Cost: SINTO members £80 + £16 VAT= £96. Non-members £110 + £22 VAT = £132

Feel free to contact me if you require further information about the workshop content.

A booking form is available at http://extra.shu.ac.uk/sinto/Events/events.html or you can contact SINTO on Tel 0114 2255740, email sintoenquiry@shu.ac.uk

Presentation: Search Turns Social – Resistance is Futile

The presentation I gave to CILIP in Hants & Wight yesterday (Search Turns Social – Resistance is Futile) is now available on authorSTREAM at http://www.authorstream.com/Presentation/karenblakeman-1392940-search-turns-social-resistance-futile/

It is also available on Slideshare at http://www.slideshare.net/KarenBlakeman/search-turns-social-resistance-is-futile and temporarily on my web site at http://www.rba.co.uk/as/

Use more than Google

If you need more evidence – other than me telling you! –  that you need more than Google then take a look at The Disruptive Searcher (Sanity checking Google http://disruptivesearcher.wordpress.com/2012/02/27/sanity-checking-google/):

“if I hadn’t searched across more than Google for data on a small, new company that I was asked to research recently, I would have missed out on some very significant information that Google just wasn’t showing me.”

So take a look at Bing (http://www.bing.com/), DuckDuckGo(http://duckduckgo.com/) and Blekko (http://blekko.com/) for starters. The Disruptive Searcher also mentions Dogpile (http://www.dogpile.com/), which combines results from Google, Bing and Yahoo.

And the next Google killer is….Google!

Many of us have been saying for a while that the search engine that will kill Google is Google itself. It has come so close in the past, two of the more recent incidents being the removal of the plus sign from general web search and stopping the ‘ANDing’ of search terms. Prefixing search terms with the plus sign enabled searchers to disable Google’s synonym and variation search so that it carried out an exact match search. It still works in Google Scholar but not in general web search; Google is now using the ‘+’ prefix within Google+ to help users find Google+ business pages, for example +BASF will quickly take you to the BASF business page.  Google redeemed itself to some extent by hastily bringing in the Verbatim option, which can be found in the left hand menu of your results page. This will run your search exactly as you specify it (Google: Verbatim for exact match search http://www.rba.co.uk/wordpress/2011/11/18/google-verbatim-for-exact-match-search/). However, while it works with Google commands such as ‘filetype:’ and ‘site:’ it gives up as soon as you start using some of the options in the left hand menu on the results page, such as date.

And now enter Google+ and Search Plus Your World (SPYW). If you decided to add Google+ to your Google account Google has seriously messed up altered the way it handles your search if you are logged in. It now incorporates and gives priority to results from your Google+ network. (For more details from Google see Search, plus Your World – Inside Search http://insidesearch.blogspot.com/2012/01/search-plus-your-world.html). At present it is only available if you are signed in on Google.com and searching in English. “Search Plus Your World” is now the default and personalizes your results based on both your own behaviour and social connections, and content that has been shared with you through Google+.  Phil Bradley has written an excellent posting on how this works (Why Google Search Plus is a disaster for search http://philbradley.typepad.com/phil_bradleys_weblog/2012/01/why-google-search-plus-is-a-disaster-for-search.htmll).

Initially I was in two minds about SPYW. I thought I might find it useful if I wanted to check what people in my Google circles were saying about a particular issue but then realised that most of them prefer to post on Twitter rather than in Google+ and Google+ does not cover Twitter! The Search+ results include

  • listings from the web
  • pages from the web that have been given priority because of your search behavior
  • pages from the web given priority because of your social connections
  • both public and private (or limited) Google+ posts, photos and Google Picasa photos

When it comes to serious research Search+ includes far too much irrelevant information. So how easy is it to turn it off? If you are logged in when you run your search you will see a message above your results that tells you the number of personal results and “other results” that have been found. There is also a toggle that enables you to switch between personalised and unpersonalised results. You can also switch it off permanently within your search settings.

You can of course just log out of your Google account before you run a search, or never sign up for Google+ in the first place. But Google is making the latter increasingly difficult. Let’s look at the results that might be popping up on your screen and as an example I’ll use a search on Phil Bradley, search and social media expert and President of CILIP. First of all a search on Phil Bradley before Search+ arrived:

On my screen I see pages from his web site, his blog and a Wikipedia entry (which is not the Phil Bradley I am looking for!). When I sign in to a Google account that has Google+ associated with it I see something completely different:

 

Phil’s Google+ profile is given priority above everything else and takes up most of the screen regardless of whether or not it is the most relevant or most up to date (Real-Life Examples Of How Google’s “Search Plus” Pushes Google+ Over Relevancy http://searchengineland.com/examples-google-search-plus-drive-facebook-twitter-crazy-107554).  And don’t think you can escape with a Google account that does not include Google+. Google has ways of enticing you to “upgrade”:

Even worse, if you sign up now for a new Gmail, YouTube or Blogger account you are automatically joined to Google+ (http://searchenginewatch.com/article/2140440/New-Gmail-YouTube-Blogger-Users-Join-Google-by-Default).

Search+ has even tainted the suggestions that pop up as you type in your search:

Phil’s Google+ profile is given prominence and if you click on the link without having an account yourself your are invited to join:

To see what the suggestions should look like a group called Focus on the User (http://www.focusontheuser.org/) has produced a bookmarklet for Chrome, Firefox and Safari and extensions for Chrome and Firefox. This tries – and succeeds most of the time – to display your search results without the intrusion of Google+ results. For my search on Phil his Google+ profile is replaced with Twitter.

When I run a search on my own name my Google+ entry is supplanted by my LinkedIn profile.

“What Google should be” does not, though, remove the extra “content” that Search+ sometimes adds to the right of your results. Run a subject search and you may see “People and Pages on Google+” that are supposedly related to your search terms.

I have not yet found these entries to more relevant than standard search results and the link “Learn how you could appear here too” indicates that Google sees this as another way of persuading people and organisations to join Google+. Switching it off is not easy. It is still there if you are logged out of your Google account. It is still there if you add &pws=0 to the search URL (in fact &pws=0 does not seem to work any more at all for depersonalising results). It does disappear, though, if you use Incognito in Chrome. The intrusion of Google+ is most obvious when running searches with just one or two terms or more consumer biased searches. As soon as you start building more complex searches involving filetype: or site: for example, or research more scientific subjects then Google+ takes a back seat.

Search+ is not all that is affecting how Google presents results. Google is simplifying its privacy policies and combining user data from all of its services (Official Google Blog: Updating our privacy policies and terms of service http://googleblog.blogspot.com/2012/01/updating-our-privacy-policies-and-terms.html). It sounds innocent enough but I’ve already spotted major changes. Google knows I live in Reading because I have told it and I do find that useful when I am carrying out local searches for restaurants, builders etc. Google has now decided, though, to bombard my YouTube home page with videos about Reading.

The videos of the Reading railway station redevelopment are vaguely interesting but I see enough of that in real life on a daily basis when I pass through the centre of town. The football videos are of no interest to me whatsoever. So the crossover of content has already started and I am not looking forward to what Google decides to put in my web search results as a consequence of my YouTube activity!

It is becoming increasingly difficult to make Google behave. Using advanced search commands is one way but many searches do not require them. The best method I have found so far is to use Chrome as your browser and open an incognito window. This depersonalises your results, ignores your web history and existing cookies, and leaves no traces of your search activity. Alternatively, since Google has clearly lost the plot when it comes to search, try another service. The three that I would currently recommend are Bing (http://www.bing.com/), DuckDuckGo (http://duckduckgo.com/) and Blekko (http://blekko.com/).

Google shows postcode boundaries – sort of

Google has started showing UK postcode area boundaries but not in Google maps as one would expect. Using the standard Google search box type in your postcode and at the top of your results Google shows you a map with the boundaries of the postcode area.

Google postcode area boundaries

Although the boundaries are in roughly the right area, they are not accurate. In this example, the coverage of RG4 5BE extends north and south to the top and bottom of Star Road. Others have reported similar discrepancies in their areas. As a general indication of the location of a postcode area it is fine but do not rely on Google to identify which streets or parts of streets are covered by it. Google also gives information on the nearest bus stop, which in this case is correct but not the only option. If you click through to the full sized Google map the boundaries disappear and they do not appear at all if you do the search straight away within Google Maps. You do, though, see more information on the public transport options.

Google Postcode Bus Information

Alternative bus stops are given and the numbered routes listed. I was rather puzzled by the number 74 and 74 A, which  have never seen, but a quick check revealed that it is the “football” bus that runs once a day and only when there is a match at the Madjeski Stadium. The scheduled times for the next buses are as accurate as the bus company timetables provided via Traveline and Transportdirect. I watched three buses arrive and compared it to Google’s schedule: the number 800 was 7 minutes late, the first number 23 was 6 minutes late and the second on time so Google is not using real time data.

Google postcode bus information

Overall, it’s not bad. Just remember that the postcode boundaries are approximate so if you need something more precise use the Royal Mail web site. The bus timetable will not tell you if a bus is delayed or cancelled but if you are contemplating moving to the area it is a quick way of assessing how good (or bad) the local public transport is.

Yahoo Site Explorer closes – try Blekko instead

A reminder that Yahoo Site Explorer is closing down tomorrow (November 21st ) and I assume that the link and linkdomain commands will go with it, although they are not specifically mentioned (http://www.ysearchblog.com/2011/11/18/site-explorer-reminder/). Webmasters are being told to use Bing Webmaster Tools. This enables you to analyse links to your own domains but is no use if you want to find who links to other web sites as part of research. Bing, or Live.com as it then was, removed its link and linkdomain commands in November/December 2007 and Yahoo was left as the only reliable alternative. The link command enabled you to find who linked to a specific page on the web and linkdomain found links to anywhere on a specified web site. Both were useful ways of finding other sites containing similar content and discovering what others were saying about a page. Google’s link command is useless as it picks up a minuscule number of results, which now leaves Blekko (http://blekko.com/) as the only realistic alternative.

Blekko enables you to track down linked pages in two ways but both lead to the same results. The first is to use their slashtags ‘/links’ and ‘/domainlinks’ with a URL or domain name. For example http://www.rba.co.uk/sources/registers.htm /links will find pages that link to my official company registers page whereas http://www.rba.co.uk/ /domainlinks finds all inbound links to my site rba.co.uk.

The second route is via your search results. Below each entry is a downwards pointing arrow. Click on this and select ‘links’ from the pop-up box.

Blekko Lonks

 

You will then see a list of sites that link to that page.

To view inbound links to the whole of the web site click on the seo option below the result and you will see some statistics together with the total number of inbound links.

Blekko SEO

 

Click on the inbound links number and Blekko presents you with a list of domains containing links to yours and how many.

 

Blekko Domain Links

 

To see exactly where the links are located and where they go to on your site just click on the number in the links column.

 

Blekko inbound links

 

I have only looked in detail at a couple of sites but Blekko seems to do a good job and is certainly far superior to Google. The Blekko data on my own site seems to correspond with that available from Bing Webmaster Tools but of course I cannot compare other sites in the same way. My initial thoughts are that for link searching Blekko is definitely worth adding to your research toolkit.

Google: Verbatim for exact match search

Well it looks as though the user feedback to Google on the discontinuation of the +/plus sign for enforcing an exact match search has paid off. Google removed the plus sign as a web search option a few weeks ago and told searchers to use double quotes around terms instead.The double quote marks option does not always force an exact match and increasingly Google is ignoring them and making  some of your search terms optional. (See my blog posting Dear Google, stop messing with my search, http://www.rba.co.uk/wordpress/2011/11/08/dear-google-stop-messing-with-my-search/). The official reason for the change was that hardly anyone used it: the real reason has become clear with Google implementing its Google+ Direct Connect Service. This enables you to go direct to an individual’s or company’s Google+ page by prefixing their name with the plus sign, for example +BASF.

 

For those of us who really do NOT want Google to second guess what we are looking for there is now a Verbatim command. Google’s Inside Search blog (http://insidesearch.blogspot.com/2011/11/search-using-your-terms-verbatim.html) says:

 

 With the verbatim tool on, we’ll use the literal words you entered without making normal improvements such as
  • making automatic spelling corrections
  • personalizing your search by using information such as sites you’ve visited before
  • including synonyms of your search terms (matching “car” when you search [automotive])
  • finding results that match similar terms to those in your query (finding results related to “floral delivery” when you search [flower shops])
  • searching for words with the same stem like “running” when you’ve typed [run]
  • making some of your terms optional, like “circa” in [the scarecrow circa 1963]
So be warned: when using Verbatim you are rejecting Google’s “improvements”!

 

Verbatim can be found in the options on the left hand side of your results page, which means that you have to run your search before you can implement it. Go to the menu to the left of your results and click on ‘More search tools’ at the bottom. This will open up a menu that includes the Verbatim option.
Google Verbatim
It works!. When I run a Verbatim search on St Laurence I get only St Laurence and not St Lawrence as well. And my Heron Island Caversham UK parrot search now finds only those pages that contain all of my terms. There is one drawback in that Verbatim is all or nothing. I often want to have an exact match search on just one or two of my terms but am happy to have Google mess around with the remainder. Verbatim works on your whole search strategy but I think that you can include advanced search commands in your strategy. Running searches such as ‘”Heron Island” Caversham UK ~parrot’ or ‘”Heron Island” Caversham UK parrot OR pigeon’ followed by Verbatim gives me what I would expect. However, more complex searches incorporating filetype: and site: gave me very bizarre results. I need to do more research on this part of the strategy.

 

Overall, I welcome Verbatim and thank Google for listening to its users. However, as Phil Bradley has said it is a tool that “Google should not need to have created” (Google Verbatim tool http://philbradley.typepad.com/phil_bradleys_weblog/2011/11/google-verbatim-tool.html)

DuckDuckGo – silly name but a neat little search tool

Fed up with Google ignoring your search terms and giving you something completely different? Confused by irrelevant tweets and postings in your results? At the recent Internet Librarian International conference in London one of my fellow participants told me that he would not mind Google collecting his search and personal information if it gave him better results but he said that it seems to make them worse. Judging by the comments from some of the other conference goers Google’s attempts at personalisation and semantic search are not always delivering what the searcher needs. There are several steps you can take to try and depersonalise your results but even then Google can still mess up the search. Perhaps it’s time to seek out a different search tool.

Yahoo is now using Bing’s database and search results for web and image search so you might just as well go straight to Microsoft’s Bing (http://www.bing.com/). The trouble is that Bing is starting to behave like Google by messing with your search terms (Bing becomes more like Google and personalises http://www.rba.co.uk/wordpress/2011/10/07/bing-becomes-more-like-google-and-personalises/). So what are the other serious alternatives? DuckDuckGo (http://duckduckgo.com/), also known as DDG, may have a silly name – it certainly put me off from using it for some time – but once you get over that it does have a lot going for it.

It has been around for a while and when it was launched one of its main selling points was that it does not track or share your search and web browsing habits, or try to personalise your results (see https://duckduckgo.com/privacy.html for more information). That’s all very well but how good are the results?

The home page is minimalist as are most search engine’s these days.

 

As soon as you start typing  you’ll notice that there are no suggestions appearing in a drop-down menu below the search box. Some may regard that as a good thing but I do occasionally find them helpful if I am researching an unfamiliar area. In compensation DDG offers “search ideas” on the results page that make up for the absence of suggestions and related search options. The results page is clean and uncluttered with search ideas on the right hand side of the screen. You add one of the “ideas” or terms to your search simply by clicking on it, but you cannot add more than one and the search ideas disappear from subsequent results pages. The only way I can see of adding more than one is to type them into the search box yourself.

 

When you hover over an entry a “more results” link appears that finds more articles from that site and if you look at the results URL you will see that the site: command is used. There is no link to an advanced search screen but there are an incredible number of what DDG calls “Goodies”. The ones that I have found to be most useful are:

  • site: followed by a domain name –  searches for your terms within the specified site
  • inbody:  followed by your search term – looks for your term in the main part of the page
  • intitle: followed by your search term –  looks for your term in the title of  the page
  • filetype: followed by a file extension – looks for specified file formats containing your terms
  • sort:date to sort by date (uses results from Blekko)
  • region: followed by the standard two letter country code e.g. regions:fr to boost pages from France

Then there are the DDG !bang commands (https://duckduckgo.com/bang.html). These automatically take you to other search engines, for example your search terms followed by !images runs an image search on Google and !videos will run a video search on Bing. Details on general syntax, keyboard short cuts and ‘tech goodies’ are at  http://duckduckgo.com/goodies.html  and  http://duckduckgo.com/tech.html. It all looks somewhat daunting but it is worth working your way through them and drawing up your own list of what you think you might use on a regular basis. If you still find it all a bit too much to take in then use the options under the arrow next to the search box at the top of the results page. This brings up a menu of some of the more popular types of searches.

DuckDuckGo Search options

For some searches DDG gives you a red box at the top of the results page containing “zero-click” information extracted from pages and DDG’s Topic Lists for example a possible answer to your question or the result of a conversion/calculation. For a search on Mapledurham watermill it gave me a description and link to Wikipedia along with links to DDG Topics Lists for Grade II* listed buildings in Oxfordshire and museums in Oxfordshire.

DuckDuckGo zero-click info

 

My request to convert euros into pounds came up with a calculation generated by Wolfram Alpha.

DuckDuckGo Wolfram Alpha results

Would I use DuckDuckGo as my default search tool? Difficult to say at this stage. I do miss Google’s time search option but DDG’s sort:date goes some way to offset that, and I regret to say that there are times when I miss Google’s localisation and personalisation. Looking for pubs or restaurants in Reading and Caversham is so much harder in DuckDuckGo. However, I am getting a feel for the type of searches that work well on DDG and for general web searching it is a good alternative to Google and Bing. It does not play around with your search terms, supports advanced search commands and most important of all it delivers relevant results, some of which are not always in Bing or Google.

ILI 2011 web search presentations

The presentations I gave at International Librarian International this week in London are now available on my Advanced Search page at http://www.rba.co.uk/as/. They are also available on authorSTREAM and Slideshare.

Searching without Google

Presentation given as part of the main conference on Friday, 28th October 2011

It is also available on Slideshare at http://www.slideshare.net/KarenBlakeman/searching-without-google

Web Search Academy

This was a pre-conference workshop held on Wednesday26th October with myself, Marydee Ojala and Arthur Weiss presenting.

Alternative Search Tools 

Please note the content of this presentation is similar to that of my main conference presentation “Searching without Google”.

Also available on Slideshare at http://www.slideshare.net/KarenBlakeman/alternative-search-tools

Visual Search

Looks at image search tools, video search engines and visualisations.

The Slideshare version is available at http://www.slideshare.net/KarenBlakeman/visual-search-9892558

Google axes Google Directory and to close Labs

Yesterday I heard that Google had axed Google Directory (Google Kills Google Directory, Says Web Search Is Faster http://www.seroundtable.com/google-directory-gone-13731.html). If you try to access the directory you will see a message telling you that it is no longer available and “We believe that Web Search is the fastest way to find the information you need on the web. If you prefer to browse a directory of the web, visit the Open Directory Project at dmoz.org“.

Google Directory Gone

The directory was not one created by Google but a version of Dmoz.org, The Open Directory Project. I began using Dmoz when it started as an alternative to the Yahoo Directory, which Yahoo had stopped updating. I have not used it for several years, though. The quality of an increasing number of the entries was suspect and the number of dead links unacceptable. I have just revisited Dmoz and the quality seems to have deteriorated even further. It is as tedious as ever to navigate and one often ends up with a list of commercial pages advertising companies and services. I did not have much joy with the search option either (powered by AOL Search). Marketing  pages dominated all of my search results. I will not be mourning the passing of Google Directory.

Google does not seem to have made an official announcement about the directory and in the time honoured fashion has simply dropped the service. It has, though, dropped the bombshell that it is to close down Google Labs. (Official Google Blog: More wood behind fewer arrows http://googleblog.blogspot.com/2011/07/more-wood-behind-fewer-arrows.html). They will carry on with “in-product experimentation channels like Gmail Labs or Maps Labs. We’ll continue to experiment with new features in each of our products“. Android apps will be available on Android Market. There is further comment at “Google Labs To Be Closed As Larry Page’s Product Streamlining Continues” (http://searchengineland.com/google-labs-to-be-closed-86575)

This is something I did not expect at all and I will miss the single point of access to Google’s experiments. Fusion Tables (http://www.google.com/fusiontables/) has already “graduated” but what is to become of experiments such as the Art Project, Google Correlate, Image Swirl and the Public Data Explorer? Google simply says that updates will appear on the Labs website (http://www.googlelabs.com/). The close down emphasises the importance of not become totally reliant on Google search features and services. Get to know the alternatives – they are sometimes better!

I am now wondering what will be next in the firing line.