Category Archives: Google

Google shows missing search terms

Several weeks ago I noticed that Google was displaying the terms it had dropped from your search as ‘Missing’. Google started routinely ignoring selected search terms towards the end of 2011 (see http://www.rba.co.uk/wordpress/2011/11/08/dear-google-stop-messing-with-my-search/). Google’s response to the outcry from searchers was to introduce the Verbatim search option. However, there was no way of checking whether all of your terms appeared in a result other than viewing the whole page. Irritating, to say the least, if you found that the top 10 results did not include all of your keywords.

Fast forward to December 2013, and some people started seeing results lists that showed missing keywords as strikethroughs. I saw them for a few days and then, just as I was preparing a blog posting on the feature, they disappeared! I assumed that they were one of Google’s live experiments never to be seen again but it seems they are back. Two people contacted me today to say that they are seeing strikethroughs on missing terms. I ran my test searches again and, yes, I’m seeing them as well.

I ran the original search that prompted my November 2011 article (parrots heron island Caversham UK) and included -site:rba.co.uk in the strategy to exclude my original blog postings. Sure enough, the first two results were missing parrots and had “Missing parrots” underneath their entry in the list.

Google Missing Terms Shown as Strikethroughs

Remember, though, that Google automatically looks for variations on your search terms. Your original keyword may not be present in the results but a synonym may be, for example birds instead of parrots. I did find one entry in the top 10 results that seemed out of place. It was an article in the local newspaper. There was no ‘Missing….’ underneath the result but I could not find synonyms of parrots anywhere in the story. The closest was the surname of a person mentioned in the article – Parry – and I can only assume that this was Google truncating my ‘parrots’ keyword and looking for variations. But Parry was not highlighted in the entry in the results list as synonyms are. I shall look at the article in more detail to check that I have not missed a lurking parakeet or cockatoo!

Google-Missing-Terms-2

I need to carry out more test searches to see how reliable this new feature is but, nevertheless, it is a welcome and useful addition to Google. If your top 10 results are showing strikethroughs then you know you have to either prefix the missing term with ‘intext:’ or use Verbatim for the whole search.

Google workshop – top tips

Last week’s workshop on Google had a wonderful mix of participants from the academic, government, public, NHS and legal sectors. And true to form, Google decided to change a few things on the day. The link to the Google News advanced search completely disappeared (it wasn’t that good anyway!) but now seems to have reappeared. The search options that appear at the top of the results pages had changed compared with screen shots that I had taken 2 days previously; they options now seem to change according to the type of query so we suspect that this is an example of Hummingbird (Google’s new algorithm). The Google custom search engine interface has changed yet again and presented challenges to even those of us who are regular users. And then there was the new Google log-out/log-in interface which had us all flummoxed until the end of the day. (That merits a separate blog rant).

In the time honoured tradition, at the end of the day the group was asked to come up with their top 10 tips for searching Google. Here is what they came up with.

  1. Verbatim Several people shouted out this one as the number 1 tip for searching Google. Google automatically looks for variations on your search terms and sometimes drops terms from your search without telling or asking you. To make Google run your search exactly as you have typed it in, first run your search. Then click on ‘Search tools’ in the menu above your results, in the second line of options that appears click on ‘All results’ and from the drop down menu select Verbatim.
  2. site: command Use the site: command to focus your search on particular types of site, for example site:ac.uk, or to search inside a large rambling site. You can also use -site: to exclude sites from your search.
  3. Advanced search commands and search options Learn how to use the search commands (for example intext:, filetype: and site:), Many of these can be used on the advanced search screen that can usually be found under the cog wheel in the  upper right hand area of the screen, but that link sometimes disappears so learning the commands is a better bet.  A list of the more useful Google commands is at http://www.rba.co.uk/search/SelectedGoogleCommands.shtml
  4. intext: Google’s automatic synonym search can be helpful in looking for alternative terms but if you want a term to be included in your search exactly as you have typed it in then prefix the word with intext:.
  5. Country versions of  Google. The country versions of Google give priority to the country’s local content, although it might be in the local language. This is a useful strategy when searching  for industries, companies and  people that are active in a particular country. Use Google followed by the standard ISO two letter country code, for example http://www.google.de/ for Google Germany, http://www.google.no/ for Google Norway.
  6. Google.com Apart from presenting your search results in a different order Google.com is where Google launches new features and search options first. As well as seeing pages that may not be highly ranked in Google.co.uk you will get an idea of how Google search may look in the UK version in the future. It also has some unique search options such as recipes!
  7. Google Scholar http://scholar.google.com/ Google Scholar collects all the versions of an article under an ‘All versions” link.

    All Versions in Scholar
    Click on the link to see the full list, which might include free or open access copies of the paper.

  8. Search by image Click on the camera icon in the image search bar to upload a photo or link to an image on the web. Google will then try and find similar images. There were comments from some of the workshop participants that this does not seem to always work as well as it used to, which reflects my own recent experience of the option. It is still worth a go, though, if you want to find different versions of an image.
  9. Hummingbird Keep an eye out for new layouts and ways of searching that are now appearing since Hummingbird was launched. For example, you can now compare the properties of two similar items: compare cabbage with spinach will show a table comparing the nutritional value of the two vegetables.
  10. Google Custom Search Engines (CSE) Several of the participants had a go at setting up their own CSE. Ideal for bringing together websites that you search individually on a regular basis.

Edited highlights of the presentations can be found on authorSTREAM at http://www.authorstream.com/Presentation/karenblakeman-1975041-make-google-behave-techniques-better-search-results/ and http://www.authorstream.com/Presentation/karenblakeman-1975022-google-scholar-citation-indexes/

Compare Google and Bing results with Bingiton

Bingiton comparison results

Just over a year ago Bing launched a website called Bingiton (http://www.bingiton.com/), which enabled you to compare search results from Google and Bing side by side and then decide which set was best. You had to run five searches and then Bingiton told you which search engine you had chosen for each. After a couple of weeks the site was restricted to US users but it has now been relaunched in the UK.

The principle remains the same: you type in five searches, Bingiton displays the two sets of results side by side, and you decide which you prefer or go for the draw option (“can’t decide”).

I ran several batches of searches through Bingiton and Google won 4 of the rounds. The fifth, which consisted of searches for cake and jam recipes, was a draw with me being unable to decide. Two other rounds had to be declared null and void because “Scholarly articles” links (Google Scholar) appeared at the top of one set of results indicating that they were from Google. Another included what was obviously a Google map!

Bingiton

For me Bing seemed to be better at recipes and shopping enquiries than research oriented queries. Google consistently came out on top for local information and current news. Phil Bradley has also blogged about Bingiton (http://philbradley.typepad.com/phil_bradleys_weblog/2013/10/bings-bing-it-on-challenge-returns-to-the-uk.html) and invited people to comment on their own results. It is an interesting mix and Google does not always win or win outright. Take the Bingiton challenge yourself at http://www.bingiton.com/.

Google to start using your photo and reviews to endorse ads

If you have a Google+ account you should have received an email from Google with the innocuous subject line “An Update for Google+ Page Owners and Managers”. Don’t ignore it because it contains important information about changes to Google’s terms and conditions that take effect on November 11th, 2013. From that date Google may start using your profile name and photo to endorse ads. Several people have already posted extensively about this so I will not go into much detail here. Tony Hirst has already written an excellent article on this at http://blog.ouseful.info/2013/10/12/googles-new-terms-mean-you-could-soon-been-acting-as-a-product-endorser/, which also addresses other privacy issues and account settings that you may wish to review and change.

If you do not want your photo and name used in advertisements you have to opt out because Google seems to have automatically added everyone to the scheme. Sign in to your Google+ account and go to the settings page. You should see a new option for “Shared endorsements” that is switched on. Click on the Edit link to change it to “Off”. Of course, Google tries to discourage you from doing this by saying that “your friends will be less likely to benefit from your recommendations”.

Google+ Shared Endorsements

Click continue to carry on and switch endorsements off.

Google announces Hummingbird…hmmm

Google announced a major new search algorithm to celebrate its 15th anniversary called Hummingbird, because it is “precise and fast”. Interestingly, the change was implemented about a month before the announcement was made and most of us did not notice any difference! That is probably because Google is continually making minor changes to the way it presents results, and then there are the live experiments that we are all subjected to (Just Testing: Google Users May See Up To A Dozen Experiments  http://searchengineland.com/just-testing-google-searchers-may-see-up-to-a-dozen-experiments-141570). So, even if we do suspect that our results have changed, it’s difficult to know whether it’s the usual combination of personalisation and experiments or the new algorithm.

Phil Bradley has written a neat summary of what Hummingbird is (http://philbradley.typepad.com/phil_bradleys_weblog/2013/09/what-is-google-hummingbird.html) and Danny Sullivan has compiled an FAQ at http://searchengineland.com/google-hummingbird-172816. There is also a short video on the BBC website at http://www.bbc.co.uk/news/business-24292897 in which Amit Singhal, VP, Google Search talks about the launch and the future direction of Google search.

I have not noticed any significant differences in either desktop or mobile search but that is probably a good thing. We tend to spot changes only when Google completely messes up. I suspect that we’ll see little difference when using advanced commands such as filetype or site; Hummingbird seems to be geared more towards handling natural language queries. It is far too early to say how this is going to affect in depth research, but if you suddenly find strange things happening to your search it could be Hummingbird and not you.

If you are keen to find out more about how Google works and how to get better results I am presenting a workshop later this month in London that has been organised by UKeiG. Further details are on the UKeiG website. Alternatively, if you have had enough of Google and want to explore alternatives there is the Anything but Google workshop, again organised by UKeiG.

 

Google expands define but drops dictionary

Google has added extra information to its web definitions. When using the ‘define’ command, an expandable box now appears containing additional synonyms, how the word is used in a sentence, the origins of the word, the use of the word over time and translations. At the moment it is only available in Google.com and you no longer need the colon immediately after define. So, for definitions of dialectic simply type in define dialectic.

Google Define

The box gives definitions and synonyms of the word and the ‘More’ link gives you an example of its use in a sentence.

Click on the grey, downward pointing chevron to open the box and see information on the origin of the word, translations (beware – some are rather bizarre!), and use of the word over time. The last is powered by the Google Books Ngram Viewer, which shows the frequency of words in Google Books. Click on the graph, and you are taken to the Ngram Viewer where you can drill deeper into the data and see the use of the word in context.

Google Define extra options

Compare this with the old version of define results that are still displayed in Google.co.uk:

Google Define UK

The new ‘define’ box in Google.com certainly gives you much more varied information, but the Dictionary search option that provided extra definitions has been dropped. It used to be under ‘Search tools’, ‘All results’. It can still be seen in Google.co.uk.

Google Dictionary UK

The new define only works on English words or words that have been absorbed into the English language. It can cope with schadenfreude and correctly defines tikka as “an Indian dish of small pieces of meat or vegetables marinated in a spice mixture”. When I asked it to define balti, though, it came up with a simple web definition of it being a city in Moldova. The standard Google web search results came up with the common UK usage of it as a type of curry served in a steel balti bowl. Our (UK) use of the word is probably too local for it to be have been picked up by Google. Similarly, phrases such as “chicken tikka” generally pull up a single web definition although some do trigger the translation options, for example “climate change”, “global warming”.

Overall, I like the new ‘define’ but I regret the loss of the extra definitions that the Dictionary search option offered. Sometimes, the definitions that ‘define’ offers are somewhat impenetrable. The Dictionary option provided a list of alternatives that were more understandable.

Google adds in-depth articles to results

Google is rolling out a new addition to search results called “In-depth articles” (http://insidesearch.blogspot.ca/2013/08/discover-great-in-depth-articles-on.html):

“To understand a broad topic, sometimes you need more than a quick answer. Our research indicates perhaps 10% of people’s daily information needs fit this category — topics like stem cell research, happiness, and love, to name just a few. That’s why over the next few days we’ll be rolling out a new feature to help you find relevant in-depth articles in the main Google Search results.”

The articles appear as a block of three at the bottom of your results, if you only display 10 results per page, or in the middle of the page if you display more. As Google says, they appear if your search is fairly broad and they do not appear for every query. I had to run several different searches before I found an example. At present it is only available in Google.com

My search on thorium reactor started with a Wikipedia article at the top, which seems all too often to be the default.

 Search on thorium reactors top results

Further down the page was a block of three “in-depth” articles from Wired, Cosmos Magazine and Nature.

Google in-depth articles on thorium reactors

They do not appear at all if you use a Chrome Incognito window or your browser’s private browsing option. They also disappear if you apply Verbatim to your results.

How useful are these articles? They are certainly lengthy and in depth but only the one from Nature was fairly recent (December 2012). The one from Wired was published in 2009 and the Cosmos Magazine article appeared in 2006. I tried limiting my search to articles published in just the last year using Search Tools, Any time, Past year. The documents in the main results changed but the in-depth articles remained the same. The Nature article is highly relevant but there are more recent documents to be found than those from Wired and Cosmos. This raises the question as to how these articles are selected. I have not yet found any reliable information on how it is done, although Google’s Webmaster Central Blog has provided a checklist that may help get an article into the triumvirate (http://googlewebmastercentral.blogspot.co.uk/2013/08/in-depth-articles-in-search-results.html). The Moz Blog has run an analysis on 352 searches and found that the major news sources feature heavily (see http://moz.com/blog/inside-indepth-articles for further details).

In theory, in-depth articles are a good way to find an overview of a topic but do check the dates. They may be horrendously out of date.

Bing adds Creative Commons search to images

Bing has added public domain and Creative Commons options to its image search but only if it thinks you are in the US. This is a feature that Google has long offered as part of its image advanced search but Bing have only recently added it as an option. If you are looking for an image to include in a presentation, article or promotional literature you have to make sure that the copyright license allows you to do that. Get it wrong and you could be on the wrong end of a very expensive law suit (Bloggers Beware: You CAN Get Sued For Using Pics on Your Blog http://www.roniloren.com/blog/2012/7/20/bloggers-beware-you-can-get-sued-for-using-pics-on-your-blog.html). Images that are in the public domain give you free rein to do whatever you want with them but it can be difficult to find photos that match your requirements. You may have more luck with Creative Commons images.

Bing image search now has an option to restrict your search to a specific license, but only if you are using the US version of the search engine. For those of us outside of the US we have to change our ‘country/region’. Bing frequently introduces new search options that are only available on the US version. They obviously think that the rest of the world is irrelevant.

BingCogWheel

On Bing’s home page you should see in the upper right hand corner of the screen a ‘Sign in’ option and a cog wheel. Click on the wheel to go to the settings page where you will see an option to change your location. Click on ‘Change your country/region” and select ‘United States- English’. Then head off to Bing images.

Run your search and running across the top of the results page you should see a menu with ‘License’ at the end of it. Click on this and a drop down menu will appear with options such as ‘Public domain’, ‘Free to share and use’, ‘Free to modify, share and use commercially’.

BingImagesLicense

Select the license you need and only images with that license will be included in the results. In the example below I have run a search on Caversham, which is where I live, and selected the ‘Free to share and use’ license. The results include one of my own Flickr photos of Queen Anne’s school.

BingImagesFreetoShareUse

I have a major problem with the terminology used by Bing to describe some of the licenses, and it is also a problem with Google. Misunderstanding the terms of the license could land you in serious trouble and both Bing’s and Google’s descriptions can be confusing and misleading. ‘Free to modify, share and use commercially’ is straightforward. You can modify the image, share it and even use it as part of commercial publication, brochure, website or whatever. But what about ‘Free to share and use’? I often run this one past people in my workshops and seminars, many of whom are not familiar with copyright. Usually, their immediate response is that they can share and use it however they want, even commercially. Then there might be a pause and someone will ask “What’s the difference between that license and ‘Free to modify, share and use commercially”. A great deal, and a substantial dent in your finances if someone decides to sue you for copyright infringement, but to most people it is not obvious. It wasn’t obvious to me the first time I saw the options! ‘Free to share and use’ is only allowed for non-commercial purposes. Is it so difficult to add ‘non-commercial’ to the description?

Always click through to the original source of the image. If it is a Flickr photo the copyright license will be clear. My photo of Queen Anne’s school is indeed Creative Commons free to share and use, but non-commercially and with attribution (you are required to credit me as the photographer). You may also find that the license that Bing or Google indicates is associated with an image may not be correct. On many occasions I have identified, via Google, an appropriately licensed image for a presentation or paper only to discover that it was ‘all rights reserved’ and that the Creative Commons license referred to another image on the page. If in doubt, ask. And if you cannot identify who is responsible, or they do not respond to your emails then do not use it.

If you are wondering where Google’s image license options are, they are on the advanced search screen. You first have to run your search in Google images and then click on the cog wheel in the upper right hand area of the results page.

GoogleImagesAdvanced

Select ‘Advanced search’ and on the next screen go down to almost the bottom of the page and ‘Usage rights’. Click on the downward pointing arrow next to ‘not filtered by license’ and select the license you require. By the way, ‘not filtered by license’  does not mean public domain – it covers every image that Google has indexed regardless of whether it is all rights reserved or completely free to use.

GoogleImagesLicense

And finally, if the perfect image for your project is all rights reserved do not despair. Contact the owner of the photo. If it is a worthy project or a local community cause they may give you a free license.

Has Google dumped RSS alerts or not?

Google closed down its RSS Reader on July 1st and shortly afterwards stories that it had also discontinued RSS alerts started to circulate. The first one I saw was by Google Operating System (Google Alerts Drops RSS Feeds  http://googlesystem.blogspot.co.uk/2013/07/google-alerts-drops-rss-feeds.html) quickly followed by Search Engine Land (Google Alerts Drops RSS Delivery Option http://searchengineland.com/google-alerts-drops-rss-delivery-option-165709). Both reported that when they went to manage their RSS alerts Google told them that they would have to convert all of their feeds to email alerts. From this it was assumed that Google had decided to abandon RSS altogether, which confused me because I was still receiving RSS feeds for alerts I had set up in News and Blogs. It transpires that Google no longer offers alerts for web searches. That is no great loss to me as I have always found the web alerts to be unreliable. News and blog search alerts are a different matter, though, as I usually have about 70-80 running at any one time. I could set up a separate email account for the alerts but I find it so much easier to organise and view them in an RSS reader.

Two weeks later and my feeds continue to come through. I can still set up new alerts for Blog searches by running the search and then clicking on the RSS link at the bottom of the page.

Blogs_RSS_Google

The eagle-eyed amongst you will have spotted that they have not yet removed the link inviting you to subscribe to the feed in Google Reader!

The procedure for a News RSS alert is more long winded and you need a Google account to set it up. First sign in to your account and go to Google News. In the upper right hand area of the screen there is a cog wheel. Click on the wheel and a set of personalization options should appear underneath it.

Thorium_News_Google_Alerts

In addition to the standard categories that you can add or remove there is a box into which you can type in your own “topic”. Click on the + button to add it to the list and save the personalization. Your search topic should now appear in a list on the left hand side of the screen.

Thorium_News_Google_Alerts_2

Click on your topic and at the bottom of the results page you should see an RSS icon which takes you to the feed for that search.

So the good news is that Google blog and news alerts are still available as RSS feeds. The bad news is that they are complicated to set up in news, and the links and text on the blog search results page have not been updated to reflect the discontinuation of Google Reader. This strongly suggests that RSS is very low on Google’s list of priorities so it really could be axed across the board.

If Google does decide to “retire” RSS and you want to carry on receiving RSS rather than email alerts there are several alternatives. So far, the best of the free services for me is the Netvibes Dashboards (http://www.netvibes.com/), which uses a number of tools including Google. Even if I ignore the Google results, Netvibes generally comes up a comprehensive and relevant set of alerts on my topic. Overall, I would rather not have the hassle of setting up my alerts afresh but Google has a habit of finishing off services with little or no warning. Now is the time to start looking for replacements.

Google drops the tilde operator

It seems that Google has dropped the tilde (~) synonym operator (http://googlesystem.blogspot.co.uk/2013/06/googles-tilde-operator-no-longer-works.html). Although Google automatically looks for variations on your terms, placing a tilde before a word seemed to look for more variations and related terms. It meant that you didn’t have to think of all the possible permutations of a word. It was also very useful if you wanted Google to run your search exactly as you had typed it in except for one or two words. The Verbatim option tells Google to run your search without dropping terms or looking for synonyms, but sometimes you might want variations on just one of the words. That was easily fixed by placing a tilde before the word. Now we are left with the OR command, which is unreliable at the best of times.

I must admit I didn’t see this one coming. My money was on another option going first.

Many thanks to Aaron Tay (@aarontay) for the alert.

Update: @dmrussell (https://twitter.com/dmrussell) has confirmed via Twitter that it was removed because it wasn’t much used and Google could not justify the cost of maintaining the index and code.