Tag Archives: Google

Personalised vs non-personalised search – a word cloud comparison

My talk at the recent INFORUM 2012 conference held in Prague was about the issue of personalisation and the impact of our social network activities on search results. I believe that personalisation, and in particular contributions from our social and professional networks and even Google+, can present us with an alternative view of a topic or person that can be an important part of our analysis of a situation. I always have two different browsers open. One is not logged in to any account of any sort, has all cookies cleared at the end of each research session, and has search history disabled. The other is permanently logged in to a Google+ enabled account, social and professional accounts, and has web history enabled. This enables me to quickly switch between two very different environments to give me very different results when I am conducting research on Google or even Bing. Demonstrating this at a workshop or conference can be difficult, though, because postings and comments from the social elements of the search results may have been restricted to friends or limited circles.

For the INFORUM 2012 conference I decided to generate word clouds for personalised and non-personalised results for a Google.co.uk search on the single word Prague. The titles and up to the first 250 words of the top 20 results for the searches were scraped into a document from which the clouds were generated. In the graphic below, which has been taken from my presentation, the first word cloud represents a search that is as non-personalised as I could make it and the second has been personalised by several weeks of research on what to do and see in Prague. There are no prizes for guessing what we were interested in visiting!

Word cloud

Forthcoming workshop: Effective online search tools and techniques (Sheffield)

If you want to make Google behave or learn about alternative search tools, I am running a workshop for SINTO next week in Sheffield. It is a one day hands-on workshop to be held at Sheffield Hallam University on Tuseday 1st May (10 am – 4 pm).

This workshop will start with how Google works, important changes that are affecting search results, and how to make use of Google search features to improve and focus your search. It will then move on to other options for general web search and specialist tools for different types of information (for example statistics, social media, research) and subject areas. This workshop is suitable for all levels of experience and the techniques covered can be applied to all subject areas.

Cost: SINTO members £80 + £16 VAT= £96. Non-members £110 + £22 VAT = £132

Feel free to contact me if you require further information about the workshop content.

A booking form is available at http://extra.shu.ac.uk/sinto/Events/events.html or you can contact SINTO on Tel 0114 2255740, email sintoenquiry@shu.ac.uk

Presentation: Search Turns Social – Resistance is Futile

The presentation I gave to CILIP in Hants & Wight yesterday (Search Turns Social – Resistance is Futile) is now available on authorSTREAM at http://www.authorstream.com/Presentation/karenblakeman-1392940-search-turns-social-resistance-futile/

It is also available on Slideshare at http://www.slideshare.net/KarenBlakeman/search-turns-social-resistance-is-futile and temporarily on my web site at http://www.rba.co.uk/as/

Order matters with Google advanced search commands

The great thing about running search workshops is that you have so many people experimenting with advanced commands that someone is bound to spot an anomaly that you haven’t. We’ve become used to seeing different results when changing the order in which we enter keywords but not when using advanced search commands. During one of my workshops we had a couple of people playing around with Google’s allintitle command. This tells Google to look for all of the keywords following allintitle in the title of a document.

The search that was initially used was allintitle:diabetic retinopathy and came back with 277,000 results. Restricting the search to UK academic sites by using allintitle:diabetic retinopathy site:ac.uk reduced the number to about 2,190 and gave sensible results. But changing the order of the commands to site:ac.uk allintitle:diabetic retinopathy gave  two very bizarre results:

Site and Allintitle  Commands

Both results are from academic sites but the allintitle as a search command seems to have been ignored. The first entry includes intitle, diabetic and retinopathy and the second has allintitle, diabetic and retinal. Using the Verbatim option from the menus on the left hand side of the results page gave us zero!

Next we tried combining allintitle with fieltype:pdf.

allintitle:diabetic retinopathy filetype:pdf

gave us 3490 results of which at least the first 100 were relevant.

Switching the order to :

filetype:pdf allintitle:diabetic retinopathy

gave 495,000 results some of which were relevant but many did not contain all of our terms nor did they contain both diabetic and retinopathy in the title. Google was also looking for variations on our terms.

Order of advanced search commands

 

Using Verbatim on this search gave us zero again.

Advanced Commands and Verbatim

When we looked at the advanced search screen Google had put everything in the right boxes. If we used the advanced search screen to enter our terms afresh the search worked with Google putting the allintitle command at the start of the search.

Was this a general problem or just with allintitle? We then played around with the intitle command.

intitle:diabetic intitle:retinopathy site:ac.uk – 2220 sensible results (slightly more than our original allintitle search)

site:ac.uk intitle:diabetic intitle:retinopathy – 2220 sensible results identical to those above

intitle:diabetic intitle:retinopathy filetype:pdf – 3480 sensible results

filetype:pdf intitle:diabetic intitle:retinopathy – 3480 sensible results same as previous search

We then tried using a phrase after intitle:

intitle:"diabetic retinopathy" site:ac.uk – 2130 sensible results

site:ac.uk intitle:"diabetic retinopathy" 2130 sensible results identical to previous search

Following a suggestion made by Tamara Thompson of PIBuzz ( http://pibuzz.com/) changing the search slightly to site:ac.uk "intitle:diabetic intitle:retinopathy" gave exactly the same results.

Just to make sure that it wasn’t just us in the UK seeing this I asked fellow members of AIIP (http://www.aiip.org/) to run the original two allintitle searches. They saw exactly the same thing.

Its seems, then, that there is a problem when allintitle is not the first command in a search. The intitle alternatives appear more reliable. If you prefer to use the command line rather than fill in the boxes on the Advanced Search screen remember that order sometimes matters.

Does this affect other combinations of commands? I left it at allintitle and intitle but I wouldn’t be at all surprised.

Google+ overrides search settings

I’ve noticed this strange behaviour for a while but have only now had to time to try and find out what is going on. When I’m signed in to a Google account that has Google+ associated with it I cannot display more than 10 search results per page. This is despite having Instant switched off and specified 100 results per page in my search settings. I checked another Google account that does not have Google+ and my settings are respected as they are when I am signed out. I have cleared cookies and web cache, and tried different browsers. The same problem occurs. So it seems that if your account has Google+ associated with it Google overrides what it likes! I already have two browsers open all the time: one signed in to my main Google account for gmail and other stuff, and one signed out for search. Sometimes, though, I want to run the same search within Google+ and then on web search so I have to go to the effort of copying my search across to the signed out browser.

This may sound like a minor issue but if Google is ignoring this user setting one starts to wonder what else it is choosing to ignore.

Clear your YouTube history

Now that Google has merged all your personal data, time to double check that you’ve removed stuff you do not want Google to use. As well as the steps mentioned in my previous posting (Google personalisation: web history isn’t the only problem http://www.rba.co.uk/wordpress/2012/02/22/google-personalisation-web-history-isnt-the-only-problem/) you might want to clear out your YouTube history as well.

Sign in to your account and go to  http://www.youtube.com/my_history  and  http://www.youtube.com/my_search_history. The first is your viewing history and the second your search history. If you don’t want Google to use this information to “enhance your search experience” in its other products clear both of the histories and pause to stop it gathering future activity.

And another reminder that if you are fed up with Google trying to personalise your ads you can opt out at http://www.google.com/ads/preferences. Note that this does not get rid of Google’s ads altogether it just stops Google using your past searching and browser behaviour to decide which ads to display. To opt out of targeted advertising from other networks you should also pay a visit to  http://www.aboutads.info/choices/ and http://www.networkadvertising.org/managing/opt_out.asp.

Update

I should have said that the opt-out of targeted advertising is done via cookies on your computer and so is computer and browser specific. If you or your system periodically clears cookies then you will have to opt out again. You do not have to be signed in to a Google account to do this. There is also a  Keep My Opt-Outs plugin for Chrome.

Further update

I’ve just checked a very old Google account of mine that was used for news alerts but does not have a Gmail account or anything else associated with it  (it was set up pre-Gmail). I can log in to YouTube with it but when I try to access the My History page to delete search and view history it insists that I set up a channel, which I do not want or need, before I can do it. Tell you what, Google, I’ll just delete the whole account.

Google personalisation: web history isn’t the only problem

On March 1st a major change to how Google uses your search and personal information will be implemented. Under the innocent sounding title “Updating our privacy policies and terms of service” (http://googleblog.blogspot.com/2012/01/updating-our-privacy-policies-and-terms.html) Google announced in January that it is consolidating more than 60 privacy policies into a single main Privacy Policy. (You can preview the new policy at http://www.google.com/policies/privacy/preview/). Until now there have been separate Terms and Conditions and policies for each Google product (YouTube, Gmail, Reader etc). From March 1st there will be just one. In principle this is a good thing and makes sense, but Google have used this to sneak in changes in how it uses your search behaviour to personalise results.

Our new Privacy Policy makes clear that, if you’re signed in, we may combine information you’ve provided from one service with information from other services. In short, we’ll treat you as a single user across all our products, which will mean a simpler, more intuitive Google experience.

In the past, data such as your web history was kept separate from other Google products. It will now be combined with information that Google has gleaned from its other services, for example YouTube, and your results personalised accordingly. A lot has been made of deleting and disabling the web history associated with your account. It’s simple enough to do by logging in to your account and going to http://www.google.com/history/. From here you can delete entries and disable your web search history altogether.

You may, though, prefer to keep your web history. Several groups I have talked to over the last couple of months share a Google account for the library or their subject team and use it to keep track of searches and sites they have visited. One example they gave me involved a student who came back to them asking for another copy of the paper that they had given him three weeks previously. He had lost it, forgotten who the authors were, could barely remember the title and definitely could not recall the journal! Trying to repeat the search was no good; it was difficult enough attempting to recreate the search string and in any case Google had made so many changes to web search that the results would have looked totally different anyway. By using the search history the librarians managed to locate not only the search but also the document they had retrieved for the student.

Unfortunately the Web History is not the only piece of information that Google uses when personalising results. To get an idea of what it could be using take a look at your Google account dashboard by going to http://www.google.com/dashboard/. Now is the time to do a spot of spring cleaning and remove any “stuff” you no longer use or need. It won’t be possible to remove everything but you may be surprised at how much clutter there is in your account. I have told Google a lot about myself including links to other services and networks that I use. Being self employed it is one way of promoting and advertising what I do but now Google’s attempt at personalisation has become increasingly annoying. Two weeks ago I went into YouTube. I have told Google that I live in Reading in the UK and YouTube automatically presented me with videos from ReadingBerkshireUK (note that I do NOT subscribe to this channel).

The videos about the redevelopment of Reading Station and local transport are relevant but I was not tempted to view any of them – I see enough of it first hand every day. As for Reading Football Club I regret to say that I have no interest in football whatsoever. When I visited YouTube this morning it had given up trying to persuade me to click on Reading videos and decided to push content that had been shared by members of my Google+ circles. Most of it was irrelevant.

We can expect to see a lot more of this type of intrusion in the future as Google is determined to ram Google+ down our throats (see And the next Google killer is….Google! http://www.rba.co.uk/wordpress/2012/01/30/and-the-next-google-killer-is-google/). There are even reports that people setting up a new account for YouTube, Gmail, or any other Google product are being forced to set up a Google+ account. (Google Now Forcing All New Users To Create Google+ Enabled Accounts http://marketingland.com/google-now-forcing-all-new-users-to-create-google-enabled-accounts-3912). If you do not want this cross-fertilisation to occur then sign out of your account before searching. But have you noticed how insistent Google is that you have an account and that you are signed in? The new Google home page has removed the cog wheel that gave access to Advanced Search and Language tools from the top right hand corner of the screen. Instead there is now a prominent button exhorting you to “Sign in”.

Once you have carried out a search the cog wheel comes back but it is underneath the persistent Sign in link.

If you are a heavy user of Google services it can be a nuisance having to sign out each time you want to conduct a search. I now have two browsers open on my desktop: one signed out for searching, the other for Google+, Gmail, Blogger etc. Ironically, an alternative is to install Chrome, which is Google’s own browser. This has an Incognito option that depersonalises your search and removes traces of your activity when you close it down. It will keep any bookmarks that you make and files that you save during the session.

In summary, to take back control of your search:

1. Review and prune what is in your Google account’s dashboard

2. Decide whether or not the web history is going to be useful to you. If it isn’t, delete and disable it.

3. Sign out of your account before searching, or use a separate “un-signed in” browser, or use Chrome Incognito

Top search tips from UKeiG Google workshop

UKeiG organised a workshop on Google, which was held on 8th February 2012 and hosted by Birimngham University. (My slides for the day can be found on authorSTREAM and on Slideshare). Twenty-two people from a variety of backgrounds and sectors attended the event and their combined Top 10 Tips are listed below.

1. An understanding of how Google works and is messing up “improving” search is vital. Minor changes in functionality and ranking algorithms can cause havoc and are impossible to counter unless you know what is going on. Google’s various official blogs are a starting point but they don’t tell you everything. Identify and monitor blogs from searchers and organisations that monitor what Google and other search engines are up to. (A selection are listed on the final slide of the presentation).

2. “Google assumes that all searchers are stupid and don’t know how to search” said one workshop participant! It takes far too many decisions on their behalf: automatically corrects what it thinks are typographical errors, excludes and adds terms to the search without asking, changes results according to past searching behaviour, and gives priority to network connections. To bring Google to heel, learn how to use advanced search commands and the options available in the menus on the left hand side of the results pages.

3. If you have a Google account investigate your Dashboard (http://www.google.com/dashboard/). This contains all of the information you have given Google about yourself plus data that Google has collected from your various accounts such as Gmail and Google Reader. Clear out anything you don’t need or use (you won’t be able to do this for everything) and make sure you are not sharing anything that you want kept private, for example docs and maps.

4. Order matters. Changing the order in which you type in your search terms will change the order of your results. The pages that contain the terms in the order you specified in your search are usually given a higher weighting. Also keep an eye on any oddities when combining advanced search commands. For example the search allintitle:diabetic retinopathy site:ac.uk comes up with sensible results. Switch the order to site:ac.uk allintitle:diabetic retinopathy and Google totally loses the plot.

Site and Allintitle commands combined in the wrong order

 

5. Be aware that Google no longer searches for all of your terms all of the time. It now does what it calls a ‘soft AND’. See the first comment to my blog posting on this issue at http://www.rba.co.uk/wordpress/2011/11/08/dear-google-stop-messing-with-my-search/#comments. If you want all of your terms to appear in your documents exactly as you typed them in then you have to use….

6. Verbatim. This tells Google to carry out an exact match search. Run your search as normal and then use Verbatim in the menu on the left hand side of your results page. It is normally hidden from view so click on ‘More search tools’ at the bottom of the menu and Verbatim is right at the bottom. It appears that you can use advanced search commands such as filetype:, site:, and the tilde (~) with Verbatim but it cannot be combined with the date options or ‘Pages from the UK’ in the results page menus.

7. Public Data Explorer is one of Google’s many well kept secrets. It can be found at http://www.google.com/publicdata/ and allows you to search data sets from organisations such as the IMF, OECD and World Bank. You can compare the data in various ways and there are several chart options.

8. Google has a habit of hiding and moving links to resources and tools such as the Public data Explorer, Advanced Search and Language Tools. Bookmark them so that you can always find them (unless, of course, Google decides to remove them altogether).

9. Three tools that are intended for people maintaining websites can also be useful to searchers in identifying trends, alternative search terms, and research into key players and competitors in a sector.

Google Trends http://www.google.com/trends/ – can be used to view search trends over time and to compare multiple search terms

Google Trends for Websites http://trends.google.com/websites – looks at search trends for individual websites or you can compare several websites. In addition it shows what people  ‘Also visited’ and ‘Also searched for’.

Google Insights for Search http://www.google.com/insights/search/ – advanced options for identifying search trends including countries and categories.

If you are responsible for content on your web pages these tools can help identify terms that could increase traffic to your site.

10. If you have had enough of Google and do not feel secure with the way it monitors your activity and personalises results try DuckDuckGo (http://duckduckgo.com/) as an alternative. DDG does not track, filter or personalise and several people found some of the results to be better than Google’s. Many of the workshop participants had tried Bing but there was little enthusiasm for it. They had found that the results were not as relevant as Google’s and there was concern over Bing’s links with Facebook, personalisation and what it calls “adaptive search”. Google is so often considered the bad guy because of the amount of personal information it gathers but it does at least show users a lot of what has been collected about them. The same cannot be said for Bing.

 

And the next Google killer is….Google!

Many of us have been saying for a while that the search engine that will kill Google is Google itself. It has come so close in the past, two of the more recent incidents being the removal of the plus sign from general web search and stopping the ‘ANDing’ of search terms. Prefixing search terms with the plus sign enabled searchers to disable Google’s synonym and variation search so that it carried out an exact match search. It still works in Google Scholar but not in general web search; Google is now using the ‘+’ prefix within Google+ to help users find Google+ business pages, for example +BASF will quickly take you to the BASF business page.  Google redeemed itself to some extent by hastily bringing in the Verbatim option, which can be found in the left hand menu of your results page. This will run your search exactly as you specify it (Google: Verbatim for exact match search http://www.rba.co.uk/wordpress/2011/11/18/google-verbatim-for-exact-match-search/). However, while it works with Google commands such as ‘filetype:’ and ‘site:’ it gives up as soon as you start using some of the options in the left hand menu on the results page, such as date.

And now enter Google+ and Search Plus Your World (SPYW). If you decided to add Google+ to your Google account Google has seriously messed up altered the way it handles your search if you are logged in. It now incorporates and gives priority to results from your Google+ network. (For more details from Google see Search, plus Your World – Inside Search http://insidesearch.blogspot.com/2012/01/search-plus-your-world.html). At present it is only available if you are signed in on Google.com and searching in English. “Search Plus Your World” is now the default and personalizes your results based on both your own behaviour and social connections, and content that has been shared with you through Google+.  Phil Bradley has written an excellent posting on how this works (Why Google Search Plus is a disaster for search http://philbradley.typepad.com/phil_bradleys_weblog/2012/01/why-google-search-plus-is-a-disaster-for-search.htmll).

Initially I was in two minds about SPYW. I thought I might find it useful if I wanted to check what people in my Google circles were saying about a particular issue but then realised that most of them prefer to post on Twitter rather than in Google+ and Google+ does not cover Twitter! The Search+ results include

  • listings from the web
  • pages from the web that have been given priority because of your search behavior
  • pages from the web given priority because of your social connections
  • both public and private (or limited) Google+ posts, photos and Google Picasa photos

When it comes to serious research Search+ includes far too much irrelevant information. So how easy is it to turn it off? If you are logged in when you run your search you will see a message above your results that tells you the number of personal results and “other results” that have been found. There is also a toggle that enables you to switch between personalised and unpersonalised results. You can also switch it off permanently within your search settings.

You can of course just log out of your Google account before you run a search, or never sign up for Google+ in the first place. But Google is making the latter increasingly difficult. Let’s look at the results that might be popping up on your screen and as an example I’ll use a search on Phil Bradley, search and social media expert and President of CILIP. First of all a search on Phil Bradley before Search+ arrived:

On my screen I see pages from his web site, his blog and a Wikipedia entry (which is not the Phil Bradley I am looking for!). When I sign in to a Google account that has Google+ associated with it I see something completely different:

 

Phil’s Google+ profile is given priority above everything else and takes up most of the screen regardless of whether or not it is the most relevant or most up to date (Real-Life Examples Of How Google’s “Search Plus” Pushes Google+ Over Relevancy http://searchengineland.com/examples-google-search-plus-drive-facebook-twitter-crazy-107554).  And don’t think you can escape with a Google account that does not include Google+. Google has ways of enticing you to “upgrade”:

Even worse, if you sign up now for a new Gmail, YouTube or Blogger account you are automatically joined to Google+ (http://searchenginewatch.com/article/2140440/New-Gmail-YouTube-Blogger-Users-Join-Google-by-Default).

Search+ has even tainted the suggestions that pop up as you type in your search:

Phil’s Google+ profile is given prominence and if you click on the link without having an account yourself your are invited to join:

To see what the suggestions should look like a group called Focus on the User (http://www.focusontheuser.org/) has produced a bookmarklet for Chrome, Firefox and Safari and extensions for Chrome and Firefox. This tries – and succeeds most of the time – to display your search results without the intrusion of Google+ results. For my search on Phil his Google+ profile is replaced with Twitter.

When I run a search on my own name my Google+ entry is supplanted by my LinkedIn profile.

“What Google should be” does not, though, remove the extra “content” that Search+ sometimes adds to the right of your results. Run a subject search and you may see “People and Pages on Google+” that are supposedly related to your search terms.

I have not yet found these entries to more relevant than standard search results and the link “Learn how you could appear here too” indicates that Google sees this as another way of persuading people and organisations to join Google+. Switching it off is not easy. It is still there if you are logged out of your Google account. It is still there if you add &pws=0 to the search URL (in fact &pws=0 does not seem to work any more at all for depersonalising results). It does disappear, though, if you use Incognito in Chrome. The intrusion of Google+ is most obvious when running searches with just one or two terms or more consumer biased searches. As soon as you start building more complex searches involving filetype: or site: for example, or research more scientific subjects then Google+ takes a back seat.

Search+ is not all that is affecting how Google presents results. Google is simplifying its privacy policies and combining user data from all of its services (Official Google Blog: Updating our privacy policies and terms of service http://googleblog.blogspot.com/2012/01/updating-our-privacy-policies-and-terms.html). It sounds innocent enough but I’ve already spotted major changes. Google knows I live in Reading because I have told it and I do find that useful when I am carrying out local searches for restaurants, builders etc. Google has now decided, though, to bombard my YouTube home page with videos about Reading.

The videos of the Reading railway station redevelopment are vaguely interesting but I see enough of that in real life on a daily basis when I pass through the centre of town. The football videos are of no interest to me whatsoever. So the crossover of content has already started and I am not looking forward to what Google decides to put in my web search results as a consequence of my YouTube activity!

It is becoming increasingly difficult to make Google behave. Using advanced search commands is one way but many searches do not require them. The best method I have found so far is to use Chrome as your browser and open an incognito window. This depersonalises your results, ignores your web history and existing cookies, and leaves no traces of your search activity. Alternatively, since Google has clearly lost the plot when it comes to search, try another service. The three that I would currently recommend are Bing (http://www.bing.com/), DuckDuckGo (http://duckduckgo.com/) and Blekko (http://blekko.com/).

Workshop (Birmingham): How to make Google behave

Well, the proverbial has hit the fan with Google search getting really personal (Official Google Blog: Search, plus Your World http://googleblog.blogspot.com/2012/01/search-plus-your-world.html). Good news or bad news? A bit of both. It’s great for tracking down information or a comment made by someone within your personal social networks but a disaster if you are conducting serious, global research. And Google has made so many other changes: dumping the ‘+’ symbol as a way to enforce an exact match search and no longer ‘ANDing’ terms are just two. The results are here, there and everywhere but not necessarily where you want them. Changing your default search engine is one solution but there are times when Google’s extensive coverage is required. There are ways of switching off Google’s improvements and options that you can use to improve results.

I am running a workshop for UKeiG on how to make Google behave  – at least some of the time! – in Birmingham on February 8th. The areas we’ll be covering will include:

  • how Google works – what Google tells us and what we have to guess
  • recent developments and their impact on search results
  • how Google customises your results and can you stop it?
  • how to use existing and new features to focus your search and control Google
  • how and when to use Google’s specialist tools and databases
  • what Google is good at and when you should consider alternatives

There will be time to experiment and try out the techniques for yourself. Exercises will be provided to help you test out the search features but you are free to explore and try out searches of your own.

If you are interested further details and a booking form are available on the UKeiG web site at http://www.ukeig.org.uk/trainingevent/how-make-google-behave-techniques-better-results-karen-blakeman