Tag Archives: web page monitoring

Web page monitoring

Tracking changes to web page content

4 Comments

I’ve updated my list of  services and programs that track changes to web pages at http://www.rba.co.uk/sources/monitor.htm.  I’ve copied the list here partly for information but also because I’d be interested in hearing other people’s experiences of using them and recommendations for  any services I have omitted.

Link checkers such as Xenu Link Sleuth (http://home.snafu.de/tilman/xenulink.html) can alert you to pages that have disappeared or that are redirecting users to another site, but changes to the content are equally if not more important. There are many services that track web page content for changes. Some are free whilst other priced services may offer limited facilities as a free taster.

This lists includes both web based services and software programs for PCs and Intranets.

Web based services

Change Detection

URL: http://www.changedetection.com/

This is a free service allowing you to track an unlimited number of pages. The frequency of the alerts can be daily, weekly or monthly and you can choose to only have alerts for “sizeable changes”, when content has been added or removed, or for specific keywords. The email merely alerts you to the fact that there have been changes; you have to click on a link in the email to view them in the Change Detection web site. RSS as well as email alerts avialable.

ChangeDetect

URL: http://www.changedetect.com/

The home page gives the impression that this is a totally free service. It isn’t. The free trial version of this service allows you to track a maximum of 5 pages and lasts for two weeks. You can receive web page change notifications via email, ICG or text message. The subscription services allow you to track more pages and password protected pages. ChangeDetect Personal costs USD 1.95 a month and tracks 10 web pages. ChangeDetect Plus costs USD 14.95 a month for 100 web pages and allows you to set up keyword and phrase notification triggers and colour coded notifications. ChangeDetect Professional costs USD 39.95 a month for 500 web pages with content checked twice-daily.

Femtoo

URL: http://femtoo.com/

This service allows you to have up to 10 “trackers” and a maximum of 5000 characters tracked for changes free of charge. There are a number of plans that allow more trackers and additional options which can be found at http://femtoo.com/plans/. You can select the content to be tracked and how it is to be treated (text or numerical). Alerts can be delivered by email, SMS and a personal Tracker RSS Feed. Content is checked every 30 minutes.

FollowThatPage

URL: http://www.followthatpage.com/

The free service provides 100 daily page checks and 1 hourly check. You can track additions, deletions, Google page rank, keywords, and sections of a page. Alerts are sent to you by email. The Pro account gives you 1000 daily checks, 20 hourly checks, 5 10-minute checks and 100 weekly checks.

Infominder

URL: http://www.infominder.com/

The free trial tracks up to 10 pages free of charge for 30 days and allows you to associate categories and descriptions with a “minder”. Within the advanced options you can specify how often, in days, the page is to be checked. The most frequent check allowed for free is every 1 day. You can also specify the minimum number of changes that must occur before you are notified and any keywords or phrases that must appear in the changes.

Infominder Professional costs USD 30/yr to track 100 pages, USD 60/yr for 250 pages, USD 120/yr for 500 pages and USD 250 /yr for 1000 pages.

Infominder Premium allows you to monitor changes up to 4 times a day and costs USD 60/yr for 100 pages, USD 125/yr for 250 pages, USD 300/yr for 500 pages and USD 500/yr for 1000 pages.

[Note: The Infominder web pages do not appear to have been updated since 2007 which does not inspire confidence.]

Page2RSS

URL: http://page2rss.com

Page2RSS tracks web pages for changes and notifies you of those changes by RSS. Simply type in the URL of the page you wish to track and then add the feed URL to your favourite feed reader. Excellent tool for pages that do not offer their own RSS feeds.

Watch That Page

URL: http://www.watchthatpage.com/

This is a free service run by ATS Consulting, a Norwegian company that specialises in software development. You can track an unlimited number of pages, which can be grouped into folders and tracked on a daily or weekly basis. There is a keyword matching option that filters the changes that are relevant to you, for example if you are only looking for news where a certain term or phrase occurs such as a company or a product name. Channels enable you to divide your pages into groups based on importance or content type. Each channel can have different properties: some can have keyword matching and daily reports whilst others can be checked less frequently and report all changes. Email alerts can include the text that has changed on your pages or just list the URLs of pages that have changed. If you are a professional or heavy user, you are required to pay a fee. Watchthatpage will notify you by email if you fall into the heavy user category.

Websnitcher

URL: http://websnitcher.com/

Websnitcher is a free services that checks your pages every 3 hours and gives you a detailed list of changed textareas. Email notifications are sent once a day and it also generates RSS feeds from the collected data. It alerts you only to what it considers are relevant changes; the intelligent filter tries to ignore changes in date and what it thinks are irrelevant textareas such as how many users are online.

Desktop programs

Copernic Tracker

URL: http://www.copernic.com/en/products/tracker/

Copernic Tracker is a tracking program that costs US $49.95. Once installed on your PC it enables you to track any number of pages on external sites and intranets. You can track changed words, new links or images. There is a useful advanced query form for tracking specific words within pages, Boolean and other search operators (AND, OR, NEAR).

Copies of page revisions are stored locally so that you can compare changes that occurred in the past and add your own notes for tracked pages and each of their revisions. There are four pre-set tracking schedules: Multiple Times per Day, On a Daily Basis, On a Weekly Basis and On a Monthly Basis. Alerts can be a tray icon, desktop alert or notification message, SMS notification, email report with the tracked page contents and changes highlighted.

Internet Owl

URL:http://www.internetowl.com/

As well as general changes to a page you can track the page for the appearance or deletion of specified text, or track selected areas of the page. You can view changes from within the program or in your browser and be alerted via email, a pop-up on your desktop or a sound. The default checking frequency – minutes, hours or days – can be changed as can the frequency for individual pages. Price: 29.95 USD. 30 day free trial.

Update Patrol

URL: http://www.updatepatrol.com/

Update Patrol checks pages for changes as often as you like and you can monitor single pages or entire web sites. It costs US $69.95 for a standard license and US $129.95 for the pro version. See http://www.updatepatrol.com/editions.html for details of the features supported by each edition. A free trial is available.

Update Scannner for Firefox

URL: https://addons.mozilla.org/en-US/firefox/addon/3362
or http://updatescanner.mozdev.org/en/index.html

A free add-on for Firefox. To monitor a page, display it in Firefox and from the right click menu select Scan Page for Update. You can select how often each page is to be scanned (from 5 minutes to once a week), whether or not to ignore numbers, and if insignificant changes are to be ignored (specify the number of characters from less than 10 to less than 1000 characters). An alert will pop-up at the bottom of the screen when changes are detected. Click the blue up-arrow on the bottom status bar to display the Update Scanner sidebar and pages that have been updated are shown in bold. Click on a site in the sidebar to view the page with highlighted changes.

Website Watcher

URL: http://aignes.com/

The full version of this software is available on a 30 day free trial. It tracks an unlimited number of pages and you can choose to ignore HTML tags, images/banners, numbers and dates. You can enter user names and passwords for password protected pages that you wish to track. Pages can be checked once a day, once a week, or on a specified day or days of the week. You can even specify the checking frequency during a day either in hours or minutes.

You can track entire sites without having to specify each page individually (not available in the Basic Edition). As well as web pages you can track RSS and Atom feeds, but this feature is not really a replacement for a fully fledged RSS reader if you are a serious news junkie.

Prices are 29.95 Euros for the Basic Edition, 49.95 for the Personal Edition, 99 Euros for a single user Business licence, 1990 Euros for a site license and 9990 Euros for an enterprise licence.

Google, RSS

Google Reader tracks web page changes

3 Comments

So you are an RSS addict but your favourite news page does not have an RSS feed. There are plenty of tools that will monitor a web page and notify you of changes by email or RSS (see my list Monitoring Web Page Changes at http://www.rba.co.uk/sources/monitor.htm) but now Google Reader also has an option that will allow you to monitor changes to most web pages. All you need to do is log  in to Google and open Google Reader, click on Add a subscription, and then enter the URL of the page you want to monitor. That’s it.

I am testing it out on 3 web pages and comparing the results with Page2RSS and the desktop program Website Watcher. My comparison has only been running for 12 hours but already there are differences between Google Reader and Page2RSS. Google Reader is picking up more changes than Page2RSS, which is not surprising because Page2RSS checks a page just once a day and Google checks pages more frequently. But what I did not expect was that Google would miss a major change that Page2RSS picked up. Had I bothered to look at the web page when Google Reader had told me it had changed I would have spotted the new text that it had missed but the temptation is to just view the reported change in Google Reader. Website Watcher, though, has come up trumps every time and picked up all changes to the pages, probably because I told it to check the pages in question every 10 minutes.

The initial stages of my trial suggest that Google Reader is a good way to track changes to web pages as long as you only need to know if a web page has changed in some way and as long as you go to the live web page to view the changes. It seems that if a web page changes frequently throughout the day it will not pick up and report every single change. Google Reader checks pages at pre-determined time intervals but I expected it report on all of the changes since it’s last report. It doesn’t and that puzzles me.

If you really need to know about web page changes as soon as possible then a desktop tool such as Website Watcher is the bees knees. You can choose how often it checks the pages and you can also tell it look for specific keywords  – useful if you are waiting for a product launch announcement for example.  Website Watcher can also easily monitor whole directories of pages. It is not free – prices start at 29.95 euros  (see http://www.aignes.com/shop.htm for details) – but it gives you far more options and control than Google Reader.