<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Measuring content&#160;effectiveness</title>
	<atom:link href="http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/</link>
	<description>Musings on User Experience, Design, Web Analytics and other interests</description>
	<lastBuildDate>Fri, 12 Feb 2010 05:19:59 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0</generator>
	<item>
		<title>By: Darwin Hall</title>
		<link>http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/comment-page-1/#comment-3117</link>
		<dc:creator>Darwin Hall</dc:creator>
		<pubDate>Wed, 02 May 2007 00:19:36 +0000</pubDate>
		<guid isPermaLink="false">http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/#comment-3117</guid>
		<description>Benry, I for one applaud your efforts in development of a customized KPI. It says to me that you are passionate about your work and have talent to burn. I think bounce rate can mean many things depending on where it is, where they came from and the offering of interest before them.

It can be difficult to contextualize an idea as dynamic as traffic analysis and KPI&#039;s. 

Darwin</description>
		<content:encoded><![CDATA[<p>Benry, I for one applaud your efforts in development of a customized KPI. It says to me that you are passionate about your work and have talent to burn. I think bounce rate can mean many things depending on where it is, where they came from and the offering of interest before them.</p>
<p>It can be difficult to contextualize an idea as dynamic as traffic analysis and KPI&#8217;s. </p>
<p>Darwin</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Chris Wilhelmi</title>
		<link>http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/comment-page-1/#comment-3116</link>
		<dc:creator>Chris Wilhelmi</dc:creator>
		<pubDate>Tue, 01 May 2007 19:49:26 +0000</pubDate>
		<guid isPermaLink="false">http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/#comment-3116</guid>
		<description>my first reaction is that using bounce rate and time spent are more measures of page effectiveness in totality as opposed to content effectiveness...I think it could be more useful if combined with some other measures of content utilization such as a weighted average of clicks. Something that incorporates total possible clicks versus actual clicks. That way your looking at two distinct groups, those who bounced as well as those who used the content and assessing them together.</description>
		<content:encoded><![CDATA[<p>my first reaction is that using bounce rate and time spent are more measures of page effectiveness in totality as opposed to content effectiveness&#8230;I think it could be more useful if combined with some other measures of content utilization such as a weighted average of clicks. Something that incorporates total possible clicks versus actual clicks. That way your looking at two distinct groups, those who bounced as well as those who used the content and assessing them together.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Steve McInerney</title>
		<link>http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/comment-page-1/#comment-3112</link>
		<dc:creator>Steve McInerney</dc:creator>
		<pubDate>Mon, 30 Apr 2007 09:56:24 +0000</pubDate>
		<guid isPermaLink="false">http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/#comment-3112</guid>
		<description>&lt;i&gt;Have you found it to work well regardless of the traffic level of the page?&lt;/i&gt;

Strictly? No. Generally? Yes.
Why &quot;No&quot;? :-) If &amp; When Exits == 0. Division by Zero is a no no. :-)
I fudge around that by finding the max &quot;ratio&quot; from all other ratios from all pages and substituting that instead. Yeah it&#039;s a nasty fudgy hack...
As with any metric - really low numbers can throw things screwy. I find &gt; 30 entries is probably the useful limit. Any less is too &quot;noisy&quot;. Big numbers are no problem - tho you can get an averaging effect which swamps detail.
I also base this off the &quot;Entry Pages&quot; so entry == 0 is not an issue.

I haven&#039;t (yet) tried trending it over a period of time. Be interesting to see if it changed anything...

I suspect it would be wise to segment before generating the ratio, to really drill down, but for general KPI work is probably a Good Start(tm).


High Time visits? I&#039;d agree with the sentiment. But is an &quot;engaged user&quot; an agreeable goal? On work&#039;s site - no. Or rather, not really. Get &#039;em in, and show them the right exit for their needs asap. Anything more is wasting their time.
If we can solve their need in two pages that&#039;s perfect; Any more suggests we&#039;ve failed somewhere.
Slight hyperbole. Well a lot actually, but you get the idea. :-)
Ideally we&#039;d solve their need in one page, but legals won&#039;t let us....

Ditto on my personal site to a large degree - single page - no engagement wanted or even desirable. I would rather see greater engagement, via discussion, on the mailing list I host, than the website.
Which leads me to (re) think that I probably need to do more to make the list more obvious. Thanks! :-)

- Steve</description>
		<content:encoded><![CDATA[<p><i>Have you found it to work well regardless of the traffic level of the page?</i></p>
<p>Strictly? No. Generally? Yes.<br />
Why &#8220;No&#8221;? <img src='http://www.benry.net/blog/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' />  If &amp; When Exits == 0. Division by Zero is a no no. <img src='http://www.benry.net/blog/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' /><br />
I fudge around that by finding the max &#8220;ratio&#8221; from all other ratios from all pages and substituting that instead. Yeah it&#8217;s a nasty fudgy hack&#8230;<br />
As with any metric &#8211; really low numbers can throw things screwy. I find &gt; 30 entries is probably the useful limit. Any less is too &#8220;noisy&#8221;. Big numbers are no problem &#8211; tho you can get an averaging effect which swamps detail.<br />
I also base this off the &#8220;Entry Pages&#8221; so entry == 0 is not an issue.</p>
<p>I haven&#8217;t (yet) tried trending it over a period of time. Be interesting to see if it changed anything&#8230;</p>
<p>I suspect it would be wise to segment before generating the ratio, to really drill down, but for general KPI work is probably a Good Start(tm).</p>
<p>High Time visits? I&#8217;d agree with the sentiment. But is an &#8220;engaged user&#8221; an agreeable goal? On work&#8217;s site &#8211; no. Or rather, not really. Get &#8216;em in, and show them the right exit for their needs asap. Anything more is wasting their time.<br />
If we can solve their need in two pages that&#8217;s perfect; Any more suggests we&#8217;ve failed somewhere.<br />
Slight hyperbole. Well a lot actually, but you get the idea. <img src='http://www.benry.net/blog/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' /><br />
Ideally we&#8217;d solve their need in one page, but legals won&#8217;t let us&#8230;.</p>
<p>Ditto on my personal site to a large degree &#8211; single page &#8211; no engagement wanted or even desirable. I would rather see greater engagement, via discussion, on the mailing list I host, than the website.<br />
Which leads me to (re) think that I probably need to do more to make the list more obvious. Thanks! <img src='http://www.benry.net/blog/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' /> </p>
<p>- Steve</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: benry</title>
		<link>http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/comment-page-1/#comment-3109</link>
		<dc:creator>benry</dc:creator>
		<pubDate>Mon, 30 Apr 2007 04:43:52 +0000</pubDate>
		<guid isPermaLink="false">http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/#comment-3109</guid>
		<description>Thanks for taking the time to comment Steve.

I like the suggestion from Eric&#039;s Hacks -- forgot about that one. Will have to take a look at it again. Have you found it to work well regardless of the traffic level of the page? Does the effectiveness change if trended over longer periods of time?

Either methods work for me for the Bounce Rate / Time Spent on Pages. Not sure the viewing of pages over time long periods of time is all that common on the site I&#039;m measuring, but worth deeper eval. Doubtful most users are viewing this way. Both Jim Novo and Brian Eisenberg would say that high time visits are typically reflective of a more engaged user. That was our thinking in including it.

Agree with Exit Ratio. You can easily end up with a one-to-one. We had examples like this with our RRSP content. We ranked high in search engines for the information. People came to our site. Got the answer and left. Not a problem with the page really from a content perspective but it was from an inability to move the reader towards some further engagement or conversion.

Thanks again,

- Scott</description>
		<content:encoded><![CDATA[<p>Thanks for taking the time to comment Steve.</p>
<p>I like the suggestion from Eric&#8217;s Hacks &#8212; forgot about that one. Will have to take a look at it again. Have you found it to work well regardless of the traffic level of the page? Does the effectiveness change if trended over longer periods of time?</p>
<p>Either methods work for me for the Bounce Rate / Time Spent on Pages. Not sure the viewing of pages over time long periods of time is all that common on the site I&#8217;m measuring, but worth deeper eval. Doubtful most users are viewing this way. Both Jim Novo and Brian Eisenberg would say that high time visits are typically reflective of a more engaged user. That was our thinking in including it.</p>
<p>Agree with Exit Ratio. You can easily end up with a one-to-one. We had examples like this with our RRSP content. We ranked high in search engines for the information. People came to our site. Got the answer and left. Not a problem with the page really from a content perspective but it was from an inability to move the reader towards some further engagement or conversion.</p>
<p>Thanks again,</p>
<p>- Scott</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Steve McInerney</title>
		<link>http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/comment-page-1/#comment-3105</link>
		<dc:creator>Steve McInerney</dc:creator>
		<pubDate>Mon, 30 Apr 2007 02:47:50 +0000</pubDate>
		<guid isPermaLink="false">http://www.benry.net/blog/2007/04/29/measuring-content-effectiveness/#comment-3105</guid>
		<description>FWIW? My at a glance view for content pages is from Eric&#039;s books of Hacks: #58. Specifically: &quot;4.6.4.2. Ratio of page entries to exits&quot;.

Set with a simple Red/Green flipper. Pages = &quot;1.0&quot; Green. Can obviously put an &quot;Orange&quot; (1.0 -&gt; 1.3 for example) in there if you need a maybe.

If&#039;s but&#039;s and maybe&#039;s around the use of this one.
Even so, I find it extremely useful to get a quick glace at what is vs isn&#039;t working. Been extremely accurate for me - both personally and @ work. Both being content sites.
Even works very nicely on pages that I regard as &quot;one hit wonders&quot;. ie If you see nothing else, see this one page. 1:1.

Works very effectively if you have Page A as a landing page and generic page B as the obvious exit.


&quot;Bounce Rate / Time Spent on Page in Seconds&quot;
I&#039;d need to see some numbers first as a qualifier - but wouldn&#039;t this be better off inverted (1/##)?
Why? We (as people :-) ) tend to associate high numbers with Good Things(tm), not bad - so playing more to the obvious psychology?
You may find some sort of inbuilt fudge factor useful to smooth numbers out to account for quick pages to read vs slow pages.

My gut feel tho, any metric dependent on &quot;Time on Page&quot; has an inbuilt (IMHO fatally flawed) assumption that people are *actually* looking at the page.
I&#039;ve worked for many years where I will open 5-10 pages off search results and gradually work my way through them. Possibly the last one may have been &quot;open&quot; for 10-20 minutes, or longer, before I actually read anything off it.
I&#039;d argue this behaviour is more prevalent on content sites vs shopping style. Happy to be proven wrong.
And I could be weird. It&#039;s been noted before. ;-)


&quot;Exit Ratio&quot;?
You could also suggest that an end user found exactly what they were looking for and didn&#039;t need to go any further. ie 1:1 again. That could be a sign of perfect success. Perhaps not for &quot;your&quot; site, but could be for &quot;mine&quot;; if you ken.


Thoughts?

- Steve</description>
		<content:encoded><![CDATA[<p>FWIW? My at a glance view for content pages is from Eric&#8217;s books of Hacks: #58. Specifically: &#8220;4.6.4.2. Ratio of page entries to exits&#8221;.</p>
<p>Set with a simple Red/Green flipper. Pages = &#8220;1.0&#8243; Green. Can obviously put an &#8220;Orange&#8221; (1.0 -&gt; 1.3 for example) in there if you need a maybe.</p>
<p>If&#8217;s but&#8217;s and maybe&#8217;s around the use of this one.<br />
Even so, I find it extremely useful to get a quick glace at what is vs isn&#8217;t working. Been extremely accurate for me &#8211; both personally and @ work. Both being content sites.<br />
Even works very nicely on pages that I regard as &#8220;one hit wonders&#8221;. ie If you see nothing else, see this one page. 1:1.</p>
<p>Works very effectively if you have Page A as a landing page and generic page B as the obvious exit.</p>
<p>&#8220;Bounce Rate / Time Spent on Page in Seconds&#8221;<br />
I&#8217;d need to see some numbers first as a qualifier &#8211; but wouldn&#8217;t this be better off inverted (1/##)?<br />
Why? We (as people <img src='http://www.benry.net/blog/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' />  ) tend to associate high numbers with Good Things(tm), not bad &#8211; so playing more to the obvious psychology?<br />
You may find some sort of inbuilt fudge factor useful to smooth numbers out to account for quick pages to read vs slow pages.</p>
<p>My gut feel tho, any metric dependent on &#8220;Time on Page&#8221; has an inbuilt (IMHO fatally flawed) assumption that people are *actually* looking at the page.<br />
I&#8217;ve worked for many years where I will open 5-10 pages off search results and gradually work my way through them. Possibly the last one may have been &#8220;open&#8221; for 10-20 minutes, or longer, before I actually read anything off it.<br />
I&#8217;d argue this behaviour is more prevalent on content sites vs shopping style. Happy to be proven wrong.<br />
And I could be weird. It&#8217;s been noted before. <img src='http://www.benry.net/blog/wp-includes/images/smilies/icon_wink.gif' alt=';-)' class='wp-smiley' /> </p>
<p>&#8220;Exit Ratio&#8221;?<br />
You could also suggest that an end user found exactly what they were looking for and didn&#8217;t need to go any further. ie 1:1 again. That could be a sign of perfect success. Perhaps not for &#8220;your&#8221; site, but could be for &#8220;mine&#8221;; if you ken.</p>
<p>Thoughts?</p>
<p>- Steve</p>
]]></content:encoded>
	</item>
</channel>
</rss>
