<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: I predict a riot (based on a single study)</title>
	<atom:link href="http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/feed/" rel="self" type="application/rss+xml" />
	<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/</link>
	<description>Neuroscience and psychology news and views.</description>
	<lastBuildDate>Mon, 20 May 2013 15:51:40 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
	<item>
		<title>By: cig</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26657</link>
		<dc:creator><![CDATA[cig]]></dc:creator>
		<pubDate>Sun, 22 Apr 2012 10:06:30 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26657</guid>
		<description><![CDATA[Maybe you should revise the wording in the article itself to say this for the benefit of future readers who may not read the comments. I was as confused as ficial and started wondering if you had turned quack.]]></description>
		<content:encoded><![CDATA[<p>Maybe you should revise the wording in the article itself to say this for the benefit of future readers who may not read the comments. I was as confused as ficial and started wondering if you had turned quack.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Eric Charles</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26645</link>
		<dc:creator><![CDATA[Eric Charles]]></dc:creator>
		<pubDate>Sat, 21 Apr 2012 22:32:23 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26645</guid>
		<description><![CDATA[It is important to distinguish failures-to-replicate that occur because there is a real problem (psuedoscience, fabrication, etc.), from failures-to-replicate that are inevitable in a statistics-driven science. So, if this effort finds 1 out of 100 studies fail to replicate, that will actually beat expectations. On the other hand, I suspect it will be more &lt;i&gt;much&lt;/i&gt; worse than that. 

If psychology was acting like a real science, and the rate of replication failures was low, we would &lt;i&gt;not&lt;/i&gt; consider non-replication as a failure. We would consider the author of the original study to be a good, hard working member of the field, and the person who did the replication a good, hard working member of the field. We would also appreciate it if, assuming the issue was deemed important, a third researcher did a more comprehensive study to settle the matter. If the third party had more than enough power for the non-replication to be conclusive, that wouldn&#039;t be a failure either.]]></description>
		<content:encoded><![CDATA[<p>It is important to distinguish failures-to-replicate that occur because there is a real problem (psuedoscience, fabrication, etc.), from failures-to-replicate that are inevitable in a statistics-driven science. So, if this effort finds 1 out of 100 studies fail to replicate, that will actually beat expectations. On the other hand, I suspect it will be more <i>much</i> worse than that. </p>
<p>If psychology was acting like a real science, and the rate of replication failures was low, we would <i>not</i> consider non-replication as a failure. We would consider the author of the original study to be a good, hard working member of the field, and the person who did the replication a good, hard working member of the field. We would also appreciate it if, assuming the issue was deemed important, a third researcher did a more comprehensive study to settle the matter. If the third party had more than enough power for the non-replication to be conclusive, that wouldn&#8217;t be a failure either.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jared</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26641</link>
		<dc:creator><![CDATA[Jared]]></dc:creator>
		<pubDate>Sat, 21 Apr 2012 18:40:09 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26641</guid>
		<description><![CDATA[Reblogged this on &lt;a href=&quot;http://philosophyandpolity.com/2012/04/21/452/&quot; rel=&quot;nofollow&quot;&gt;PHILOSOPHY &amp; POLITY&lt;/a&gt; and commented: 
Courtesy of Mind Hacks.]]></description>
		<content:encoded><![CDATA[<p>Reblogged this on <a href="http://philosophyandpolity.com/2012/04/21/452/" rel="nofollow">PHILOSOPHY &amp; POLITY</a> and commented:<br />
Courtesy of Mind Hacks.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: vaughanbell</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26636</link>
		<dc:creator><![CDATA[vaughanbell]]></dc:creator>
		<pubDate>Sat, 21 Apr 2012 07:58:13 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26636</guid>
		<description><![CDATA[Discovering that an effect does not hold by not replicating the study is valued less in scientific and career terms than the first reporting of the data.

This is what drives the &#039;file drawer effect&#039; and is why replications (or non-replications) are hard to publish.

So non-replication is a success for science (because we have more data about the world) even if it is a failure for the original theory.

Unfortunately, these two aspects are not considered sufficiently separately at the moment.]]></description>
		<content:encoded><![CDATA[<p>Discovering that an effect does not hold by not replicating the study is valued less in scientific and career terms than the first reporting of the data.</p>
<p>This is what drives the &#8216;file drawer effect&#8217; and is why replications (or non-replications) are hard to publish.</p>
<p>So non-replication is a success for science (because we have more data about the world) even if it is a failure for the original theory.</p>
<p>Unfortunately, these two aspects are not considered sufficiently separately at the moment.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Warren Davies</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26632</link>
		<dc:creator><![CDATA[Warren Davies]]></dc:creator>
		<pubDate>Fri, 20 Apr 2012 17:53:01 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26632</guid>
		<description><![CDATA[It&#039;s a superb idea. I worry when single studies get widely disseminated, because maybe if something seems popular and widely used it&#039;s easier to assume that it&#039;s well supported.

Regardless of whether people are happy I think we have to do it... I know it&#039;s hard but researchers must be less attached to the outcome of their work as they are to the process. Put all your effort and pride in the process and let the chips fall where they may.]]></description>
		<content:encoded><![CDATA[<p>It&#8217;s a superb idea. I worry when single studies get widely disseminated, because maybe if something seems popular and widely used it&#8217;s easier to assume that it&#8217;s well supported.</p>
<p>Regardless of whether people are happy I think we have to do it&#8230; I know it&#8217;s hard but researchers must be less attached to the outcome of their work as they are to the process. Put all your effort and pride in the process and let the chips fall where they may.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: ficial</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26628</link>
		<dc:creator><![CDATA[ficial]]></dc:creator>
		<pubDate>Fri, 20 Apr 2012 13:15:40 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26628</guid>
		<description><![CDATA[&quot;Unfortunately, psychology and science in general still see a non-replication as a failure (in fact, we even use the term ‘failed replication’).

This is clearly nonsense and checking the original finding is equally as valuable if the new data agree with, or disagree with, the original study.&quot;

Would you please expand on this point? My that reproducibility is a foundation of science, so I don&#039;t understand the &#039;unfortunately&#039; in the first paragraph, nor the &#039;this is clearly nonsense&#039; in the second.]]></description>
		<content:encoded><![CDATA[<p>&#8220;Unfortunately, psychology and science in general still see a non-replication as a failure (in fact, we even use the term ‘failed replication’).</p>
<p>This is clearly nonsense and checking the original finding is equally as valuable if the new data agree with, or disagree with, the original study.&#8221;</p>
<p>Would you please expand on this point? My that reproducibility is a foundation of science, so I don&#8217;t understand the &#8216;unfortunately&#8217; in the first paragraph, nor the &#8216;this is clearly nonsense&#8217; in the second.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: KamounLab</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26623</link>
		<dc:creator><![CDATA[KamounLab]]></dc:creator>
		<pubDate>Fri, 20 Apr 2012 06:37:33 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26623</guid>
		<description><![CDATA[&quot;Unfortunately, psychology and science still see a non-replication as a failure&quot; Srsly? That&#039;s called pseudoscience.]]></description>
		<content:encoded><![CDATA[<p>&#8220;Unfortunately, psychology and science still see a non-replication as a failure&#8221; Srsly? That&#8217;s called pseudoscience.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: neurobonkers</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26614</link>
		<dc:creator><![CDATA[neurobonkers]]></dc:creator>
		<pubDate>Fri, 20 Apr 2012 00:06:24 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26614</guid>
		<description><![CDATA[I don&#039;t think there is a dispute that as a matter of principle this a good thing, the point made above as I understand it is that it will take a long time before this may take off because of old fashioned attitudes to the value of replications.

Also, if you don&#039;t think this is going to cause a stir check out the recent &lt;a title=&quot;http://neurobonkers.com/2012/03/08/a-yale-professors-one-man-rampage-against-plos-the-internet-and-a-cambridge-research-group/&quot; href=&quot;http://neurobonkers.com/2012/03/08/a-yale-professors-one-man-rampage-against-plos-the-internet-and-a-cambridge-research-group/&quot; rel=&quot;nofollow&quot;&gt;Bargh&lt;/a&gt; affair.]]></description>
		<content:encoded><![CDATA[<p>I don&#8217;t think there is a dispute that as a matter of principle this a good thing, the point made above as I understand it is that it will take a long time before this may take off because of old fashioned attitudes to the value of replications.</p>
<p>Also, if you don&#8217;t think this is going to cause a stir check out the recent <a title="http://neurobonkers.com/2012/03/08/a-yale-professors-one-man-rampage-against-plos-the-internet-and-a-cambridge-research-group/" href="http://neurobonkers.com/2012/03/08/a-yale-professors-one-man-rampage-against-plos-the-internet-and-a-cambridge-research-group/" rel="nofollow">Bargh</a> affair.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: ANG Guy</title>
		<link>http://mindhacks.com/2012/04/19/i-predict-a-riot-based-on-a-single-study/#comment-26613</link>
		<dc:creator><![CDATA[ANG Guy]]></dc:creator>
		<pubDate>Thu, 19 Apr 2012 22:14:20 +0000</pubDate>
		<guid isPermaLink="false">http://mindhacks.com/?p=22165#comment-26613</guid>
		<description><![CDATA[&quot;Rusty&quot;???  I would think the headshrinkers would jump up and down in joy that someone is going to the trouble of adding legitimacy to their field...  Unless there actually are significant problems...

Almost all the &quot;hard&quot; science types I have ever met consider all social sciences a joke.  There has been a lot of progress in the last 15 years, especially in new technologies to aid in cognitive research.  This is GOOD news.]]></description>
		<content:encoded><![CDATA[<p>&#8220;Rusty&#8221;???  I would think the headshrinkers would jump up and down in joy that someone is going to the trouble of adding legitimacy to their field&#8230;  Unless there actually are significant problems&#8230;</p>
<p>Almost all the &#8220;hard&#8221; science types I have ever met consider all social sciences a joke.  There has been a lot of progress in the last 15 years, especially in new technologies to aid in cognitive research.  This is GOOD news.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
