<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Restricted Boltzmann Machine &#8211; Short Tutorial</title>
	<atom:link href="http://imonad.com/blog/2008/10/restricted-boltzmann-machine/feed/" rel="self" type="application/rss+xml" />
	<link>http://imonad.com/blog/2008/10/restricted-boltzmann-machine/</link>
	<description>Software engineering, Functional programming, Predictive Analytics</description>
	<lastBuildDate>Tue, 03 Nov 2009 15:54:47 -0500</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: chef-ele</title>
		<link>http://imonad.com/blog/2008/10/restricted-boltzmann-machine/comment-page-1/#comment-53</link>
		<dc:creator>chef-ele</dc:creator>
		<pubDate>Thu, 09 Oct 2008 16:44:31 +0000</pubDate>
		<guid isPermaLink="false">http://imonad.com/blog/?p=65#comment-53</guid>
		<description>Here&#039;s some nit-picky editorial comments that might help clarify the text (feel free to ignore these, though!): 

In the section that starts with &quot;The algorithm as a whole is:&quot;,  you do not have an explicit step that updates the weights &amp; biases.  The needed formulas are in a section above, where you wrote that &quot;CD = 0 - n&quot;  and  &quot;W’ = W + alpha*CD&quot;.  Copying those two lines into the list of steps for the algorithm would make the algorithm a bit clearer, I think.  

Next, on the diagrams, it might be helpful to explicitly label the blue nodes as visible nodes &amp; the brown nodes as hidden nodes. 

Also, when you say, &quot;Si.Sj is just a multiplication of current activation (state) of neuron I and neuron J&quot;   it might be slightly clearer to explicitly say that Si is the state of a visible neuron, and Sj is the state of a hidden neuron.  This becomes more obvious later on, but at that point in the text one might think Si &amp; Sj could be the states of two different neurons in the same layer, which they&#039;re not.</description>
		<content:encoded><![CDATA[<p>Here&#8217;s some nit-picky editorial comments that might help clarify the text (feel free to ignore these, though!): </p>
<p>In the section that starts with &#8220;The algorithm as a whole is:&#8221;,  you do not have an explicit step that updates the weights &amp; biases.  The needed formulas are in a section above, where you wrote that &#8220;CD = 0 &#8211; n&#8221;  and  &#8220;W’ = W + alpha*CD&#8221;.  Copying those two lines into the list of steps for the algorithm would make the algorithm a bit clearer, I think.  </p>
<p>Next, on the diagrams, it might be helpful to explicitly label the blue nodes as visible nodes &amp; the brown nodes as hidden nodes. </p>
<p>Also, when you say, &#8220;Si.Sj is just a multiplication of current activation (state) of neuron I and neuron J&#8221;   it might be slightly clearer to explicitly say that Si is the state of a visible neuron, and Sj is the state of a hidden neuron.  This becomes more obvious later on, but at that point in the text one might think Si &amp; Sj could be the states of two different neurons in the same layer, which they&#8217;re not.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
