Skip to main content

Machine Unlearning #5 (Reinforcement Learning)

Machine Unlearning is a series broken up into tiny, one-minute readable pieces to humor our ever-shortening attention span. Sharing the links to every single piece right below:


Reinforcement Learning is a slightly different learning model than the other techniques that we have discussed previously. Therefore, I wouldn’t be able to explain the same using the fruit basket example that we have been using all this while. Let’s replace apples and oranges with self-driving cars!


Suppose that you are at Google or Tesla and are trying to train a car to drive by itself! How would you go about that? Driving requires the knowledge of much more than turning the ignition on and steering the wheel. You should know to keep the side of the road, to stop at the red signal, or to keep off the footpath, for instance.


You decide not to overwhelm the poor machine by laying out all the rules at once. Instead, you take an “on the fly” approach, by letting the car take decisions in a real-time manner, and by giving feedback on the merit of the decision taken.


If the car stops at a red light, you reward it by giving positive feedback. If the car sways off the road and runs over people sleeping on the footpath, you punish it by giving it negative feedback. The car learns by repeating the decisions that gave it positive feedback and avoiding the decisions that gave it negative feedback.


Now, for the real world story. My mother - a brown-skinned Indian - used to be teased by some of her brown-skinned relatives, for being dark-skinned. As a result, she grew up with the notion that dark-skinned was bad (negative feedback). Whenever she used to try out a bright colored outfit, they would chide her by saying that the bright colors did not compliment her complexion. The repeated feedback reinforced this belief in her mind, and she resorted to wearing pale-colored clothes during the colorful years of her youth. It took her years of unlearning to realize that dark colors did in fact suited her well.


Not just her relatives, but the teachers at her school, who are supposed to be implanting progressive thoughts in young minds, were guilty of reinforcing regressive ideas. She used to recall accounts of the nuns who ran the Convent School she was a student of slut-shaming students for coming to school with a bright bindi on their forehead. Sweet Jesus!
Labels:

Comments

Post a Comment

Popular posts from this blog

Book Review : Scion Of Ikshvaku

Author : Amish Tripathi Genre : Mythological Fantasy Published On : 22 June 2015 Watch trailer on Youtube Buy Online! As the makers put it, this first installment of the Ram Chandra series is the most awaited literary blockbuster of the year. The frenzied wait had its effect on me, as I had pre-ordered a copy, days before its release. Obviously, the most weighted factor which prompted me into this craze was The Shiva Trilogy, the previous work of the boring banker turned happy author. Shiva Trilogy achieved its cult status for two major reasons: a) the plot being discussed offered a welcome change from the modern day love stories that had mushroomed up in the post Chetan era. b) The author had meticulously researched through Vedas and other ancient texts, and had reconstructed the very image of Shiva, into a very capable man rather than a miracle performing God. To quote the First City, Amish had succeeded on reintroducing Hindu mythology to the youth of t...
4 comments
Read more

The Plan

The son went and sat near his father. “It’s been a while, dad. How are things going?” “It really has been a while, hasn’t it? I stopped following time since God knows when.” “That’s quite unbecoming of you, dad. For what I know, you were someone who used to measure time and plan accordingly. Shall I say shrewd?” “I prefer meticulous. And yes, I used to measure time – every ounce of it. Each of my actions were prudently strategic. I wanted the best for myself and my folks.” “Are you telling me even I were a result of your deliberate planning? Interesting.” “You? Of course. Especially you. There was a time when my whole life was centered on you. I have had immense plans for you, even before you were born. Do you think you just happened to be born in the month of May?” “I am quite familiar with the nine months’ infancy phase, dad. I believe that though I came out only in May, I began to exist sometime in August, perhaps.” “That’s a way to look at it, righ...
2 comments
Read more

Chennai Tidbits

‘2/14, Salvation Army Guest House, Doveton St, Chennai’  this address followed by a ten digit phone number was all that I had of Mr. Nageshwar Rao, who was to become my roommate in my new 'home' that Chennai was. Vipin Das is my name, an employee of All India Radio, and I had been transferred from New Delhi to Chennai only a few days ago. So there I was, just outside the Chennai Central, drained and haggard after the grueling train journey that gifted me two sleepless nights. I approached an auto-rickshaw with baggage in my hands, and showed him the address I had. He asked me to get in, and I was traveling through the South Indian metro, a first time in my life. It was only six in the morning, and the city was just waking up. Some young professionals, probably long distance commuters, security guards, newspaper boys on cycle, trucks and light traffic were all I could see on road. I took out that card and dialed Mr. Rao. No response. Maybe he was still sleeping. After all, it...
2 comments
Read more