Skip to main content

Machine Unlearning #5 (Reinforcement Learning)

Machine Unlearning is a series broken up into tiny, one-minute readable pieces to humor our ever-shortening attention span. Sharing the links to every single piece right below:


Reinforcement Learning is a slightly different learning model than the other techniques that we have discussed previously. Therefore, I wouldn’t be able to explain the same using the fruit basket example that we have been using all this while. Let’s replace apples and oranges with self-driving cars!


Suppose that you are at Google or Tesla and are trying to train a car to drive by itself! How would you go about that? Driving requires the knowledge of much more than turning the ignition on and steering the wheel. You should know to keep the side of the road, to stop at the red signal, or to keep off the footpath, for instance.


You decide not to overwhelm the poor machine by laying out all the rules at once. Instead, you take an “on the fly” approach, by letting the car take decisions in a real-time manner, and by giving feedback on the merit of the decision taken.


If the car stops at a red light, you reward it by giving positive feedback. If the car sways off the road and runs over people sleeping on the footpath, you punish it by giving it negative feedback. The car learns by repeating the decisions that gave it positive feedback and avoiding the decisions that gave it negative feedback.


Now, for the real world story. My mother - a brown-skinned Indian - used to be teased by some of her brown-skinned relatives, for being dark-skinned. As a result, she grew up with the notion that dark-skinned was bad (negative feedback). Whenever she used to try out a bright colored outfit, they would chide her by saying that the bright colors did not compliment her complexion. The repeated feedback reinforced this belief in her mind, and she resorted to wearing pale-colored clothes during the colorful years of her youth. It took her years of unlearning to realize that dark colors did in fact suited her well.


Not just her relatives, but the teachers at her school, who are supposed to be implanting progressive thoughts in young minds, were guilty of reinforcing regressive ideas. She used to recall accounts of the nuns who ran the Convent School she was a student of slut-shaming students for coming to school with a bright bindi on their forehead. Sweet Jesus!
Labels:

Comments

Post a Comment

Popular posts from this blog

First Rejection

About four years ago, I self-published my first novel, I Want Your Life . Self-publishing was not my initial plan. Like most aspiring writers, I envisioned my book being published under the label of one of the prominent publishing houses in the country, such as Penguin or HarperCollins. However, my editor gave me a reality check and explained that large publishing houses receive several submissions daily, making it highly unlikely for a first-time writer to get noticed. More than the prestige of being published under an established banner, my excitement lay in seeing my story in the form of a book. So, I chose the self-publishing route. After months of back-and-forth with my publishing team - proofreading, editing, revisions, illustrations, book registration, and printing - my book was finally out. It was truly a dream come true. The upside of self-publishing is the sweet certainty of getting published. The downside, however, is that you are responsible for everything, including promot...
1 comment
Read more

Rajasthan: Part 1 (Center-left)

Why do we travel? I can think of a few reasons: to catch a glimpse of life beyond the familiarity of our homes, to taste new flavors, to experience landscapes and weather patterns different from our own, to witness natural wonders and man-made marvels, to meet interesting people, and to hear new words. Khamma Ghani is the phrase we decided to hear this time around. The first step in making a travel plan is, of course, choosing the destination. Everything else - the timing, the things to pack, the number of leave days needed, and any legal processes - depends on where we intend to go. Thanks to the constant exposure to travel vloggers, we have a bucket list of destinations we hope to explore someday. The list gets updated every now and then, with current entries ranging from international destinations like Vietnam, Japan, and Italy to domestic ones like Meghalaya and Ladakh. Rajasthan was never at the top of our list. True, it is one of the most heavily promoted destinations on India...
Post a Comment
Read more

an Exclusive Inclusivity

Inclusivity is a popular term in modern-day discourse. Quite literally, the term inclusive refers to the habit of including everything or all types of people—irrespective of their backgrounds, beliefs, or personal preferences—as long as one’s actions do not cause harm to anyone else. Inclusivity is relevant because it ensures equity, social cohesion, and diversity of thought, which is why most modern-day progressive societies aspire to be as inclusive as possible. So that everyone feels welcome. So that no one feels left out. If you have watched Modern Family, you might know what I am talking about. The show has taken the example of a family and has beautifully incorporated inclusivity into it. You see a divorcee, an interracial couple, a homosexual couple adopting an orphan child, a person who loves dogs living with a person who doesn’t, and your good old traditional family—all living in harmony. Sure, they have their differences. But nobody belittles anyone for their choice of life. ...
Post a Comment
Read more