avatarFrancisco Iglesias

Free AI web copilot to create summaries, insights and extended knowledge, download it at here

2834

Abstract

/a> as the most robust model (<a href="https://arxiv.org/abs/1706.06083">Madry et al.</a>). This fact highlights just how far away we are from robust recognition models – even for simple handwritten digits.</p><p id="c3ca">In our <a href="https://arxiv.org/abs/1805.09190">recent paper</a>, we introduce a new concept to classify images robustly. The idea is very simple: if an image is classified as a seven, than it should contain roughly two lines – one shorter, one longer – that touch each other at one end. That’s a generative way to think about digits, which is pretty natural for humans and which allows us to easily spot the signal (the lines) even amidst large amounts of noise and perturbations. Having such a model should make it easy to classify the adversarial examples featured above into the correct class. Learning a generative model of digits (say zeros) is pretty straightforward (using a <a href="https://arxiv.org/abs/1606.05908">Variational Autoencoder</a>) and, in a nutshell, works as follows: we start from a latent space of nuisance variables (which might capture things like thickness or tilt of the digit and are learnt from the data) and generate an image using a neural network. We then show examples of handwritten zeros and train the network to produce similar ones. At the end of training, the network has learnt about the natural variations of handwritten zeros:</p><figure id="9127"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*Y6O2le5_-9PLg_n4iWN_6w.png"><figcaption>A generative model of zeros learns the typical variations of handwritten digits (right side).</figcaption></figure><p id="3e0c">We learn such a generative model for each digit. Then, when a new input comes along, we check which digit model can best approximate the new input. This procedure is typically called <i>analysis-by-synthesis</i>, because we <i>analyse</i> the content of the image according to the model that can best <i>synthesise</i> it. Standard feedforward networks, on the other hand, have no feedback mechanisms to check whether the input image really resembles the inferred class:</p><figure id="e38b"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*qfe00YnTC58Up5hOmVuC8g.png"><figcaption>Feedforward networks directly go from image to class and have no way to check that the classification makes sense. Our analysis-by-synthesis model checks what image features are present and classifies according to which class makes most sense.</figcaption></figure><p id="f1e5">That’s really the key difference: feedforward networks have no way to check their predictions, you have to trust them. Our analysis-by-synthesis model, on the other hand, looks whether certain image features are really present in the input before jumping to a conclusion.</p><p id="031b">We do not need a pe

Options

rfect generative model for this procedure to work. Our model of handwritten digits is certainly not perfect: look at the blurry edges. Nonetheless, our model can classify hand-written digits with high accuracy (99,0%) and its decisions make a lot of sense to humans. For example, the model will always signal low confidence on noise images, because they don’t look like any of the digits it has seen before. The images closest to noise that the analysis-by-synthesis model still classifies as digits with high confidence make a lot of sense to humans:</p><figure id="5507"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*fjhRFQkEFDMWuwwFv2tEaQ.png"><figcaption>We tried to synthesise unrecognisable images that are still classified as zeros with high confidence by our analysis-by-synthesis model. This is the best we got.</figcaption></figure><p id="b7c5">In the current state-of-the-art model by Madry et al. we found that minimal perturbations of clean digits are often sufficient to derail the classification of the model. Doing the same for our analysis-by-synthesis model yields strikingly different results:</p><figure id="f6b0"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*aedBhqczyEb_pd4y9ubzEg.png"><figcaption>Adversarial examples for the analysis-by-synthesis model. Can you guess what the original number was?</figcaption></figure><p id="7e30">Note that the perturbations make a lot of sense to humans and it is sometimes difficult to decide into which class the image should be classified. That’s exactly what we expect to happen for a robust classification model.</p><p id="5452">Our model has several other notable features. For example, the decisions of the analysis-by-synthesis model are much easier to interpret as one can directly see which features sway the model towards a particular decision. In addition, we can even derive some lower bounds of its robustness.</p><p id="7ce5">The analysis-by-synthesis model does not quite match human perception yet and there is still a long way to go (see the full analysis in our <a href="https://arxiv.org/abs/1805.09190">manuscript</a>). Nonetheless, we believe these results are extremely encouraging and we hope that our work will pave the way towards a new class of classification models that are accurate, robust and interpretable. We still have to learn a lot about these new models, least of all how to make inference more efficient and how to scale them to more complex data sets (like CIFAR or ImageNet). We are working hard to answer these questions and are looking forward to sharing more results with you in the future.</p><h2 id="7aaa">Towards the first adversarially robust neural network model on MNIST</h2><p id="284d">Lukas Schott, Jonas Rauber, Matthias Bethge, Wieland Brendel arXiv:1805.09190</p></article></body>

My Top 5 Must Reads Of the Day #37

And Why I Recomend It

image created by author

Are you tired of sifting through countless articles on Medium, searching for the ones that truly stand out?

  • Look no further!

I have curated a list of the top 5 must-read articles on the platform.

  • You’ll find five exceptional articles that are sure to captivate your attention and leave you wanting more.

From intriguing concepts to valuable recommendations, each of these articles is a gem waiting to be discovered.

So grab a piping hot cup of your favorite coffee, and let’s embark on an electrifying adventure together as we uncover the crème de la crème on Medium.

All Editions Here

This is a My Special Top 50 Must reads

Do you want me to review your article and appear on my top 5 of the day? Let me know in the coments below!!!

  • Table of Content

· All The Mentions are here“Want to be the Hemingway of your generation? · Benefits for being part of my Top 5 of the day · Why consider to tip me?Top 1 Johnzelle AndersonIf You Don’t Use it, You Lose It A therapist helps his grandma overcome her fear of highwaysTop 2 George DillardWhat Will Replace America’s Fading Values? We’ve discarded outdated ideas, but we need to replace them with somethingTop 3 Karine SchomerHow a New Word Can Show You Realities You Never Imagined I’m fascinated with words. . . and totally promiscuous about it.Top 4 Wes O’DonnellThe Chances of Accidental Nuclear War Just Skyrocketed The United States and Russia have nearly stumbled into an accidental nuclear war at least ten times (that we know of).Top 5 Shelly FaganThe Jehovah Witnesses are Desperate The cult is spamming their message whether you want it or not. That’s harassment. · Final ThoughtsMy PreviousTop 5 Must Reads Of the Day · “Inside the Minds of Writers: Reflections on the Top 5 Must-Reads” · Are you loving the content I’m creating?

All The Mentions are here

Moneta Scribere Kate N Author Emily Alain Yunes Anthony Today The Shadows Creative Source Taylor Brazzill Elena Tucker Aurelia Bliss Annie Trevaskis Dranéa Nawazish Ali Sanpal David Sheehan Giovanni Cefalo Conjuga HIDEYO Vassilis Anagiannis Chiarra Sue Simon Pastor Nardine Eldalil Paul Obunga Cee Arr JotBeat IZenica Technologies LLC |Digital Marketing Agency Dan R. Green Owen W. Bharat Gami Top History Man Tomi Smith Ahmad Barry McKinney Despina Manendi Martin Jnr Pantelis Giamouridis Amethysta Hajra Ajmal Poets of Bosnia Daria Malinova Experiencing life as the way it is Jessica Penny WOLRAD My Complete Balance E Savaria H. Mikel Feilen Oliver M. Traveller Jack T. V. Knight Cynthia Ramirez PPwrites Michael Paland Skrdeal Elisabeth Roberts Stephen O’Connor Mikaela Millan Angelina Radulovic Ibrahim augustine Jazmine Clark Dr John Frederick Rose William Frick Destiny Twist Fran Murphy Lotus Empress 100 Pounds John Pearce Jane Tucker Steeve St Fleur Tina D’Angelo Paradoxon Shahidmuffakir Blogs by J Amy Potter Taytum Emberlynn Shafiq Sadiqi Adeyemi Bello Mochamad Renaldi America Zed⚡ Jamie Northrup — Minimalist Hustler Zachary K Semih Yiğit Atoufa Mohanna Donia Conni Walkup Hull

“Success as a writer on Medium is not about perfection or popularity, it’s about persistence and purpose. Keep sharing your unique voice, and trust that your words will find the audience they are meant to touch.”

“Want to be the Hemingway of your generation?

  • Don’t miss this article!

(We can’t promise you’ll grow a beard, but the exposure is guaranteed!)”

Benefits for being part of my Top 5 of the day

  • Increased visibility: By having your article reviewed and featured on the top 5 list, you’ll gain more visibility and exposure on Medium.
  • Valuable feedback: I will provide you with constructive feedback on your article, which can help you improve your writing skills and produce better content in the future.
  • Credibility boost: Being featured on a top 5 list can enhance your credibility as a writer and position you as an authority in your field.
  • Community engagement: By leaving a comment below, you’ll engage with a community of fellow writers and readers, who may provide you with additional feedback and support.
  • Motivation: Knowing that your article could potentially be featured on the top 5 list can be a great motivator to produce high-quality content and strive for excellence in your writing.

Why consider to tip me?

“If you enjoy the content I create, consider supporting me with a tip.

I truly appreciate your contribution and can’t wait to showcase your amazing work to our readers.

Thank you for being a valued member of our community!

With your support, I can invest more time and resources into creating even more exceptional content. Your contribution, no matter how small, means the world to me.

Thank you for your kindness and appreciation.”

Top 1

Johnzelle AndersonIf You Don’t Use it, You Lose It A therapist helps his grandma overcome her fear of highways

The article “If You Don’t Use it, You Lose It: A therapist helps his grandma overcome her fear of highways” is a touching and inspiring story that beautifully showcases the power of therapy and the importance of maintaining independence in old age.

As I read this story, I was struck by Johnzelle Anderson’s incredible writing skills and his ability to connect with us on a deep, emotional level.

The story revolves around Johnzelle Anderson’s grandmother, who was forced into retirement and struggled with anxiety and isolation as a result. Despite Johnzelle Anderson’s efforts to help his grandmother, her driving skills declined and she developed a paralyzing fear of highways.

Johnzelle Anderson’s decision to move his grandmother to Richmond and help her overcome her highway anxiety is a testament to the power of love and family, and the story’s ending is truly heartwarming.

What sets this article apart is Johnzelle’s skill in drawing readers in and making them feel invested in the story.

By sharing his own experiences and emotions, Johnzelle Anderson creates a deep connection with readers that is both moving and inspiring. Moreover,Johnzelle Anderson’s ability to write with clarity and precision makes this article a joy to read.

Overall, I would highly recommend this article to anyone who is looking for a touching and inspiring story that highlights the beauty of the human spirit. Johnzelle Anderson’s message of perseverance and the importance of maintaining independence in old age is one that everyone can relate to, and I believe that this article will resonate with readers of all ages.

Top 2

George DillardWhat Will Replace America’s Fading Values? We’ve discarded outdated ideas, but we need to replace them with something

As I read “What Will Replace America’s Fading Values?” , I was struck by George Dillard’s deep understanding of the complex issues facing United States today. George Dillard delves into the results of a recent Wall Street Journal poll, which found that traditional American values such as patriotism, religion, and community involvement are fading in importance for many Americans.

This, in turn, has created a sense of fragmentation and disconnection from the values and institutions that used to hold us together as a nation.

He Desserves a Great Coffee

Support George Dillard

Instead, he explores the reasons behind these shifts and asks what new values can replace the old ones.

He recognizes that many Americans have become disillusioned with traditional values and institutions, and that this is not necessarily a bad thing. After all, patriotism and religion have been cynically exploited in recent years, and many religious institutions have been exposed as hypocritical or even criminal. In addition, Americans are no longer “joiners” and have become disconnected from their communities.

What I appreciate most about George Dillard’s article is his thoughtful exploration of what new American values could look like.

He recognizes that we need something to replace the old values that are fading away, but also acknowledges that this will not be an easy task. He suggests that new values could focus on ideas such as empathy, compassion, and a commitment to the common good.

These values would help to bring Americans together, rather than divide us.

Overall, I highly recommend this article to anyone who is interested in the future of America and the values that will shape it. George Dillard is a skilled writer who tackles complex issues with clarity and insight, and his ideas about what new American values could look like are both creative and thought-provoking.

If you’re looking for an engaging and enlightening read, “What Will Replace America’s Fading Values?” is definitely worth checking out.

Top 3

Karine SchomerHow a New Word Can Show You Realities You Never Imagined I’m fascinated with words. . . and totally promiscuous about it.

As a lover of words, I found this article by the talented writer, Karine Schomer, to be a delightful and thought-provoking exploration of the power of language.

The way in which she describes the many types of words that fascinate her, from intellectual to slang to made-up words, reflects her deep appreciation for the diversity of human expression.

In this particular article,Karine Schomer recounts a conversation with a neighbor about the changing climate in California and the joy of cozying up indoors during the colder months. Her neighbor introduces her to the Danish word “hygge,” which captures the warm, comforting feeling of being wrapped up in a blanket with loved ones on a chilly evening.

Karine Schomer goes on to describe how the concept of hygge has been marketed and commodified in America, but also how it has opened up her mind to a new way of thinking about the ways in which humans adapt to and find joy in their environments.

  • She reminds us that a single new word can take us on a mental journey, allowing us to see the world in a new light.

I was struck by the beauty and skill of Karine’ writing, as well as her ability to connect with readers on a personal level. Her description of her own reaction to her neighbor’s love of cold weather and cozy nights indoors was both humorous and relatable. Her exploration of the cultural and neurological roots of hygge was both informative and engaging.

Overall, I highly recommend this article to anyone who loves words and is curious about the ways in which language shapes our perceptions of the world. Karine is a masterful storyteller who has the ability to make readers feel as though they are right there in the middle of the street with her and her neighbor, sharing in the joy of discovering a new word and a new way of thinking.

Top 4

Wes O’DonnellThe Chances of Accidental Nuclear War Just Skyrocketed The United States and Russia have nearly stumbled into an accidental nuclear war at least ten times (that we know of).

This article is a gripping and thought-provoking account of the growing risks of an accidental nuclear war between the United States and Russia. Wes O’Donnell makes a convincing case that recent developments, including the suspension of the New START treaty and the cessation of information sharing between the two countries, have increased the probability of such a catastrophic event.

With 12,700 nuclear weapons worldwide, and thousands of them on hair-trigger alert, an accident is statistically guaranteed to happen eventually.

Wes O’Donnell highlights the lack of communication between the world’s two largest nuclear powers, which raises the probability of a misunderstanding triggering an unwinnable war.

The article makes the reader reflect on the implications of this possibility, from the loss of human life to the impact on the environment and the global economy.

Wes O’Donnell’s writing style is clear and engaging, making the article accessible to a wide audience.

Wes O’Donnell also employs real-world examples, such as the 1983 Soviet satellite report and Carl Sagan’s concerns about a comet or asteroid hitting the US or Russia, to drive home the point that an accidental nuclear war is not just a theoretical possibility. The article also notes the lack of safeguards in Russia, which makes it more vulnerable to accidents, and the pitiful conventional warfighting capability of Russia in Ukraine, which increases its reliance on its nuclear deterrent.

Wes O’Donnell’s analysis is not all doom and gloom, however.

The article notes that the United States has taken steps to prevent accidental nuclear war, from mechanical safeguards to personnel reliability programs. Nevertheless, the article emphasizes that these measures may not be enough, especially given the recent breakdown in communication channels between the US and Russia.

It is a sobering reminder of the risks we face in a world where nuclear weapons are still in existence, and it highlights the urgent need for renewed efforts to reduce the risks of such a catastrophic event.

Wes O’Donnell’s skillful writing and use of real-world examples make the article engaging and accessible to a wide audience, and the implications of the article are relevant to everyone, regardless of their background or interests.

Top 5

Shelly FaganThe Jehovah Witnesses are Desperate The cult is spamming their message whether you want it or not. That’s harassment.

I was deeply moved and impressed by the writing skills of the author of “The Jehovah Witnesses are Desperate.”

Shelly Fagan tells a compelling story of being repeatedly harassed by the Jehovah Witnesses through letters, publications, and even drone deliveries. Shelly Fagan highlights the desperation of the Jehovah Witnesses to spread their message, even if it means ignoring people’s requests to be left alone.

I found myself nodding in agreement with Shelly Fagan’s frustration at being woken up by persistent proselytizers and receiving voicemails from a real estate broker who was actually just another Jehovah Witness trying to convert them.

Shelly Fagan’s experiences were so relatable, and I could feel their exasperation at the cult’s attempts to force their beliefs on others.

What really stood out to me was Shelly Fagan’s questioning of the cult’s methods, pointing out that tricking people into listening to their message hardly seems like something a benevolent God would condone.

  • Shelly Fagan’s writing style is clear and concise, making her points effectively and leaving a lasting impact.

I highly recommend reading this article, whether you’ve had personal experiences with the Jehovah Witnesses or not.

It’s a thought-provoking piece that raises important questions about the tactics of religious organizations and the boundaries of free will. Shelly Fagan’s bravery in speaking out against the cult’s harassment is inspiring, and I hope that her message will resonate with readers as it did with me.

Final Thoughts

The amalgamation of these articles serves up a tantalizing array of perspectives and fascinating insights on a wide spectrum of subjects.

The writers’ unparalleled viewpoints and astute comprehension enhance the conversation and leave a lasting impact.

  • Whether you crave to broaden your intellectual horizons, these articles proffer an unparalleled journey for each reader.

It’s a fruitful endeavor to dedicate your time to savoring the intricacies they unravel and uncovering the pearls of wisdom they hold.

My PreviousTop 5 Must Reads Of the Day

“Inside the Minds of Writers: Reflections on the Top 5 Must-Reads”

Are you loving the content I’m creating?

If so, I’d be forever grateful if you consider supporting me with a coffee.

I truly appreciate your contribution and can’t wait to showcase your amazing work to our readers.

Plus, I promise to put that money towards creating even more exceptional content!

Check out my Ko-fi page here:

https://ko-fi.com/franciscoiglesias88.

Top 5
Writing
Articles
Review
Viral
Recommended from ReadMedium