Skip to content
iLab: From Brain to Machine and Back

iLab: From Brain to Machine and Back

iossifidis Lab

  • Home
  • Research Projects
  • Publications
  • Software
  • Press and Media
  • Student’s Zone — Teaching
    • Thesis topics
    • Student Projects
    • Journal Club & Progress Club
    • Lab Course
    • Lectures – Vorlesungen
  • About us
    • The Team
    • Contact
    • Impressum
  • Home
  • 2021
  • March
  • 31
  • JournalClub: Exploration by Random Network Distillation

JournalClub: Exploration by Random Network Distillation

Posted on March 31, 2021 By felix No Comments on JournalClub: Exploration by Random Network Distillation
journal club

In my current project I encountered a stumbling block: inefficient/insufficient exploration. While not really useful as a solution to my problem I finally read this paper I had wanted to for a while. Here is the abstract:

Yuri Burda*, Harrison Edwards*, Oleg Klimov (all OpenAI), Amos Storkey (Univ. of Edinburgh) *main authors

We introduce an exploration bonus for deep reinforcement learning methods that is easy to implement and adds minimal overhead to the computation performed. The bonus is the error of a neural network predicting features of the observations given by a fixed randomly initialized neural network. We also introduce a method to flexibly combine intrinsic and extrinsic rewards. We find that the random network distillation (RND) bonus combined with this increased flexibility enables significant progress on several hard exploration Atari games. In particular we establish state of the art performance on Montezuma’s Revenge, a game famously difficult for deep reinforcement learning methods. To the best of our knowledge, this is the first method that achieves better than average human performance on this game without using demonstrations or having access to the underlying state of the game, and occasionally completes the first level.

Links:

Restricted Content
To view this protected content, enter the password below:

Tags: journalClub

Post navigation

❮ Previous Post: Hochschule Ruhr West startet Podcast, der Wissen schafft
Next Post: JournalClub: Human-Like Arm Motion Generation: A Review ❯

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recent Posts

  • Vom Rollator für Kinder zum intelligenten Bewegungs–From rollator for children to intelligent movement coach – BmBF.START-Interaktiv December 27, 2022
  • Game control using an EMG and EEG-based BCI October 15, 2022
  • Bacherlorarbeit: Artificial Muscle Signal Generation using Generative Adversarial Networks October 15, 2022
  • Iossifidis Lab at the Bernstein Conference 2022 September 29, 2022
  • Bernstein Conference 2022:Closed-loop adaptation of brain-machine interfaces using error-related potentials and reinforcement learning September 29, 2022

Recent Comments

    Copyright © Ioannis Iossifidis 2020 iLab: From Brain to Machine and Back.

    Theme: Oceanly by ScriptsTown

    We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
    Cookie SettingsAccept All
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
    CookieDurationDescription
    cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
    cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
    cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
    cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
    cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
    cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
    cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
    cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
    viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
    viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
    Functional
    Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
    Performance
    Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
    Analytics
    Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
    Advertisement
    Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
    Others
    Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
    SAVE & ACCEPT