Deep reinforcement learning : a study of the CartPole problem

Budai Ádám; Csorba Kristóf: Deep reinforcement learning : a study of the CartPole problem.

[thumbnail of cscs_2018_030-033.pdf]
Előnézet
Cikk, tanulmány, mű
cscs_2018_030-033.pdf

Letöltés (454kB) | Előnézet

Absztrakt (kivonat)

One of the major challenges of artificial intelligence is to learn solving tasks which are considered to be challenging for even a human. Reinforcement learning is the most general learning framework among the three main type of learning methods: supervised, unsupervised and reinforcement learning. Most of the problems can easily fit into this framework. Experience shows that a lot of machine learning methods with non-linear function approximators suffers from instability regarding convergence. Reinforcement learning is more prone to diverge due to its ability to change the structure of its training data by modifying the way how it interacts with the environment. In this paper we investigate the divergence issue of DQN on the CartPole problem in terms of the algorithm’s parameters. Instead of the usual approach we do not focus on the successful trainings but instead we focus on the dark side where the algorithm fails on such an easy problem like CartPole. The motivation is to gain some further insight into the nature of the divergence issues on a specific problem.

Mű típusa: Konferencia vagy workshop anyag
Befoglaló folyóirat/kiadvány címe: Conference of PhD Students in Computer Science
Dátum: 2018
Kötet: 11
Oldalak: pp. 17-20
Konferencia neve: Conference of PhD students in computer science (11.) (2018) (Szeged)
Befoglaló mű URL: http://acta.bibl.u-szeged.hu/59477/
Kulcsszavak: Számítástechnika - előadáskivonat, Algoritmus - előadáskivonat
Megjegyzések: Bibliogr.: 20. p. ; összefoglalás angol nyelven
Feltöltés dátuma: 2019. okt. 28. 10:01
Utolsó módosítás: 2022. nov. 08. 10:18
URI: http://acta.bibl.u-szeged.hu/id/eprint/61754
Bővebben:
Tétel nézet Tétel nézet