Autonomous vehicle controls using Reinforcement Learning

Authors

  • Mukesh Iyer  Department of Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon Savitribai Phule Pune University, Pune, Maharashtra, India
  • Jai Baheti  Department of Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon Savitribai Phule Pune University, Pune, Maharashtra, India
  • Rajmohan Bajaj  Department of Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon Savitribai Phule Pune University, Pune, Maharashtra, India
  • Nilesh Nanda  Department of Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon Savitribai Phule Pune University, Pune, Maharashtra, India
  • Dr. Sunil Rathod  Department of Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon Savitribai Phule Pune University, Pune, Maharashtra, India

Keywords:

OpenAI Gym, Reinforcement Learning, CarRacing-v0

Abstract

In this paper, we explore a reinforcement learning algorithm to train an agent to drive a vehicle in the OpenAI Gym environment called CarRacing-v0. Gym is an open-source repository created by OpenAI which provides a toolkit for developing and comparing various Reinforcement learning algorithms. The gym library is a collection of environments that can be used to work out reinforcement learning algorithms. Learning to drive in the CarRacing-v0 environment is challenging since it requires the agent to finish the continuous control task by learning from pixels. To tackle this challenging problem, we explored an approach called Deep Q Learning. In this paper we further demonstrate a method to train the agent which learns from raw pixels without providing any hand-crafted features. Some minor environment specific changes were made but the base agent was not provided any knowledge regarding car racing.

References

  1. Silver, D., Huang, A., Maddison, C. et al. Mastering the game of Go with deep neural networks and tree search. Nature 529, 484–489 (2016). https://doi.org/10.1038/nature16961
  2. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller. arXiv:1312.5602. https://arxiv.org/abs/1312.5602
  3. Mnih, V., Kavukcuoglu, K., Silver, D. et al. Human-level control through deep reinforcement learning. Nature 518, 529–533 (2015). https://doi.org/10.1038/nature14236
  4. Shashank Kotyan, Danilo Vasconcellos Vargas, Venkanna U. Self Training Autonomous Driving https://arxiv.org/abs/1904.12738
  5. Wal, Douwe van der and Wenling Shang. “Advantage Actor-Critic Methods for CarRacing.” (2018). https://esc.fnwi.uva.nl/thesis/centraal/files/f285129090.pdf
  6. Simon Kardell, Mattias Kuosku, “Autonomous vehicle control via deep reinforcement learning”, 2017
  7. Alex Kendall, Jeffrey Hawke, David Janz, Przemyslaw Mazur, Daniele Reda, John-Mark Allen, Vinh-Dieu Lam, “Alex Bewley, Amar Shah “Learning to Drive in a Day”, September 2018
  8. Mayank Bansal, Alex Krizhevsky, Abhijit Ogale, “ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst”, December 2018
  9. Nihal Altunas, Erkan Imal, Nahit Emanet, Ceyda Nur Ozturk, “Reinforcement learning-based mobile robot navigation”, March 2016.

Downloads

Published

2020-04-30

Issue

Section

Research Articles

How to Cite

[1]
Mukesh Iyer, Jai Baheti, Rajmohan Bajaj, Nilesh Nanda, Dr. Sunil Rathod "Autonomous vehicle controls using Reinforcement Learning" International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN : 2395-1990, Online ISSN : 2394-4099, Volume 5, Issue 10, pp.34-38, March-April-2020.