In this part of the documentation, we will describe our overall integration effort that merges together the Reinforcement Learning (RL) algorithms, and relevant ROS and Gazebo packages. The framework introduced is called gym_gazebo and combines best of both worlds: the state of the art RL algorithms and all the necessary robotics tools such as diverse ROS packages for kinematics and control. To monitor the advancement of the training we utilize the Gazebo simulator.