Home
About
Textbook Solutions
RL 2nd ed Solutions
Blog
Publications
On this page
Recent Posts
Alireza Azimi
Recent Posts
Save yourself some time
There are no shortcuts to mastering anything.
Apr 14, 2026
Alireza Azimi
End of a Chapter
My master’s journey is finally nearing its end. I am preparing to defend my thesis on April 21.
Apr 14, 2026
Alireza
DQN JAX
It’s officially here. My implementation of DQN in JAX. I’m going to move away from the model of documenting everything here in the blog and keep things contained inside the…
Apr 14, 2026
Alireza Azimi
Implementing Proximal Policy Optimization in JAX
In this article we will go in depth into implementing PPO using JAX. You can find the code repository here.
Apr 14, 2026
Alireza Azimi
Working with Gradient Bandits
Apr 8, 2026
Alireza Azimi, Another Author
Parameterized Gradient Bandits
Apr 8, 2026
Alireza Azimi
Convolutional Neural Networks
CNNs are quite common in computer vision tasks. Ranging from simple classification between digits in the MNIST dataset to performing robotic manipulation from vision using…
Apr 8, 2026
Alireza Azimi
Forward Kinematics: A robotics classic
Have you ever tried to pinpoint the exact position of your hand in 3D space just by looking at it? It’s not so easy! In robotics, knowing the precise location of an
end-effec…
Apr 8, 2026
Alireza Azimi, Veronika Ivanytska
Determining Camera XY-Axis in MuJoCo
In mujoco schemas you can define camera objects like the following:
Apr 8, 2026
Alireza Azimi
Inverse Kinematics: Pose from Point instead of Point from Pose
Point at your nose. In how many ways can you orient your arm and index finger to accomplish this?
Jul 23, 2025
Alireza Azimi, Veronika Ivanytska
No matching items