Home
About
Textbook Solutions
- RL 2nd ed Solutions
Reinforcement Learning
Machine Learning
Math
Publications

On this page

Recent Posts

fromscratch

Welcome to my technical blog/website!

Here I turn my exploration of ideas into shareable knowledge.

To learn more about me, check out about.

Recent Posts

Implementing Proximal Policy Optimization in JAX

In this article we will go in depth into implementing PPO using JAX. You can find the code repository here.

Convolutional Neural Networks

CNNs are quite common in computer vision tasks. Ranging from simple classification between digits in the MNIST dataset to performing robotic manipulation from vision using…

Inverse Kinematics: Pose from Point instead of Point from Pose

Point at your nose. In how many ways can you orient your arm and index finger to accomplish this?

Alireza Azimi, Veronika Ivanytska

Determining Camera XY-Axis in MuJoCo

In mujoco schemas you can define camera objects like the following:

Forward Kinematics: A robotics classic

Have you ever tried to pinpoint the exact position of your hand in 3D space just by looking at it? It’s not so easy! In robotics, knowing the precise location of an end-effec…

Alireza Azimi, Veronika Ivanytska

No matching items

❤️ Support Ukraine 🇺🇦