Teaching

CMPUT365: Introduction to Reinforcement Learning

Instructor: Marlos C. Machado
Computing Science Department
University of Alberta
Fall 2025

An introductory course to reinforcement learning, which focuses on the study and design of learning agents that interact with a complex, uncertain world to achieve a goal. The course will cover multi- armed bandits, Markov decision processes, reinforcement learning, planning, and function approximation (online supervised learning).

CMPUT 503 - Experimental Mobile Robotics

Instructor: Matthew Taylor
Computing Science Department
University of Alberta
Winter 2025

An introductory course to experimental inquisition of the fascinating field of mobile robotics. It covers basic concepts, models, and algorithms in autonomous navigation of a mobile robot operating in indoor environments. Using ROS, it involves robot mapping, localization, path planning, object detection and homing.

CMPUT 366 - Search Planning in Artificial Intelligence

Instructor: Levi Lelis
Computing Science Department
University of Alberta
Fall 2024

An introductory course to search and planning in artificial intelligence. It covers deterministic single-agent and multi-agent problems; how to model real-world problems as state-space search problems and how to solve such problems. It covers algorithms for solving deterministic shortest path problems with combinatorial optimization problems, constraint satisfaction problems, and multi- agent problems.

MA108: Differential Equations

Department of Mathematics
Indian Institute of Technology Bombay
Spring 2022

An introductory differential equations course covering first-order and second-order differential equations, along with their applications. The course focuses on solving linear and nonlinear ODEs using various methods like separation of variables, integrating factors, and series solutions.