Dear all,
The 1st series of computer exercises are now available on Moodle in week 2. Like the theory exercises, the computer exercises are also designed solely for educational purposes, so you do NOT need to submit a solution.
Each series of computer exercises include analyses of different RL algorithms in a specific environment. In the 1st series, you are going to do a lot of fun analyses for decision-making in a T-maze. The analyses should be completed over a course of a few weeks in parallel with the theory exercises. In each week's exercise sheet, we specify which analyses you need to complete for that week.
Since "Machine Learning" (CS-433) is among the required courses of our class, we expect you to be familiar with setting up your Python environment, installing necessary dependencies, and working with Jupyter notebook, etc. In case you have not passed that course or forgot the materials, please check the setup guide prepared by the teaching team of "Machine Learning" (CS-433): https://github.com/epfml/ML_course/blob/master/labs/ex01/python_setup_tutorial.md
All the best,
Your TAs
