You can customize the favicon site-wide for a course.
- Edit your course
- Open Step 1: The Basics
- Upload an ICO file to the Site Icon area
Note: An ICO file is the only file type that will work for your favicon.

You can create an ICO file using this site here.