Yes, you can.
Please refer to the following for detailed instructions.
Related: Replace/Delete Registered Images and Videos (Web Browser Version)
https://teachme.jp/8/manuals/8080589
You can also replace the video thumbnail image.
Related: Edit video thumbnail (Web Browser)
https://teachme.jp/8/manuals/8081051