Good decision, Bronzaar. You actually have to remove the shift lever and then the cover. When you do, you'll discover the clutch slave cylinder and yet another cover which have to be removed as well before you can get at the from sprocket. If you want to get the chain off, you probably also have to loosen the rear axle and slide the wheel forward.
Mine never gets dirty if I don’t ride

Cleaning behind the sprocket cover every week does seem a bit excessive - to say the least

To be honest, I afraid to open up the front sprocket area. After seeing it, I might want to clean it more often. (like a curse)
For three years I lubed the chain of my CB500XA after every second day ride with chain oil that was suppose to be none fling. Someone had suggested placing a small magnet on the chain before rotating it so you tell when the lubed part came around. After the second one disappeared I decided to remove the front sprocket cover to retrieve them.
OH MY GOD! Everything was packed with grit and grease.
Took a lot of popsicle sticks and paper towels to get the worst of it out. Took a spray can of GUNK engine cleaner and my spray washer to get the rest off. The curb had a long prism coloured puddle all the way down to the sewer cover where the two missing magnets found a home. Good thing the neighbourhood tree hugger was not around to see that.
I now use chain wax. Unlike chain oil this stays on the chain. No more grubby mess on the chain, chain guard, back wheel, and front spocket.
Mine got sorta cleaned when I replaced the chain and sprockets at 36,909 miles.
I use chain wax as well. Matter of fact this reminds me to spray some on before I ride down to the local coffee shop n about 30 minutes. I use it every 500-600 miles or if ridden in the rain.