If the axle nut is tightened, the tensioner position would be locked in place.
See post #9 here for how to replace just the broken bolt: JB Weld on Chain Adjuster? | Honda Rebel 250 & 450 Forum (hondarebelforum.com)
Jacks Rebel Warehouse likely will have used ones, ebay may have new and used and partzilla.com or a Honda dealer will have new ones. CMX250 chain adjuster for sale | eBay
Honda 40543-KR3-000 - CHAIN ADJUSTER | Partzilla.com
See post #9 here for how to replace just the broken bolt: JB Weld on Chain Adjuster? | Honda Rebel 250 & 450 Forum (hondarebelforum.com)
Jacks Rebel Warehouse likely will have used ones, ebay may have new and used and partzilla.com or a Honda dealer will have new ones. CMX250 chain adjuster for sale | eBay
Honda 40543-KR3-000 - CHAIN ADJUSTER | Partzilla.com