Great topic DG! I’ve moved it to a dedicated thread 
Some people think (processed) sugar is the devil - and I’d probably agree! Even ‘natural’ sugar in foods like fruit is much higher than what our ancestors would have consumed - but moving to fruits from candy is of course much better (in part, because fruit contains enzymes which help you digest it).
With regards to the main question, I do not consume any processed sugar myself (or processed food for that matter - I make everything from scratch). I’ll only have a bit of fruit in the summer - because I know I’ll be doing a lot of walking and so will work off any excess calories/negate some of the downsides.
Keep in mind carbs basically become sugar too - potatoes are actually higher on the glycemic level that sugar itself!! (So mininising carbs could be a nice next step for you? 
)