It can help but I wouldn't recommend wearing a brace during squats unless you are going for PRs or a more serious lifter. Over time it will weaken supporting muscles and ligaments/tendons while strengthening the major muscles which can lead to injuries. Make sure to sit back and shift your weight onto your heels, especially going down. Your descent should be really controlled and dont let you knees go valgus(inward towards each other) or let you knees get out in front of your toes. Go as low as you can controlled and if it hurts dont go that deep. I would do a lot of step ups onto something as high as you can without hurting and walking lunges if they dont hurt and other single leg exercises to strengthen the knee joint. Especially single leg glute exercises, weighted single leg bridge hip extensions are a good exercise for people with knee pain from squatting. You obviously should get strain in muscles weight lifting and should get soreness but should not get sharp pain and/or swelling.
It can be hard to tell people what to do/adjust without watching them move though and without knowing where the soreness is coming from. But I would guess that doing squats, even just light ones with good form and single leg stuff, especially glute stuff will help alleviate your knee soreness over time.