HOBBY ENGINE KILLER WHALES SAILBOAT
Not sure I replied to the right place. I sail and race RC Yachts. Looking at the pictures can’t see how the sails are controlled. But it looks like you have a few other problems.
Does the main boom and the line controlling it clear the hand rails?
With the shape of main sail just above the boom it’s not going to sail to windward unless you can reduce the the curve at the bottom to about 20 to 30 mm in the middle of the boom. Similar on the jib probably a bit less can’t tell scale from picture. Check if you can achieve that before investing in servos and winches. I agree with the others your best bet is to take it to a club where they can explain things better than a few words here. If you want to learn to sail have a look at the Joysway DragonForce 65 you can check on The MYA website for local clubs.
These are just my suggestions for starters
Good luck