I answered a question, but it doesn't follow with the majority's conjecture and is being downvoted. Should I just delete my answer? And if I do, will that reverse the negative reputation points?
Yes reputation is restored if you delete the question How is reputation archived
But much rather than deleting, you should try to improve your answer if possible instead. You can ask for a clarification in the comments from the down voters, in the chat, or even on meta.
So while we are at it. lets review your answer a bit
The answer on it self is not that bad, but it lacks sources. A theory is good and all, but try to back it up using source materials, statements they made, visuals or even the statements the author himself has give.
If you are unsure how you could do this, then take an example on the other given answers. Whom base it on the characters hair color/length, physical traits, introduced characters and the likes.
Don't let a few down-votes get to you. Just keep on answering, and try to improve your answers as you go.