In most cases, if the question has great answers, it's probably because it was in response to a great question. However, it's possible for low-quality questions to have high-quality answers, and that would be a case where you probably wouldn't want to upvote the question.
There's an intentionally small amount of guidance on when you should vote on posts, because it's often subjective. The primary bit of guidance that the site gives on reasons to upvote/downvote are the tooltips:
This question shows research effort; it is useful and clear
This question does not show any research effort; it is unclear or not useful
If you think a question meets one of these criteria, feel free to vote. Just make sure you're voting on the quality of the content, and not on the user (that would be voting fraud).
