We released a fix for flagged comments today.
If you accidentally flag a comment, you can now unflag it! Once it's flagged it will look like this:
If you click on the blue FLAGGED button, you will be able to unflag the comment.
Let me know if you have any questions!