50% of the time, i was travelling on my own so didn't have to worry about anyone else, the rest was with some friends. The biggest issue i had we people trying to nick your flipflop when going swimming!
But you never went....
Been to both places, never encountered any real issues, there are much worse places in Brazil. Heard lots and lots of horror stories before i went. My advise to anyone going is just been extra vigilant and if the area doesn't feel right or the people you are with, then leave.
Plus its during the Olympics, the security presents will be huge. If you have no concerns about zika, for anyone who wants to visit, this is the best time to go in terms of safety.