I would like to implement a feature in a digital community that would allow users to send chats to other users. The target application is mobile phones, and the idea is that they would use these chat features to communicate privately (either group or pm) instead of using an external chat application like Touch or Kik (or whatever the craze is this week).

However, in order to do that, I would need to replicate a number of the features these other apps have, which in order to remain appealing would almost certainly have to include sending pictures, perhaps video. Even though the community is built up around a game, it would still require these social features to remain on the users' radar.

I certainly don't want my users to feel like they're spied upon. But in an age where kids are getting felony charges for sexting eachother, I certainly wouldn't want to get accused of facilitating child pornography because a couple of my underage users hooked-up. And honestly, considering I met my wife on an online game myself, I wouldn't necessarily want to discourage adult conversations over such a communications channel.

How can I balance legal issues and rule obedience with users' privacy over a 'private' communication channel between two users?

  • 1
    Note that, for the legal aspects, you really need to consult a lawyer. Providing a private communication channel between users, while avoiding or limiting legal liability for any content transmitted thereby, is a complex subject that requires in-depth knowledge of local laws and judicial practices. Such specific legal issues are outside the scope of this site, and probably not something that anyone responding to your question here would be qualified to answer definitively. Commented Aug 6, 2014 at 13:53

3 Answers 3


How do you moderate private communication channels?


  1. Add a Flag as Offensive button to the receiving user's interface, and when they press it, you let a moderator read that individual communication in order to decide what action to take.

  2. Add a Flag as Spam button to the receiving user's interface, and when they press it, you let a moderator read it and the most recent messages by the sender in order to decide what action to take.

If you're worried about users sending inappropriate images, then don't allow them to upload the images to your site, this will mean the users will have to upload it on a public image hosting site which should have the software and resources to effectively moderate against illegal content.

  • 4
    I both like and dislike the last section. On the one hand, outsourcing it definitely gives you a certain legal protection by moving the responsibility to either the host the user picks, or to the user themself. On the other hand, if privacy is the primary concern here, "encouraging" users to use other services might be counter intuitive.
    – user98085
    Commented Aug 5, 2014 at 22:07
  • I could just as easily let them use the third party services. But I'd like to keep them engaged in -MY- app, not some third party app.
    – corsiKa
    Commented Aug 5, 2014 at 22:47
  • 1
    @corsiKa There's no reason they have to see where the images go, for example the StackExchange image upload feature uses the Imgur API without ever going off-site from the user's perspective.
    – MrLore
    Commented Aug 5, 2014 at 22:57
  • +1, if a channel is private it should remain as such (maybe you are also prohibited by your local law to read them). adding a flag-button with a message, that will tell the user that it will be read. if the user links to a questionable image it might be the same consequences as if it's uploaded at your page - in this case you should ask a lawyer how to secure yourself
    – jwacalex
    Commented Aug 6, 2014 at 0:09
  • "and the most recent messages by the sender" that part sounds problematic privacy wise. A receiver shouldn't have the right to give a moderator access messages not addressed to that particular receiver. Commented Aug 7, 2014 at 12:00

You don't monitor private communications. One of the moderators of Ars Technica had a post about how Ars handled the public compilation of Edward Snowden's posts on their forums. He notes the readers reaction to how these posts (which were public) were handled:

The Ars community reaction was mixed, but there was a significant subset of users—many of which were folks who'd been posting at Ars for 10+ years—who felt shocked and betrayed that Ars would spotlight a poster's public posting history like that, even though none of the information was private in any sense of the word. [...] The general reaction to "exposing" a user's public data, even a user who was unquestionably an enormously important and newsworthy figure like Snowden, included a very large amount of community anger.

This clearly highlights the user's expectations, even for thier public posts. Private channels should remain private. If a user is being threatened, abused, stalked, etc. over a private channel you can have a "Report" button that forwards the communication to the moderators. The remainder of the messages remain private, but the communication thread that needs to be acted upon is now available for moderators to see. The user's expectation of privacy (regardless of whether you grant them that in your terms of service) remains intact, as they have taken the step to include you in this one instance that needs to be resolved.

The Ars moderator continues:

If Ars had grepped through the database to also look at his account's private messages, which we did not, that rage would have been far greater—and, in my opinion, it would be completely justified.

Ars had a story about a very public individual and likely has information this individual created on their system. Yet, they are unwilling to even look at that information for fear of violating their community's trust. This is a very powerful factor. If your community can't trust you, as the leadership of the community, there is no point in sticking around.


Do not monitor private communication channels. The users will expect that only the recipient and themselves can read the message, and nobody else. Attempting to monitor these communications is an invasion of privacy, and almost defeats the purpose of having a private communication channel.

I propose that you implement one of the following protocols in your system:

  • Blocking. Give users the ability to stop others from communicating them. It may be wise to track how often a user is blocked, as this can be a sign that he is breaking the rules. Ignoring is another term that is very similar to this.

  • Reporting. Billy may block/ignore Joe only due to personal preference, not due to a rule violation. However, to make it easier to track down rule breakers, implementing a reporting function will be helpful. The reported message can then be read by moderators, but only that message.

  • Want to avoid inappropriate images and/or videos? The reporting feature will help, but the best way to avoid this is to not implement a feature for uploading videos and images. If you feel this is a necessary feature, perhaps make this something the user can unlock. (Similar to how moderation features work on SE)

These are common features that users know how to use, and understand that a reported message will be read by a moderator. Users expect privacy for these kinds of communications, and attempting to monitor them will backfire. The above features will allow you to keep private communications in line with the community guidelines.

  • As I mentioned to MrLore, I'd like keep people in my app and engaged in the game's community rather than outsource it to a third-party app.
    – corsiKa
    Commented Aug 5, 2014 at 22:49
  • on an internet based game I don't expect privacy when I am messaging another user in-game I expect that a moderator can look at my chat record if they suspect that I am cheating. so I don't type anything on the internet I don't expect to be seen by people on the internet.
    – Malachi
    Commented Aug 5, 2014 at 23:11
  • 2
    @corsiKa then you can make it something users unlock, kind of like moderation features here
    – Tanner
    Commented Aug 5, 2014 at 23:17
  • @Malachi: on an internet based game I don't expect privacy when I am messaging another user in-game I expect that a moderator can look at my chat record if they suspect that I am cheating At least in germany the moderator or whoever allowed him to read the message can get in a lot of legal trouble, chats and messages have to be kept private. Only the receiver can mark it as offensive, then it can be looked into.
    – user248
    Commented Aug 6, 2014 at 19:10
  • if it is in the ToS that if you are suspected of cheating that they can look, then they can look.
    – Malachi
    Commented Aug 7, 2014 at 16:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.