This article covers the security and privacy framework for Finalsite Chat at the administrator level, including how the AI and human moderation system works, how to act on reported content, and what HIPAA and data protection policies apply.
💡Quick answers
- Where is flagged content reviewed and acted on? In the CMS, navigate to Mobile Apps > Chat > Message moderation. Flagged messages appear here for admin review and action.
- How does a user report a message? Long-press the message in the app, tap Report, and select a reason. The report is sent immediately to administrators for review in the moderation dashboard.
- Is Finalsite Chat HIPAA-compliant? No. Protected health information must not be transmitted through Chat. Direct families and staff to use a HIPAA-compliant platform or secure email for medical documents.
- What happens to messages that contain profanity? They are blocked automatically before sending, and the sender is notified of the violation. No admin action is required.
- Are edited or deleted messages retrievable? Yes. Finalsite maintains a comprehensive archive of all platform communications, including edited and deleted messages. Contact Finalsite support to request records for compliance or safety purposes.
- Is school chat data used to train AI models? No. Chat data is analyzed in real time for safety but is never used to train AI models. See How Chat moderation works for the full privacy breakdown.
Security and privacy in Finalsite Chat
At Finalsite, ensuring the privacy and security of your community is our top priority. Robust privacy settings are in place ensuring that your community's data is protected with care and integrity. Please view our Privacy Policy to learn more and contact us at privacy@finalsite.com with any questions or concerns. We strive to maintain a safe chat environment for productive engagement between users and teachers.
HIPAA and health security
It is our policy that no protected health information (PHI) subject to the Health Information Portability and Accountability Act (HIPAA) be disclosed through our platform. For transmitting medical documents, we recommend the following:
- utilize a HIPAA-compliant database to ensure the highest level of security.
- request that parents and guardians submit information including any protected health information via secure email.
How users can report inappropriate communication
Within the user's app, communication can be reported by users when found to be offensive or troublesome.
- To report communication, a user can hold down on a piece of communication until the quick menu appears and click Report. Select the reason why you are reporting this communication. Once reported, Chat administrators can decide whether the message will be deleted and manage this within Chat moderation.
   Â
How content moderation works
Our Chat moderation system includes proactive measures to ensure appropriate interactions:
- Active Monitoring: Continuous oversight by district and school administrators.
-
Flagging and Blocking: We utilize filters and blocklists to manage different types of content in the form of text, images, and videos.
- Flagging for Review: Text, images, and videos flagged by our AI model for toxicity, threats, or inappropriate language are reviewed by administrators.
- Immediate Blocking: Messages containing profanity are blocked before sending, with the sender notified of the violation.
Which content is flagged and/or blocked
Content subject to review or immediate blocking includes:
- Spam and promotions: Repetitive or promotional content not aligned with educational objectives.
- Personal information: Attempts to direct conversations away from the platform by sharing sensitive information.
- Toxicity and threats: Messages containing threats, insults, or attacks based on identity or protected characteristics.
- Obscenity and explicit content: Including sexually explicit material or vulgar language.
What and who can get blocked
Finalsite Chat employs extensive measures to maintain appropriateness:
- Blocked words: A comprehensive list of 10,000 prohibited words managed by AI to prevent their use.
- Blocked users: Users engaging in inappropriate behavior repeatedly will be temporarily blocked or permanently restricted from using the platform.
Comments
Please Sign in to leave a comment if you don't see the comment box below.