Difference between revisions of "Common CanIt User Tasks"

From Roaring Penguin
Jump to: navigation, search
(From the Inbox)
(From the WebUI)
Line 64: Line 64:
 
==From the WebUI==
 
==From the WebUI==
  
By default you can create these from the Home page of the WebUI using the Accept and Reject List box (this is available by default for all users with web access, but can be disabled as well).
+
By default you can create these rules proactively from the Home page of the WebUI using the Accept and Reject List box (this is available by default for all users with web access, but can be disabled as well). The links beneath this box allow you to manage and delete existing rules of each type.
  
 
You can also create these rules in response to specific incidents if you are using the pulldown lists for action selection (as opposed to radio button) and if you administrator allows these as an option.
 
You can also create these rules in response to specific incidents if you are using the pulldown lists for action selection (as opposed to radio button) and if you administrator allows these as an option.
  
Manual blacklisting and whitelisting rules can also be created under Rules->Sender, Rules->Domains, and Rules->Networks (not available to users by default) for the relevant level of scope. You create a rule by entering the address into the text field at the top and clicking Add Rule. It will then ask you to specify what to do for that address/domain/IP, when the rule should expire, and a brief description of why you created the rule.
+
The rules can also be created under Rules->Sender, Rules->Domains, and Rules->Networks (not available to users by default) for the relevant scope. You create a rule by entering the target into the text field at the top and clicking Add Rule. It will then ask you to specify what to do for that address/domain/IP, when the rule should expire (optional), and a brief description of why you created the rule (optional).
  
These pages will also allow you to view and modify existing rules. Those that where generated from the inbox or quarantine will have a comment with the Incident ID that the rule was created for automatically added. Once all of the changes are made to your liking, make sure that you click the Submit Changes button at the bottom.
+
These pages, which is also where the links under the Accept and Reject List box point, will allow you to view and modify existing rules. Those that where generated from the inbox or quarantine will have a comment with the Incident ID that the rule was created for automatically added. Once all of the changes are made to your liking, make sure that you click the Submit Changes button at the bottom.
  
 
=Create Additional Rules=
 
=Create Additional Rules=

Revision as of 13:34, 18 April 2017

Main article: Quick Start Guide

The following are suggestions on how to perform frequent tasks applicable to a CanIt end-user.

Please Note

The options within this guide may or not apply to you, depending on your version of CanIt and how it has been set up by the e-mail administrator. If you can't find something as described but think that you need it, consult your administrator; there may be a reason that you don't have it

Manage Your Quarantine

Quarantined messages can be accepted or rejected. When you perform these actions, the message is trained into our Bayes Database for content analysis which makes the scanner better at identifying spam in the future. You may also be allowed to Block or Always-Allow the Sender or Domain so that mail from them in the future will either be rejected or accepted automatically when they are received.

From the Inbox

If you are set up to receive notification emails it will contain voting links beside each entry. You may or may not have all of the above options available. By clicking the voting link for each item the changes should automatically be applied. This may require you to log in to the WebUI to register the vote, but if a window opens to acknowledge the vote without asking you to log in, you can simply ignore it.

You can click on the Subject of the message to be shown its contents in the WebUI if you are able to log in. See the next section for advanced tools.

From the WebUI

The pending messages in your quarantine will be immediately visible from the Home page as well as being categorized and searchable from the Quarantine page. The messages visible on the Home page are messages that were deemed to be suspicious, but not egregiously so, and are pulled from the more detailed Quarantine->Pending. You can also select the Spam, Non-Spam or All pages from the Quarantine menu to see messages that you have already been (manually or automatically) rejected or (only manually) accepted. Mail that initially scored below the quarantine threshold is not stored in the WebUI except if you have the Archive available.

From Home, Quarantine, or the individual incident pages there will be a drop-down menu or series of radio buttons that will let you accept or reject any of the trapped messages (except those that have already been resolved; only admins can re-open incidents by default). From Home or Quarantine you will need to click Submit Changes before these will take effect. With drop-down menus you may additionally have the ability to Always-Accept, or Block options for the sender and/or domain.

See Why a Message Was Trapped

From either the Home or Quarantine section you will be able to click on the subject of messages to see the body contents. You can then click on See Incident Details at the top of the page (or the Date column from the list view) to get detailed information on how the message scored. It is helpful to note the Incident ID if you are going to see help from an admin (IDs are case-sensitive).

At the bottom of the incident page is a list of all of the rules that were triggered by the message. The most common reason a message is blocked will be if it triggered the Bayes statistical analysis. This is the probability that it is spam based on content analysis and is represented by the list of coloured words at the very bottom. The overall likelihood is listed next to the spam score as a percentage.

Many other test may be listed above this in a form like:

# RULE_NAME      Human-readable description of rule

The value assigned by each rule can be overridden if you have access to Rules->Score Overrides, or by addressing the rule's specific page.

Stop Messages From Being Trapped/Let Through

As mentioned, the most common reason for a message to be trapped is because of content analysis using Bayesian Analysis. We at Roaring Penguin run what we call the Roaring Penguin Training Network (RPTN) - a massive database consisting of all of combined judgement of all of our participating members. By participating, your CanIt system benefits from millions of votes, creating a very accurate set of general rules on what the content of spam emails look like. That being said, your organization receives a unique sub-set of all of the mail on the internet and so rules that fit the rest of the world may not fit you exactly. This is why it is important that you still train your own system, even though it has so much inherited knowledge. Your votes will allow us to acknowledge when content that looks spammy to you, but not to others (or vice versa).

Any time that you accept a message from your quarantine, this is done automatically; teaching the system that messages which resemble the one you released are good. Likewise, if you reject a pending message it will reinforce the assumptions that the scanner made about its content and will make similar messages even more likely to be caught in the future.

If a spam has already made it to your inbox without being trapped, you will likely have the ability to vote it as spam from the CanIt footer that is generally added to the content of the email itself.

If you find that you consistently have the same types of good messages trapped or bad messages let through over an extended period, a special rule may be in order.

Rules can be created under the Rules menu in the WebUI which may or may not be available to you as a user. For more on this, see Block and Always-Allow Rules, as well as Create a Additional Rules below.

Block and Always-Allow Rules

Block and Always-Allow rules are absolute. Messages that trigger either of these will not go through any scanning. They will either be automatically discarded in the former case or automatically accepted in the latter. As such, you need to be careful with them. The exception to this is that Always-Allowed items will still be discarded if they contain viruses or will still be filtered normally if they fail an SPF check.

Blocking senders or domains is often not as useful as you might initially think. Spammers tend to generate new sender addresses for every message they send, and so you will rarely receive two spams from the same sender. Blacklists are most appropriate for things like recurring newsletters and ads from e-retailers or other similar senders whose unsubscribe process is too tedious. This discussed in more depth in our discussion of why we do not allow for bulk creation of these rules.

You should also use some caution when creating Always-Allow rules as well. Allowing an entire domain is rarely advisable, especially for common domains like gmail.com or hotmail.com. Even for senders, however, there is a level of danger because spammers are capable of spoofing the address of one of your common contacts, or can infect one of their machines. If either of these is the case for a contact that you have allowed the spam will make it through unchecked. Messages sent using this tactic are often the most malicious and we have an article on them here. We also refuse to enforce Allow rules for your own domain for the same reason, also discussed here.

If you are worried about adding absolute rules like these, see Creating Additional Rules below.

From the Inbox

Block and Always-Allow rules can be created from the your inbox using the voting links in the footers added to regular mail or from the action list in the notifications if the admin has made these available to you.

Because blocking is often useless, as described above, a blacklist entry generated in this manor is automatically given a 30 day expiry. If you would like to make a permanent Block rule you can do so in the WebUI or request one from your administrator.

From the WebUI

By default you can create these rules proactively from the Home page of the WebUI using the Accept and Reject List box (this is available by default for all users with web access, but can be disabled as well). The links beneath this box allow you to manage and delete existing rules of each type.

You can also create these rules in response to specific incidents if you are using the pulldown lists for action selection (as opposed to radio button) and if you administrator allows these as an option.

The rules can also be created under Rules->Sender, Rules->Domains, and Rules->Networks (not available to users by default) for the relevant scope. You create a rule by entering the target into the text field at the top and clicking Add Rule. It will then ask you to specify what to do for that address/domain/IP, when the rule should expire (optional), and a brief description of why you created the rule (optional).

These pages, which is also where the links under the Accept and Reject List box point, will allow you to view and modify existing rules. Those that where generated from the inbox or quarantine will have a comment with the Incident ID that the rule was created for automatically added. Once all of the changes are made to your liking, make sure that you click the Submit Changes button at the bottom.

Create Additional Rules

This is something that you may want to - or need to - request from your administrator. A limited number of rule options will be available to regular Users under the Rules category.

Country Rules

Country rules can be set in Rules->Countries and they allow you to apply scores in the same way as custom rules specifically to messages originating from a country. It is important to note that these decisions are made based on server locations, not top-level-domains. Mail is often relayed through countries other than those that they originate from and so your points may end up being applied or missed where you might not expect.

Attachment Extensions

Rules->MIME Types allows you to create rules for types such as "application/html".

Rules->Filename Extensions can be used to manage attachments based on their extensions. CanIt will detect not only the immediate file extensions, but also those within archives. Virus transmission is extremely common with many Microsoft file formats such as .exe, .msi, and .bat, so these are blocked by default as well as the rest of these extensions. You could override these with your own rules for the same extensions, but that is not advisable.

You can add your own by entering the extension without the dot in the text field at the top, clicking Add Rule, then applying an action for whitelisted sender and a general action for all other sender. Be sure to Submit Changes when you are done. If you > to the file extension CanIt will look for that extension only if it is contained within an archive (.zip, .rar, etc.).

Other formats such as Microsoft Office documents and PDFs are common carriers of viruses. CanIt does have facilities in place to scan for viruses built into Office Macros as well as to scan for links, however some malicious content may continue to come through using this vector. If you do not anticipate needing these files via email, you may consider blocking them.

Custom/Compound Rules

The most flexible and powerful are Custom Rules and Compound Rules. These let you identify a wide variety of aspects of a message including the Header content, Body content and a wide variety of other fields. You can create arbitrary rules for words, phrases and even pattern matching with regular expressions and add or subtract your desired number of points if they are triggered. Compound Rules are a more complex, they allow for more fields to be searched and the use of logic operators such as AND and OR to match multiple criteria. These rules allow you to do things like adding or removing points if certain words are in the body; add additional score if multiple low scoring tests are hit; block messages that are similar to your domain but not the same.

Some of these rules can be tricky to manage and you should not hesitate to consult an administrator before trying to make rules of your own.

Continue to: Common CanIt User Problems