Does WebMarshal support third party URL categorization and blocking lists?


This article applies to:

  • WebMarshal

Question:

Does WebMarshal support third party URL categorization and blocking lists?

Reply:

  • Yes, current supported versions of WebMarshal provide support for blocklist and site categorization functionality:
    • Automatically updated URL category listings (licensed through Trustwave):
      • Web Filter Database (previously known as Marshal8e6/M86 Filter List) (WebMarshal 6.5 and above)
      • Other lists that were previously supported are no longer available
    • The "FileFilter" facility. With FileFilter you can import URL category lists from text files. You can use any data source that you can transform into the required file format.
      • In WebMarshal 7,1 and above FileFilter supports domain wildcards. In earlier versions, FileFilter supports URL stemming but does not support wildcards. For details see the WebMarshal User Guide.
    • URLCensor. URLCensor generates URL categorizations based on information retrieved in real time from DNS Blocklist facilities.
  • All versions of WebMarshal provide automatic, customized generation of local URL category listings through the TextCensor lexical analysis technology. These listings can be used in rules to allow or deny access to sites.

For technical details of these items, please see the WebMarshal User Guide.

Note concerning URLCensor Licensing:

Most DNS Blocklist providers request that, if you generate a large volume of requests, you should set up a local caching DNS server. Providers may also require a subscription fee. For example, surbl.org requests that you use a local DNS server and subscribe to a feed if you generate more than a few hundred thousand requests per day. See the following for more information:

Trustwave provides the technology to query the SURBL information. Any licensing required to use this information should be arranged between the WebMarshal customer and the list provider.

This article was previously published as:
NETIQKB29694

Last Modified 6/28/2016.
https://support.trustwave.com/kb/KnowledgebaseArticle10064.aspx