Let us create a 3D eBook for you!
Let us create a 3d Digital eBook for you! DigyCat.com

Spam Filters Explained


What do they do? How do they work? Which one is right for me?By Alan Hearnshaw

Spam is a very real problem that many people have to deal with on a daily basis. For those that have decided to do something about it and start to investigate the options available in spam filtering, this article provides a brief introduction to your options and the types of spam filters available.

Despite the bewildering array of spam filters available today, all claiming to the best one "of its kind" there are really just five filtering methodologies in general use today and all products rely on one, or a combination of these:

Content-Based Filters

"In the beginning, there were content-based filters."

These filters scan the contents of the and look for tell-tale signs that the message is spam. In the early days of spamming it was quite simple to look out for "Kill Words" such as "Lose Weight" and mark a message as spam if it was found.

Very soon though, spammers got wise to this and started resorting to all kinds of tricks to get their message past the filters. The days of "obfuscation" had begun. We started getting messages containing the phrase "L0se Welght" (Notice the zero for "o" and "l" for "i") and even more bizarre - and sometimes quite ingenious - variations.

This rendered basic content-based filters somewhat ineffective, although there are one or two on the market now that are clever enough to "see through" theses attempts and still provide good results.

Bayesian Based Filters

"The Reverend Bayes comes to the rescue"

Born in London 1702, the son of a minister, Thomas Bayes developed a formula which allowed him to determine the probability of an event occurring based on the probabilities of two or more independent evidentiary events.

Bayesian filters "learn" from studying known good and bad messages. Each message is split into single "word bytes", or tokens and these tokens are placed into a database along with how often they are found in each kind of message.

When a new message arrives to be tested by the filter, the new message is also split into tokens and each token is looked up in the database. Extrapolating results from the database and applying a form of the good reverend's formula, know as the a "Naive Bayesian" formula, the message is given a "spamicity" rating and can be dealt with accordingly.

Bayesian filters typically are capable of achieving very good accuracy rates (>97% is not uncommon), and require very little on-going maintenance.

Whitelist/Blacklist Filters

"Who goes there, friend or foe?"

This very basic form of filtering is seldom used on its own nowadays, but can be useful as part of a larger filtering strategy.

A "whitelist" is nothing more than a list of e-mail addresses from which you wish to accept communications. A whitelist filter would only accept messages from these people and all others would be rejected

A "blacklist", conversely, is a list of e-mail addresses - and sometimes IP Addresses (computer identification addresses) - from which communications will not be accepted.

While this may seem like a good idea from the outset, a whitelist methodology is too restrictive for most people and, as virtually all spam e-mails carry a forged "from" address, there is little point in collecting this address to ban it in future as it is very unlikely to be the same next time.

There are bodies on the internet that maintain a list of known "bad" sources of e-mail. Many filters today have the ability to query these servers to see if the message they are looking at comes from a source identified by this Internet-based blacklist, or RBL. While being quite effective, they do tend to suffer from "false positives" where good messages are incorrectly identified as spam. This happens often with newsletters.

Challenge/Response Filters

"Open sesame!"

Challenge/Response filters are characterised by their ability to automatically send a response to a previously unknown sender asking them to take some further action before their message will be delivered. This is often referred to as a "Turing Test" - named after a test devised by British mathematician Alan Turing to determine if machines could "think".

Recent years have seen the appearance of some internet services which automatically perform this Challenge/Response function for the user and require the sender of an e-mail to visit their web site to facilitate the receipt of their message.

Critics of this system claim it to be too drastic a measure and that it sends a message that "my time is more important than yours" to the people trying to communicate with you.

For some low traffic e-mail users though, this system alone may be a perfectly acceptable method of completely eliminating spam from their inbox - one step above the "Whitelist" system outlined above.

Community Filters

"A united front"

These types of filters work on the principal of "communal knowledge" of spam. When a user receives a spam message, they simply mark it as such in their filter. This information is sent to a central server where a "fingerprint" of the message is stored.

After enough people have "voted" this message to be spam, then it is stopped from reaching all the other people in the community.

This type of filtering can prove to be quite effective, although it stands to reason that it can never be 100% effective as a few people have to receive the spam for it to be "flagged" in the first place. Just like its similar cousin the Internet black list (RBL), this system also can suffer from "false positives", or messages incorrectly identified as spam.

Hopefully you are now armed with a little more information to be able to make an informed decision on the best spam filter for you.

For further information, consider reading the reviews and articles found at http://www.whichspamfilter.com

Alan Hearnshaw is a computer programmer and the owner of http://www.whichspamfilter.com, a web site which conducts weekly in-depth reviews of current spam filters, provides help and guidance in the fight against spam and provides a useful community forum.alan@whichspamfilter.com


MORE RESOURCES:

Spam Blocker - Google News

This RSS feed URL is deprecated

This RSS feed URL is deprecated, please update. New URLs can be found in the footers at https://news.google.com/news

How To Block Robocalls: Automated Calls Are Rising, Here's How ... - International Business Times


International Business Times

How To Block Robocalls: Automated Calls Are Rising, Here's How ...
International Business Times
The Federal Trade Commission reported complaints about robocalls reached a new high in 2017. Here's how to block the unwanted calls from ringing your phone.

and more »

Cryptojacking Has Gotten Out of Control | WIRED - WIRED


WIRED

Cryptojacking Has Gotten Out of Control | WIRED
WIRED
Cryptojacking, which exploded in popularity this fall, has an ostensibly worthy goal: Use an untapped resource to create an alternative revenue stream for games or media sites, and reduce reliance on ads. It works by embedding a JavaScript component in ...

and more »

Digital publishers cry foul as Google exerts more control over an industry it already dominates - Times of India


Times of India

Digital publishers cry foul as Google exerts more control over an industry it already dominates
Times of India
Here's how the new Chrome browser ad blocking set-up will work: Chrome will have an ad blocker turned on by default. This will block "disruptive" or "intrusive" ads on web pages. Industry body Coalition for Better Ads (CBA), which Google joined this ...
An update on Better Ads | Web | Google Developers Google Developers
Microsoft removes Google's Chrome installer from the Windows Store The Verge

all 97 news articles »

Stop spam calls with the best call- and text-blocker apps - Digital Trends


Digital Trends

Stop spam calls with the best call- and text-blocker apps
Digital Trends
Unwanted calls and texts are a serious problem. There were almost 30 billion robocalls in the U.S. last year according to YouMail research. Thankfully, the Federal Communications Commission is acting to try and protect consumers from unwanted ...

T-Mobile's spam call blocking is coming to MetroPCS - The Verge - The Verge


The Verge

T-Mobile's spam call blocking is coming to MetroPCS - The Verge
The Verge
Back in March, T-Mobile introduced Scam ID and Scam Block, two features that help users avoid annoying robocalls, and now it's bringing the service to MetroPCS. Starting tomorrow, all MetroPCS users will automatically get Scam ID, the feature that ...
MetroPCS Fights Spam Calls Through Scam ID, Scam Block Android Headlines
MetroPCS customers get Scam ID and Scam Block this week TmoNews
Scam ID and Scam Block coming to Metro PCS to stop scammers ... 9to5Mac
T-Mobile Newsroom
all 19 news articles »

Verizon is charging for anti-spam features T-Mobile and AT&T give away for free - The Verge


The Verge

Verizon is charging for anti-spam features T-Mobile and AT&T give away for free
The Verge
More important, however, is the fact that competing carriers offer robocall and spam warnings to their subscribers for free. T-Mobile, for instance, even does so on a network level, so you don't have to download an extraneous app. T-Mobile announced ...

and more »

How to Stop Spam Calls Before You Kill Your Phone - Gizmodo


Gizmodo

How to Stop Spam Calls Before You Kill Your Phone
Gizmodo
Nomorobo, which is used by some carriers, just launched on iOS and identifies spam calls in a similar way—it will set you back $1.99 a month, but unlike Hiya, it won't touch your contacts or call history. Meanwhile, Should I Answer? is free for ...

BT's spam blocker IDs accident claims as top nuisance call • The ... - The Register


The Register

BT's spam blocker IDs accident claims as top nuisance call • The ...
The Register
BT's free spam filter, launched earlier this year to crack down on nuisance calls, has identified accident claims as the worst offender for nuisance calls with 12 million made in the first week of March. Some two million customers have signed up to the ...

and more »

How to block spam on your phone | Fox News - Fox News


Fox News

How to block spam on your phone | Fox News
Fox News
Ting! You've received a new message. You put down your shopping bags, dig into your pocket and pull out your smartphone — and then you frown, because it's from a phone number you've never seen in your life, and the message reads: “REAL ROLEX 90% OFF!”

and more »

LargeFriends.com - the best dating site for plus-sized singles!
SuccessfulMatchCentral.com - the best dating site for plus-sized singles!

PreLaunchX

DigyCat Domain Is For Sale - $105,000 For Enquiries eMail Us

© www.DigyCat.com - 2012

home | site map | links