Anti-spam Systems and Techniques - Revision history

Leehw at 17:04, 8 December 2007

2007-12-08T17:04:32Z

← Older revision		Revision as of 17:04, 8 December 2007
Line 1:		Line 1:
	Now a days the email system has become the most significant technology and a useful tool for human beings in the world. In the US alone, 88% of adult users have email accounts and half of email users use email systems almost every day. However, like growing email users, spam, scam, and fishing emails are increasing. Lots of email providers, such as Gmail, Hotmail, have been making an effort to protect their users from spam, scam, and fishing emails. Accordingly, I’ll discuss some new techniques for anti-spam systems and how to improve the anti-spam system on the server through SPF (Sender Policy Framework), SenderID, Domain Keys, and DKIM(Domain Key Identified Mail).		Now a days the email system has become the most significant technology and a useful tool for human beings in the world. In the US alone, 88% of adult users have email accounts and half of email users use email systems almost every day. However, like growing email users, spam, scam, and fishing emails are increasing. Lots of email providers, such as Gmail, Hotmail, have been making an effort to protect their users from spam, scam, and fishing emails. Accordingly, I’ll discuss some new techniques for anti-spam systems and how to improve the anti-spam system on the server through SPF (Sender Policy Framework), SenderID, Domain Keys, and DKIM(Domain Key Identified Mail).
-

	== Time to replace SMTP? ==		== Time to replace SMTP? ==
Line 6:		Line 5:
	SMTP has many security problems but SMTP servers became more secure as users began writing their own servers such as [http://www.microsoft.com/exchange/default.mspx Microsoft Exchange Servers], [http://cr.yp.to/qmail.html Qmail] and [http://www.postfix.org Postfix].		SMTP has many security problems but SMTP servers became more secure as users began writing their own servers such as [http://www.microsoft.com/exchange/default.mspx Microsoft Exchange Servers], [http://cr.yp.to/qmail.html Qmail] and [http://www.postfix.org Postfix].
	However, SMTP stays at the core of current junk email problems. Moreover, junk email is highly approaching 90% of all email traffic on the internet and like growing email users, spam, scam, and fishing emails are increasing.		However, SMTP stays at the core of current junk email problems. Moreover, junk email is highly approaching 90% of all email traffic on the internet and like growing email users, spam, scam, and fishing emails are increasing.
-

	== Anti-spam technique through Procmail ==		== Anti-spam technique through Procmail ==
Line 12:		Line 10:

	[[Image:Procmailrc.jpg]]		[[Image:Procmailrc.jpg]]
-

	== New Anti-spam Systems ==		== New Anti-spam Systems ==
Line 23:		Line 20:

	[[Image:Dns.jpg]]		[[Image:Dns.jpg]]
-

	=== SIDF (Sender ID Framework) ===		=== SIDF (Sender ID Framework) ===
	SIDF was designed by Microsoft. It certifies sender addresses through SPF record and uses very similar methods name syntax as SPF. However, SIDF is not the latest version of SPF.		SIDF was designed by Microsoft. It certifies sender addresses through SPF record and uses very similar methods name syntax as SPF. However, SIDF is not the latest version of SPF.
	For more information, click this [http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx link]		For more information, click this [http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx link]
-

	=== DKIM (DomainKeys Identified Mail) ===		=== DKIM (DomainKeys Identified Mail) ===
Line 36:		Line 31:

	[[Image:Email_header.jpg]]		[[Image:Email_header.jpg]]
-

	== Anti-spam System and Techniques ==		== Anti-spam System and Techniques ==
Line 44:		Line 38:
	*'''Step Two''': Set email server to validate emails have valid headers through TXT record of DNS server (Sender's DNS)		*'''Step Two''': Set email server to validate emails have valid headers through TXT record of DNS server (Sender's DNS)
	*'''Step Three''': It is good idea to use both SPF, DKIM and spam filters		*'''Step Three''': It is good idea to use both SPF, DKIM and spam filters
-

	== See Also ==		== See Also ==
Line 58:		Line 51:
	*[[Autocomplete]]		*[[Autocomplete]]
	*[[Identity Theft]]		*[[Identity Theft]]
-

	== External links ==		== External links ==
Line 66:		Line 58:
	*[http://it.slashdot.org/article.pl?sid=04/09/13/1317238 IETF Decides On SPF / Sender-ID issue]		*[http://it.slashdot.org/article.pl?sid=04/09/13/1317238 IETF Decides On SPF / Sender-ID issue]
	*[http://www.ietf.org/rfc/rfc4871.txt RFC 4871 - The DKIM Base Specification]		*[http://www.ietf.org/rfc/rfc4871.txt RFC 4871 - The DKIM Base Specification]
-

	== References ==		== References ==
Line 77:		Line 68:
	*SPF vs. Sender ID <[http://www.openspf.org/SPF_vs_Sender_ID http://www.openspf.org/SPF_vs_Sender_ID]>		*SPF vs. Sender ID <[http://www.openspf.org/SPF_vs_Sender_ID http://www.openspf.org/SPF_vs_Sender_ID]>
	*How Gmail Blocks Spam <[http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html]>		*How Gmail Blocks Spam <[http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html]>
-

	--[[User:Leehw\|Leehw]] 11:51, 8 December 2007 (EST)		--[[User:Leehw\|Leehw]] 11:51, 8 December 2007 (EST)

Leehw at 17:03, 8 December 2007

2007-12-08T17:03:50Z

← Older revision		Revision as of 17:03, 8 December 2007
Line 58:		Line 58:
	*[[Autocomplete]]		*[[Autocomplete]]
	*[[Identity Theft]]		*[[Identity Theft]]
		+

	== External links ==		== External links ==

Leehw: /* See Also */

2007-12-08T17:03:28Z

Leehw: /* See Also */

2007-12-08T17:03:02Z

Leehw at 17:01, 8 December 2007

2007-12-08T17:01:28Z

← Older revision		Revision as of 17:01, 8 December 2007
Line 26:		Line 26:

	=== SIDF (Sender ID Framework) ===		=== SIDF (Sender ID Framework) ===
-
	SIDF was designed by Microsoft. It certifies sender addresses through SPF record and uses very similar methods name syntax as SPF. However, SIDF is not the latest version of SPF.		SIDF was designed by Microsoft. It certifies sender addresses through SPF record and uses very similar methods name syntax as SPF. However, SIDF is not the latest version of SPF.
	For more information, click this [http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx link]		For more information, click this [http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx link]
Line 32:		Line 31:

	=== DKIM (DomainKeys Identified Mail) ===		=== DKIM (DomainKeys Identified Mail) ===
-
	The first version of [http://dkim.org DKIM] was combined DomainKeys designed by Yahoo and Identified Internet Mail by Cisco.		The first version of [http://dkim.org DKIM] was combined DomainKeys designed by Yahoo and Identified Internet Mail by Cisco.
	Today, many email providers such as AOL, Yahoo, Cisco, Microsoft, PGP, IBM, and Gmail collaborate to develop		Today, many email providers such as AOL, Yahoo, Cisco, Microsoft, PGP, IBM, and Gmail collaborate to develop
Line 41:		Line 39:

	== Anti-spam System and Techniques ==		== Anti-spam System and Techniques ==
-
	There are many effective anti-spam solutions in the world. But still it is impossible to block 100% of spam because of the inefficient sendmail system. Still, most of email users suffer from unwanted emails. As described above, we can build better and more efficient sendmail systems through new anti-spam techniques so that users don’t need any spam filtering tools.		There are many effective anti-spam solutions in the world. But still it is impossible to block 100% of spam because of the inefficient sendmail system. Still, most of email users suffer from unwanted emails. As described above, we can build better and more efficient sendmail systems through new anti-spam techniques so that users don’t need any spam filtering tools.

Line 68:		Line 65:
	*[[Identity Theft]]		*[[Identity Theft]]
	*[[Information Security Awareness]]		*[[Information Security Awareness]]
		+

	== External links ==		== External links ==
Line 76:		Line 74:
	*[http://www.ietf.org/rfc/rfc4871.txt RFC 4871 - The DKIM Base Specification]		*[http://www.ietf.org/rfc/rfc4871.txt RFC 4871 - The DKIM Base Specification]

-	~~== References ==~~

		+	== References ==
	*PROCMAIL QUICK START <[http://www.ii.com/internet/robots/procmail/qs http://www.ii.com/internet/robots/procmail/qs]>		*PROCMAIL QUICK START <[http://www.ii.com/internet/robots/procmail/qs http://www.ii.com/internet/robots/procmail/qs]>
	*Opinion: Is It Time to Replace SMTP? By Dave Crocker (Cisco) <[http://www.cisco.com/web/about/ac123/ac147/archived_issues/ipj_10-2/102_smtp.html http://www.cisco.com/web/about/ac123/ac147/archived_issues/ipj_10-2/102_smtp.html]>		*Opinion: Is It Time to Replace SMTP? By Dave Crocker (Cisco) <[http://www.cisco.com/web/about/ac123/ac147/archived_issues/ipj_10-2/102_smtp.html http://www.cisco.com/web/about/ac123/ac147/archived_issues/ipj_10-2/102_smtp.html]>

Leehw: /* See Also */

2007-12-08T17:00:44Z

Leehw at 16:51, 8 December 2007

2007-12-08T16:51:00Z

← Older revision		Revision as of 16:51, 8 December 2007
Line 70:		Line 70:
	*SPF vs. Sender ID <[http://www.openspf.org/SPF_vs_Sender_ID http://www.openspf.org/SPF_vs_Sender_ID]>		*SPF vs. Sender ID <[http://www.openspf.org/SPF_vs_Sender_ID http://www.openspf.org/SPF_vs_Sender_ID]>
	*How Gmail Blocks Spam <[http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html]>		*How Gmail Blocks Spam <[http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html]>
		+
		+
		+	--[[User:Leehw\|Leehw]] 11:51, 8 December 2007 (EST)

Leehw: /* References */

2007-12-08T16:50:22Z

References

← Older revision		Revision as of 16:50, 8 December 2007
Line 68:		Line 68:
	*Sender ID <[http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx]>		*Sender ID <[http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx]>
	*SPF (Sender Policy Framework) Project <[http://www.openspf.org http://www.openspf.org]>		*SPF (Sender Policy Framework) Project <[http://www.openspf.org http://www.openspf.org]>
		+	*SPF vs. Sender ID <[http://www.openspf.org/SPF_vs_Sender_ID http://www.openspf.org/SPF_vs_Sender_ID]>
		+	*How Gmail Blocks Spam <[http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html http://googlesystem.blogspot.com/2007/10/how-gmail-blocks-spam.html]>

Leehw: /* References */

2007-12-08T16:49:23Z

References

← Older revision		Revision as of 16:49, 8 December 2007
Line 61:		Line 61:

	== References ==		== References ==
		+
		+	*PROCMAIL QUICK START <[http://www.ii.com/internet/robots/procmail/qs http://www.ii.com/internet/robots/procmail/qs]>
		+	*Opinion: Is It Time to Replace SMTP? By Dave Crocker (Cisco) <[http://www.cisco.com/web/about/ac123/ac147/archived_issues/ipj_10-2/102_smtp.html http://www.cisco.com/web/about/ac123/ac147/archived_issues/ipj_10-2/102_smtp.html]>
		+	*SMTP <[http://en.wikipedia.org/wiki/Simple_Mail_Transfer_Protocol http://en.wikipedia.org/wiki/Simple_Mail_Transfer_Protocol]>
		+	*DomainKeys identified Mail (DKIM) <[http://dkim.org http://dkim.org]>
		+	*Sender ID <[http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx]>
		+	*SPF (Sender Policy Framework) Project <[http://www.openspf.org http://www.openspf.org]>

Leehw: /* External links */

2007-12-08T16:45:09Z

External links

← Older revision		Revision as of 16:45, 8 December 2007
Line 54:		Line 54:

	== External links ==		== External links ==
-	[http://www.openspf.org SPF: Project Overview]~~<BR>~~	+	*[http://www.openspf.org SPF: Project Overview]
-	[http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx Sender ID Framework]~~<BR>~~	+	*[http://www.microsoft.com/mscorp/safety/technologies/senderid/default.mspx Sender ID Framework]
-	[http://dkim.org DomainKeys Identified Mail (DKIM)]~~<BR>~~	+	*[http://dkim.org DomainKeys Identified Mail (DKIM)]
-	[http://it.slashdot.org/article.pl?sid=04/09/13/1317238 IETF Decides On SPF / Sender-ID issue]~~<BR>~~	+	*[http://it.slashdot.org/article.pl?sid=04/09/13/1317238 IETF Decides On SPF / Sender-ID issue]
-	[http://www.ietf.org/rfc/rfc4871.txt RFC 4871 - The DKIM Base Specification]~~<BR>~~	+	*[http://www.ietf.org/rfc/rfc4871.txt RFC 4871 - The DKIM Base Specification]

	== References ==		== References ==

← Older revision		Revision as of 17:03, 8 December 2007
Line 51:		Line 51:
	*[[Piggybacking]]		*[[Piggybacking]]
	*[[Honeypot]]		*[[Honeypot]]
-	*[[Biometric Systems Regarding Security Design Principle]]
	*[[Phishing]]		*[[Phishing]]
-	*[[Email Security]]
	*[[Biometrics in Information Security]]		*[[Biometrics in Information Security]]
-	*[[Smart Card Technology to Prevent Fraud]]
	*[[Electronic Voting Systems]]		*[[Electronic Voting Systems]]
-	*[[The Mitnick Attack]]
	*[[Payment Card Industry Data Security Standard]]		*[[Payment Card Industry Data Security Standard]]
	*[[Operating Systems Security]]		*[[Operating Systems Security]]
	*[[Autocomplete]]		*[[Autocomplete]]
-	*[[Internet Cookies and Confidentiality]]
	*[[Social Engineering]]		*[[Social Engineering]]
	*[[Identity Theft]]		*[[Identity Theft]]
	*[[Information Security Awareness]]		*[[Information Security Awareness]]
-

	== External links ==		== External links ==

← Older revision		Revision as of 17:00, 8 December 2007
Line 50:		Line 50:

	== See Also ==		== See Also ==
-		+	*[[Random Number Generators and Information Security]]
-		+	*[[Security and Storage Mediums]]
		+	*[[Piggybacking]]
		+	*[[Honeypot]]
		+	*[[Biometric Systems Regarding Security Design Principle]]
		+	*[[Phishing]]
		+	*[[Email Security]]
		+	*[[Biometrics in Information Security]]
		+	*[[Smart Card Technology to Prevent Fraud]]
		+	*[[Electronic Voting Systems]]
		+	*[[The Mitnick Attack]]
		+	*[[Payment Card Industry Data Security Standard]]
		+	*[[Operating Systems Security]]
		+	*[[Autocomplete]]
		+	*[[Internet Cookies and Confidentiality]]
		+	*[[Social Engineering]]
		+	*[[Identity Theft]]
		+	*[[Information Security Awareness]]

	== External links ==		== External links ==

← Older revision		Revision as of 17:03, 8 December 2007
Line 57:		Line 57:
	*[[Operating Systems Security]]		*[[Operating Systems Security]]
	*[[Autocomplete]]		*[[Autocomplete]]
-	*[[Social Engineering]]
	*[[Identity Theft]]		*[[Identity Theft]]
-	*[[Information Security Awareness]]

	== External links ==		== External links ==