|
Chilkat •
HOME •
Android™ •
ASP •
Visual Basic •
VB.NET •
C# •
iOS (IPhone) •
Objective-C •
C++ •
C •
MFC •
Delphi •
FoxPro •
Java •
Perl •
PHP Extension •
PHP ActiveX •
Python •
PowerShell •
Ruby •
SQL Server •
VBScript
CanonicalizeUrl
The CanonicalizeUrl method is a utility function that canonicalizes a URL into a standard form to avoid duplicates. For example, "http://www.chilkatsoft.com/" and "http://www.chilkatsoft.com/default.asp" are the same URL. ' The Chilkat Spider component/library is free. Dim spider As New Chilkat.Spider() ' Does a DNS lookup to find the default domain, which may or may not include the "www." depending on the DNS results. ' Also domain names are converted to lowercase: TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.ChilkatSoft.com/") & vbCrLf TextBox1.Refresh() ' CanonicalizeUrl will drop the HTML fragment: TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.chilkatsoft.com/purchase2.asp#buyZip") & vbCrLf TextBox1.Refresh() ' If a username/password is in the URL, it gets dropped: TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://username:password@www.chilkatsoft.com/purchase2.asp#buyZip") & vbCrLf TextBox1.Refresh() ' Port 80 and 443 are dropped: TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.chilkatsoft.com:80/purchase2.asp") & vbCrLf TextBox1.Refresh() TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("https://www.paypal.com:443/") & vbCrLf TextBox1.Refresh() ' Removes default pages: ' default.asp, index.html, index.htm, default.html, index.htm, default.htm ' index.php, index.asp, default.php, .cfm, .aspx, ,php3, .pl, .cgi, .txt, .shtml, .phtml TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.asp") & vbCrLf TextBox1.Refresh() TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.asp") & vbCrLf TextBox1.Refresh() TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.php") & vbCrLf TextBox1.Refresh() TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.pl") & vbCrLf TextBox1.Refresh() TextBox1.Text = TextBox1.Text & spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.htm") & vbCrLf TextBox1.Refresh() ' Output: ' http://chilkatsoft.com/ ' http://chilkatsoft.com/purchase2.asp ' http://chilkatsoft.com/purchase2.asp ' http://chilkatsoft.com/purchase2.asp ' https://www.paypal.com/ ' http://chilkatsoft.com/ ' http://chilkatsoft.com/ ' http://chilkatsoft.com/ ' http://chilkatsoft.com/ ' http://chilkatsoft.com/ |
© 2000-2012 Chilkat Software, Inc. All Rights Reserved.
