VBScript Requires Chilkat v11.7.0+

Expand Ligatures and Normalize Unicode in Extracted PDF Text

See more PDF Text Extraction Examples

Demonstrates the "expandLigatures" and "normalize" clean-up options. Typeset PDFs use single glyphs for "fi" and "fl"; by default they are expanded to their letters. Unicode normalization is NFC by default; NFKC also folds compatibility characters such as circled digits, the trademark sign and vulgar fractions into plain characters, and "none" leaves the text as the PDF has it. VBScript

Dim fso, outFile
Set fso = CreateObject("Scripting.FileSystemObject")
'Create a Unicode (utf-16) output text file.
Set outFile = fso.CreateTextFile("output.txt", True, True)

success = 0

'  This example requires the Chilkat API to have been previously unlocked.
'  See Global Unlock Sample for sample code.

'  The PDF used in this example is available at ligatures.pdf

set pdf = CreateObject("Chilkat.Pdf")
success = pdf.LoadFile("qa_data/pdf/ligatures.pdf")
If (success = 0) Then
    outFile.WriteLine(pdf.LastErrorText)
    WScript.Quit
End If

set json = CreateObject("Chilkat.JsonObject")
set jsonOut = CreateObject("Chilkat.JsonObject")

'  The first line is set with the fi and fl ligature glyphs; the second has circled digits,
'  a trademark sign and a vulgar fraction.
success = pdf.ExtractText("text",json,jsonOut)
If (success = 0) Then
    outFile.WriteLine(pdf.LastErrorText)
    WScript.Quit
End If

outFile.WriteLine("---- default (expandLigatures: true, normalize: NFC) ----")
outFile.WriteLine(jsonOut.StringOf("text"))

'  Keep the ligature characters as they are in the PDF.
success = json.UpdateBool("expandLigatures",0)
success = json.UpdateString("normalize","none")
success = pdf.ExtractText("text",json,jsonOut)
If (success = 0) Then
    outFile.WriteLine(pdf.LastErrorText)
    WScript.Quit
End If

outFile.WriteLine("---- expandLigatures: false, normalize: none ----")
outFile.WriteLine(jsonOut.StringOf("text"))

'  NFKC folds the compatibility characters too (and expands ligatures on its own).
success = json.UpdateString("normalize","NFKC")
success = pdf.ExtractText("text",json,jsonOut)
If (success = 0) Then
    outFile.WriteLine(pdf.LastErrorText)
    WScript.Quit
End If

outFile.WriteLine("---- normalize: NFKC ----")
outFile.WriteLine(jsonOut.StringOf("text"))

'  Sample output (shown here in ASCII: (fi) and (fl) stand for the single ligature characters, (1) and (2) for the circled digits,
'  (TM) for the trademark sign and 1/2 for the vulgar fraction; the NFKC output has plain "1", "2", "TM" and "1", fraction slash, "2"):

'  ---- default (expandLigatures: true, normalize: NFC) ----
'  Typeset Text
'  
'  The final flight of the season was officially confirmed on the fifth. Rooms (1) and (2) are reserved; the Harbor Cafe(TM) serves 1/2 portions.
'  ---- expandLigatures: false, normalize: none ----
'  Typeset Text
'  
'  The (fi)nal (fl)ight of the season was of(fi)cially con(fi)rmed on the (fi)fth. Rooms (1) and (2) are reserved; the Harbor Cafe(TM) serves 1/2 portions.
'  ---- normalize: NFKC ----
'  Typeset Text
'  
'  The final flight of the season was officially confirmed on the fifth. Rooms 1 and 2 are reserved; the Harbor CafeTM serves 1/2 portions.

outFile.Close