(JavaScript) Multimodal Input: File Data

See more AI Examples

Note: At the time of writing this example, xAI, Perplexity, and DeepSeek do not have the ability to accept non-image multimodal data or URLs.

Note: This example requires Chilkat v11.2.0 or greater.

Note

This example is intended for running within a Chilkat.Js embedded JavaScript engine. All Chilkat JavaScript examples require Chilkat v11.4.0 or greater.

var success = false;

// This example assumes the Chilkat API to have been previously unlocked.
// See Global Unlock Sample for sample code.

var ai = new CkAi();

// The provider can be "openai", "google", or "claude".
// At the time of writing this example, "deepseek", "xai", and "perplexity" do not have the ability to process non-image multimodal inputs.
// Support for additional providers will be added in future versions of Chilkat.
ai.Provider = "claude";

// Use your provider's API key.
ai.ApiKey = "MY_API_KEY";

// Choose a model.
ai.Model = "claude-opus-4-1-20250805";

// Add both text input, and PDF file data.
ai.InputAddText("What is in this file?");

var bd = new CkBinData();
// We're passing a relative local file path here.. (relative the the app's current working directory)
success = bd.LoadFile("qa_data/pdf/shakespeare.pdf");
if (success == false) {
    console.log(bd.LastErrorText);
    return;
}

// Provide the filename in the 1st argument.  The file extension is important to indicate the type of file.
ai.InputAddFileData("shakespeare.pdf",bd,"");

// Ask the AI for text output.
success = ai.Ask("text");
if (success == false) {
    console.log(ai.LastErrorText);
    return;
}

// Get the text response.
var sbResponse = new CkStringBuilder();
ai.GetOutputTextSb(sbResponse);
console.log(sbResponse.GetAsString());

// -------------------------------------------------------------
// The response is in markdown format.
// Also see Markdown to HTML Conversion Examples.
// -------------------------------------------------------------

// Sample output:

// This PDF file contains a famous quote from William Shakespeare's "Romeo and Juliet". The quote appears twice on the page:
// 
// "These violent delights have violent ends
// And in their triumph die, like fire and powder,
// Which as they kiss consume. The sweetest honey
// Is loathsome in his own deliciousness
// And in the taste confounds the appetite.
// Therefore love moderately; long love doth so;
// Too swift arrives as tardy as too slow."
// 
// The file also includes a portrait image of William Shakespeare. This particular quote is spoken by Friar Lawrence in the play, warning about the dangers of passionate, 
// immoderate love - suggesting that love that burns too intensely tends to burn out quickly, just as fire and gunpowder consume each other when they meet.