In this tutorial, We are going to learn how one can create a chat app using DialogFlow and MessengerX.io.
We can easily create our logic pipeline (like how and what our chatbot will respond) and connect it in our website, deploy if required on play store or on MessengerX.io Platform and monetize it! (applicable for consumer bots)
Prerequisite
Python 3.6+
MessengerX.io FREE Auth Token
DialogFlow
Getting Started
First we will clone the template which contains the starter code
git clone https://github.com/machaao/machaao-dialogflow-template.git
cd machaao-dialogflow-template
Getting DialogFlow Auth Key
We will follow this doc created by google to enable the DialogFlow API and create the Auth Key.
In this tutorial, I am going to show you how you can get a Free API Token for creating and deploying chat app on MessengerX.io Marketplace.
Before starting the tutorial, I would like to talk about MessengerX.io. It is a marketplace for chat apps with more than hundreds of thousand of users and growing where you can create, deploy and earn from your chat apps.
Now, we need to paste the Chatbot API Token which we copied from MessengerX.io Portal and the Chatbot API Token will be able to securely send messages with the server and user.
Here, we need to run the Action server, it is used for predicting the response for users. If you want to learn more about RASA Action Server, you can visit this page.
Open a terminal/powershell.
rasa run actions --actions actions
This command will start the action server, if you see any warning, don’t get bothered.
6. Starting Rasa Core Locally
Open another terminal/powershell.
The server should start at PORT 5005.
rasa run -m models --debug --endpoints config/endpoints.yml --credentials config/credentials.yml --enable-api --cors β*β --connector "connectors.MachaaoConnector.MachaaoInputChannel"
7. Start Tunnel Server
Tunnel server is used for exposing your port to web. We will be using the FREE machaao tunnel server.
Open another terminal/powershell.
machaao tunnel -p 5005 -t <Chatbot-Api-Token>
8. Updating the Webhook URL on MessengerX.io Portal
Update your bot Webhook URL on MessengerX.io Portal with the url provided as shown below.
Visual Studio Code (You may choose to use another JS/Text editor. We will be using VSCode in this article)
Quizzy
Scope: For the purpose of this article we are going to build a simple trivia chatbot that will perform following tasks:
The chatbot will:
Greet the user and offer them to begin the Trivia.
Present the user with a question and 4 choices of answers.
Upon user’s selection, respond the user with the result of their selection i.e. Correct/Incorrect Answer.
Continue the quiz with next question.
Messaging: For sending chatbot responses, we will be using the Messaging API’s and to store user’s answers, we will utilise the Tags API.
Trivia Questions: To dynamically fetch questions and answers for the user, we will use Open Trivia Database API.
Let’s begin!
Register
In order to configure the trivia bot later, you will need to be a registered developer on MessengerX Developer Portal. If you haven’t already, head over to https://portal.messengerx.io/register to get started.
NOTE: If you are an existing developer, have reached your bot limit and wish to make more chat apps, please write to us via this link.
Create a Chat App
When you logon to the developer portal for the first time, you will see a pop up dialog like below which will prompt you to make your first chat app.
Proceed further by giving your chat app a name, description. The Webhook Url and Image Url can have a value NONE for now as we will change this later once we host our bot.
Select “Create” and you shall see an entry for your bot on the screen within seconds.
Click on “SETTINGS” and make note of Token value as we will need this to build out the bot.
NOTE: If you have created your first chat app already, you may very well choose to repurpose an existing bot token and that will work just fine. The only implication is it will break connection with the already configured settings of the previous bot.
Conversation Flow
In order to build the backend, we will first design for the conversation(s) that the user will have with the bot. For the sake of this tutorial, the bot will cater for 4 types of response messages:
Welcome message: This will be the default greeting message the bot will send when the user first begins the conversation along with a Quick Reply to begin the quiz.
Question message: This message will contain the question along with 4 quick replies that represent the answers (1 correct and 3 incorrect).
Result message: Represents the message shown to user as to whether their answer is correct or not.
Fallback message: Message sent when the chatbot receives an incoming message where it is not sure what to do and tries to bring user back to quiz.
Backend
Let’s start by creating an empty project directory. Open a Terminal/Command Line and run npm init in the project directory to initialise the Node project.
Next, we will install the MessengerX SDK and Express by running npm i --save machaao express in the terminal.
Store and fetch using Tags API
For every question asked to the user, we will be first storing the user’s question along with all the answers to MessengerX.io using Tags API. Essentially, Tags API allow us to assign a specific tag to a user along with the ability to use it as a key/value storage.
Every time a user requests for a new trivia question, our flow will be to first fetch a new question via Open Trivia Database API, store it against the user via Tags API and then present the user with the question.
When the user responds with an answer, we first fetch the current question for the given user via Tags API, compare the answer and respond the user with a result.
The logic to handle above will follow in the later article.
Incoming Message Pseudocode
Below is a diagram that explains how we will handle incoming user messages to the chatbot. We basically breakdown these messages by “action_type” which represents the type of input.
When we convert the above pseudocode into actual logic, below is what it looks like:
const express = require('express');
const server = express();
const MxSdk = require('machaao');
const lib = new MxSdk('<-----Bot Token------->', 'dev', server);
const api = 'https://opentdb.com/api.php?amount=1&category=9&difficulty=easy&type=multiple';
const rp = require('request-promise');
const welcome_responses = [
'hi',
'hello',
'bojour',
'namaste',
'kia ora',
'bula',
'kemunacho',
'hey',
'yo',
'sup',
'whats up?',
'wassup',
'get_started',
'get started',
];
server.post('/incoming', async (req, res) => {
//get incoming messages
const x = await lib.getUserMessages(req);
//manage user response
if (x.length > 0) {
const incoming = x[0].message_data;
switch (incoming.action_type) {
case 'postback':
if (welcome_responses.includes(incoming.text)) sendWelcomeMessage(req);
else sendFallbackMessage(req);
break;
case 'quick_reply':
if (welcome_responses.includes(incoming.text)) sendWelcomeMessage(req);
else if (incoming.text === 'start') sendQuestionMessage(req);
else checkResult(incoming, req);
break;
case 'get_started':
if (welcome_responses.includes(incoming.text)) sendWelcomeMessage(req);
else sendFallbackMessage(req);
break;
}
}
res.sendStatus(200);
});
Above code shows our setup MessengerX SDK initialisation, logic to handle incoming webhook requests. Notice in Line number 4 of above snippet, you will need to pass in your “Bot Token” that you made note of from the Developer Portal earlier.
The supporting methods for checking result, outgoing messages and fetching new questions are as below:
async function getQuestion() {
const options = {
method: 'GET',
uri: api,
headers: {
'Content-Type': 'application/json',
},
transform: function (body, response) {
if (typeof body === 'string') {
response.body = JSON.parse(body);
return response.body.results[0];
} else return response.body.results[0];
},
};
return rp(options);
}
function _getUserQuestion(payload) {
return payload.filter((q) => q.name === 'currentQuestion');
}
async function checkResult(incoming, req) {
const answer = await lib.getUserMessages(req);
const userTags = await lib.getUserTags(req);
if (userTags.length > 0) {
const currentQ = _getUserQuestion(userTags);
const correct_answer = currentQ[0].values[0].correct_answer;
if (correct_answer === incoming.text) await sendCorrectAnswerMessage(req);
else await sendWrongAnswerMessage(req, correct_answer);
}
}
async function sendWelcomeMessage(req) {
return lib.sendButtonsOrQuickRepliesMessage(
req,
"Hi I'm Quizzy, here to entertain you with multi choice Trivia Questions! Click Start to begin!",
[],
[{ title: 'Start', content_type: 'text', payload: 'start' }] // sample quick reply
);
}
async function sendCorrectAnswerMessage(req) {
return lib.sendButtonsOrQuickRepliesMessage(
req,
'Correct Answer!',
[],
[{ title: 'Next Question', content_type: 'text', payload: 'start' }] // sample quick reply
);
}
async function sendWrongAnswerMessage(req, correct_answer) {
return lib.sendButtonsOrQuickRepliesMessage(
req,
`Sorry, the right answer is ${correct_answer}.`,
[],
[{ title: 'Next Question', content_type: 'text', payload: 'start' }] // sample quick reply
);
}
async function sendFallbackMessage(req) {
return lib.sendButtonsOrQuickRepliesMessage(
req,
"I'm not sure I understand, to begin the quiz, tap Start below!",
[],
[{ title: 'Start', content_type: 'text', payload: 'start' }] // sample quick reply
);
}
async function sendQuestionMessage(req) {
//generate question
//set user tag
//send question
const q = await getQuestion();
const response = await lib.addUserTag('currentQuestion', [q], req);
let answers = [...q.incorrect_answers, q.correct_answer];
//randomize options
answers = answers.sort((a, b) => {
return 0.5 - Math.random();
});
const qrs = [];
answers.map((a) => {
qrs.push({ title: a, content_type: 'text', payload: a });
});
return lib.sendButtonsOrQuickRepliesMessage(req, q.question, [], qrs);
}
//run express server on port 3000
server.listen(3000, () => {
console.log('Listening on port 3000');
});
Debugging Locally
We will be using Ngrok.io which will enable us to temporarily open a tunnel making our locally running project accessed by the outside world. Below is how we will make it work:
In your terminal, run node index.js. This should spit out "Listening on port 3000" on your terminal.
Open a new terminal window and run ngrok http 3000. This will successfully generate a custom URL that will forward all incoming requests to the chatbot. An example screen is shows as below:
Next, we now want to go back to the Developer Portal and update the webhook URL using below format:
<NGROK URL>/incoming
So in above example it will be https://14f53735fd55.ngrok.io/incoming. Copy the URL and paste it in Webhook URL value of your chatbot in the portal and click on “SAVE CHANGES” as shown as 1and 2 in screenshots below.
And you are now ready to test/debug your chatbot π
To speak to your chatbot, click on “WEBCHAT” button in the portal and it will take you to the webchat. Click on “Get Started” to begin talking to the chatbot. You should successfully see messages routing through your locally running project.
Free Hosting on Heroku
Register: If you haven’t already, visit Heroku and sign up for a free account. Once you have registered, open a new comand line/ terminal window and install the Heroku CLI as we will use this to deploy our bot.
Authorise: Upon a successful installation, run heroku login in your command line, this will prompt you to open a tab and take you through a process of authorising your machine with your Heroku account.
Configure:
Open package.json in your project directory and add below property to the main object in order to let Heroku know the version of Node we wish to run the chatbot.
, “engines”: { “node”: “10.x” }}
We need to tell Heroku how to start our project upon successful deployment. We will achieve this by specifying a start script. Open package.json file, under scripts, add a key value : "start": "node index.js",
Create App on Heroku: Run heroku create in the command line. If this runs successfully, you shall see a message like below acknowledging the app creation:
Next, we need to add the newly created app to our git by running below where app name is the app name generated by Heroku. For example, in above screenshot it would be mighty-brushlands-98971. Make sure you commit your changes using Git locally.
heroku git:remote -a <app-name>
In order to deploy the chatbot to heroku, make sure you have first created at least one commit locally. To deploy, simply run git push --set-upstream heroku master
Once you receive a successful deployment message in your console, head over to the developer portal and update the Webhook URL with the new Heroku URL. In the case above that would be https://mighty-brushlands-98971.herokuapp.com/incoming
And that’s it π
To sum up, in this article we learnt how to get started with MessengerX.io using the Node SDK, build a Trivia Chatbot using OpenTrivia Database API and successfully deploy the chatbot on Heroku for free.
If you have reached this far, I am sure you have a great knack for chatbots. I hope you enjoyed the article and look forward to hearing your thoughts below.
Upon login, you should be able to create a new chatbot and the corresponding FREE API key.
Create your first chatbot application via portal
Upon login, Please click the fairly prominent “Add New App” button.
You should now see a popup screen as shown below.
Enter a display name for your chatbot.
To continue with the process, you can enter “None” in Webhook URL and Image URL field for now.
Next, Press “Save Changes” to generate a new API key for your bot.
Let’s proceed by saving the changes.
Next, Click on Settings and note down the API Key, you will need it later during the process.
Install the machaao python module
We will need to install the machaao library module to continue.
To continue, let’s install the module as shown below via PIP
# For Linux/MacOS
pip3 install machaao
# For Windows
pip install machaao
# For Ubuntu
sudo snap install ngrok
# For MacOS
brew install ngrok
# For other OS visit: https://ngrok.com/download
Finally, Let’s install NGROK so that we are done with the basic system requirements.
Create a new chatbot project locally
Once the machaao pip module has been installed on your system / laptop.
You can now create a new chatbot project by running the “machaao” command as shown below.
machaao --start <project_name>
# Creates a folder and copies the chatbot files.
cd <project_name>
# Changes current directory to the project directory
This will create a directory with the specified <project_name>
Next, Open chatbot.py in your favorite python editor and update the API key and base URL as shown below.
# Get the API Token from - https://portal.messengerx.io
MESSENGERX_API_TOKEN = "<API_KEY_FROM_PORTAL>"
# Base URL is used to communicate with either Dev or Prod APIs.
MESSENGERX_BASE_URL = "https://ganglia-dev.machaao.com" [for development purposes]
Run your local chatbot server
Next, Run the chatbot server via command line terminal.
# For Linux/MacOS
python3 chatbot.py
# For Windows
python chatbot.py
Setup your web server for development
Almost there…
Continuing on, let’s run NGROK in the command line terminal as shown below.
# Copy the HTTPS forwarding URL
ngrok http 5000
# Copy the HTTPS NGROK forwarding URL
https://<....>.ngrok.io/
NOTE: Not required on a VPS, Shared Hosting Providers such as Heroku.
Update your Chatbot Webhook URL
Next, Click on the chatbot settings and update your webhook as shown below.
Continuing, Update the webhook as shown here “https://<β¦.>.ngrok.io/machaao/incoming” without quotes and save it.
Your echo chatbot is now ready for development
If everything went well, your chatbot should now be ready to receive and process messages to or from users via Web / Android.
Congrats, you are now on your way to a deeper machine learning journey.
Finally, You can now show off your shiny new sample echo bot via https://dev.messengerx.io/<chatbot_name>
#HappyCoding
Get Started with building deeply personalized chatbots today with MessengerX.io