SlideShare a Scribd company logo
How to Use Integrated Version
Control in Rasa X
Ty Dunn
Product Manager
Karen White
Developer Marketing Manager
Agenda
HOW TO USE INTEGRATED VERSION CONTROL IN RASA X
Intro
Rasa X: a toolset for building mission-critical AI assistants
● What’s new: Integrated Version Control
Software Development Workflows for Building AI Assistants
● Version control
● Testing
● CI/CD
Demo: Integrated Version Control
Q&A
OUR MISSION
Empower all makers to create AI
assistants that work for everyone
Rasa X: downloaded in 135 countries
Rasa X is
For Teams Building
Mission-Critical
Assistants
Going beyond simple FAQ chatbots
Level 1:
Notifications
Level 2:
“Chatbots” - FAQs
Level 3:
Contextual Assistants
Level 4:
Personalized Assistants
Level 5:
Autonomous Organization
Build minimum
viable assistant Improve by
talking to the
assistant
Improve using
conversations
with real users
Improve using
conversations
with test users
Quality of assistant
Rasa Open Source (Local)
Rasa X (Server)
Rasa Open Source is an open
source framework for natural
language understanding, dialogue
management, and integrations.
Rasa X is a toolset used
to improve a contextual
assistant built using
Rasa Open Source.
Deploy your minimum viable assistant on a server and improve it using Rasa X
Continually improve your assistant using Rasa X
Review conversations and
improve your assistant based
on what you learn
Collect conversations between
users and your assistant
Ensure your new assistant passes tests
using continuous integration (CI) and
redeploy it to users using continuous
deployment (CD)
Rasa X was designed for one purpose:
To help product teams go from simple bots to advanced AI assistants
HOW TO USE INTEGRATED VERSION CONTROL IN RASA X
Conversational
datasets, specific
to the assistant’s
task
Powerful tools for
reviewing past
conversations
Integration with
development
workflows
Teams building
AI assistants
need 3 things:
With Integrated Version Control,
Rasa X now does all 3.
1 2 3
NEW: Integrated Version Control
HOW TO USE INTEGRATED VERSION CONTROL IN RASA X
What does it do?
● Creates a two-way sync with a remote git
repository
● Allows you to version training data and push
changes made in Rasa X to a target branch
By extension…
● Connects Rasa X to downstream workflows
like automated testing and deployments
● Brings Rasa X in line with software
engineering best practices
Enable in version 0.23.0+ as an
experimental feature
Overview: Getting Started
INTEGRATED VERSION CONTROL
1
Deploy Rasa X
Install Rasa X on a server
Generate SSH key
Create a new SSH key
pair on your server
2
Add key to GitHub
Add your public key to
your repository settings
3
Connect with Rasa X
Establish the connection
by posting your private
SSH key and repository
URL to a Rasa X API
endpoint
4
Testing, Version
Control, CI/CD
Applications using machine learning still need engineering best practices.
HOW TO USE INTEGRATED VERSION CONTROL IN RASA X
End-to-end workflow for managing assistant updates
INTEGRATED VERSION CONTROL
After you build, run model tests using Rasa CLI
HOW TO USE INTEGRATED VERSION CONTROL IN RASA X
Split data into a test set, or
estimate how well your model
generalizes using
cross-validation.
NLU Model
Evaluation
$ rasa test nlu -u
data/nlu.md --config
config.yml
--cross-validation
Evaluate your trained model on
a set of test stories and
generate a confusion matrix.
Core
Evaluation
$ rasa test core
--stories
test_stories.md --out
results
End to End
Evaluation
$ rasa test --stories
e2e_stories.md --e2e
Run through test conversations
to make sure that both NLU and
Core make correct predictions.
See an example using GitHub Actions!
Demo Time!
Q&A
If I push changes from my local files to my GitHub repo, do
they automatically get pulled into Rasa X?
Can different Rasa X users push changes to their own
branches?
When I launch Rasa X, I don’t see an option to enable
experimental features. What could cause this?
Resources
● Installing Rasa X on a server
● Connecting your assistant using
Integrated Version Control
● Common workflows with Rasa
Open Source and Rasa X
Check out Episodes 9 and 10 of the Rasa Masterclass
● Integrated Version Control: Linking Rasa X with Git-based Development Workflows
(Rasa blog)
● Model testing and CI for conversational software (Rasa blog)
● Integrated Version Control Installation and Setup (docs)
● Improving the Assistant - Integrated Version Control (docs)
● Masterclass Ep #9 - Improving the assistant: Setting up the Rasa X (YouTube)
● How Rasa’s Research Team Uses Rasa X to Build Carbon Bot (YouTube)
Further Reading
https://forum.rasa.com
Ty Dunn
Product Manager
t.dunn@rasa.com
Rasa Technologies GmbH, Schönhauser Allee 175, 10119 Berlin, Germany
Get in touch!

More Related Content

PDF
Research Updates from Rasa: Transformers in NLU and Dialogue
PDF
Rasa Open Source - What's next?
PDF
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
PDF
Six Steps to Conversation Driven Development
PDF
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
ODP
BDD with Cucumber
PPTX
BDD WITH CUCUMBER AND JAVA
PDF
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...
Research Updates from Rasa: Transformers in NLU and Dialogue
Rasa Open Source - What's next?
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
Six Steps to Conversation Driven Development
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
BDD with Cucumber
BDD WITH CUCUMBER AND JAVA
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...

What's hot (19)

PDF
BDD with the Cucumber
ODP
Test Automation Framework using Cucumber BDD overview (part 1)
PDF
Testing stage. being ahead business with cucumber
PPTX
Componentize! by Lancer Kind XP Conference 2016
PPTX
GitHub Copilot.pptx
PPTX
What Is Cucumber?
PDF
Boquet manager
PPTX
HotelQuickly Product & Engineering
PDF
Job manager 2020 in Angular
PDF
Tdd2018 state of the software quality in Germany
PDF
Why software projects fail in 2021?
PPTX
Automated testing for real
ODP
Java interfaces design perspective
PPTX
Behavioral tests with behat for qa
PDF
What is the best programming language for your web product?
PPTX
Bdd and Behat
PPTX
Behaviour Driven Development (BDD) - Closing the Loop on a Great Fiori UX
PPT
Word Dictionary - Software Development Project 1
PPTX
Calabash Mobile Application Testing Overview
BDD with the Cucumber
Test Automation Framework using Cucumber BDD overview (part 1)
Testing stage. being ahead business with cucumber
Componentize! by Lancer Kind XP Conference 2016
GitHub Copilot.pptx
What Is Cucumber?
Boquet manager
HotelQuickly Product & Engineering
Job manager 2020 in Angular
Tdd2018 state of the software quality in Germany
Why software projects fail in 2021?
Automated testing for real
Java interfaces design perspective
Behavioral tests with behat for qa
What is the best programming language for your web product?
Bdd and Behat
Behaviour Driven Development (BDD) - Closing the Loop on a Great Fiori UX
Word Dictionary - Software Development Project 1
Calabash Mobile Application Testing Overview
Ad

Similar to Webinar: How to Use Integrated Version Control in Rasa X (20)

PDF
Visual studio 2019 launch
PDF
Top 10 Trending Tools To Supercharge Productivity of Software Engineers
PDF
#ATAGTR2020 Presentation - Shift Left - Performance Testing
PPTX
Deploy multi-environment application with Azure DevOps
DOC
Vijay_Teekinavar_Kallesh
PDF
Radsystems Studio 8.5.9 PC Software – WhizzNews.pdf
DOC
Saurav_Kumar
PDF
Maximize Developer Efficiency_ The 10 Best Productivity Tools for Developers
PDF
Top 25+ .Net development tools for intelligent business solutions - AppsDevPro
PPTX
Azure DevOps työkalut - Roundtable 14.3.2019
PDF
Visual Studio ALM and DevOps Tools Walkthrough
PPTX
DevOps at scale: A true story - WIDS2016
PDF
Azure_DevOps introduction for CI/CD and Agile
PDF
Azure Devops Introduction for CI/CD and agile
PDF
Azure_DevOps introduction: including board,pipleline, rep
PPT
1 Ibm Solo Pruebas 2009
PPTX
Azure dev ops
PPTX
AUG NYC - Atlassian Server Updates
PPTX
How Azure DevOps can boost your organization's productivity
DOCX
Muraliupdatedpersona150716
Visual studio 2019 launch
Top 10 Trending Tools To Supercharge Productivity of Software Engineers
#ATAGTR2020 Presentation - Shift Left - Performance Testing
Deploy multi-environment application with Azure DevOps
Vijay_Teekinavar_Kallesh
Radsystems Studio 8.5.9 PC Software – WhizzNews.pdf
Saurav_Kumar
Maximize Developer Efficiency_ The 10 Best Productivity Tools for Developers
Top 25+ .Net development tools for intelligent business solutions - AppsDevPro
Azure DevOps työkalut - Roundtable 14.3.2019
Visual Studio ALM and DevOps Tools Walkthrough
DevOps at scale: A true story - WIDS2016
Azure_DevOps introduction for CI/CD and Agile
Azure Devops Introduction for CI/CD and agile
Azure_DevOps introduction: including board,pipleline, rep
1 Ibm Solo Pruebas 2009
Azure dev ops
AUG NYC - Atlassian Server Updates
How Azure DevOps can boost your organization's productivity
Muraliupdatedpersona150716
Ad

More from Rasa Technologies (20)

PDF
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
PDF
How to Effectively Test Your Chatbot | Rasa Summit
PDF
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
PDF
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...
PDF
The missing link: How AI can help create a safer society and better businesse...
PDF
Boss - Bringing More Diversity to Tech | Rasa Summit
PDF
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
PDF
Applying Conversational AI in the Enterprise
PDF
Ai = your data | Rasa Summit 2021
PDF
Supercharging User Interfaces with Rasa | Rasa Summit 2021
PPTX
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
PDF
Continuous Improvement of Conversational AI in Production | Rasa Summit
PDF
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
PDF
The State of Conversation Design - Designing for the Conversational Future
PDF
Building an AI Assistant Factory - Rasa Summit 2021
PDF
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
PDF
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
PDF
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
PDF
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
PDF
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
How to Effectively Test Your Chatbot | Rasa Summit
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...
The missing link: How AI can help create a safer society and better businesse...
Boss - Bringing More Diversity to Tech | Rasa Summit
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
Applying Conversational AI in the Enterprise
Ai = your data | Rasa Summit 2021
Supercharging User Interfaces with Rasa | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
Continuous Improvement of Conversational AI in Production | Rasa Summit
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
The State of Conversation Design - Designing for the Conversational Future
Building an AI Assistant Factory - Rasa Summit 2021
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...

Recently uploaded (20)

PPTX
ISO 45001 Occupational Health and Safety Management System
PDF
AI in Product Development-omnex systems
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PDF
Nekopoi APK 2025 free lastest update
PDF
top salesforce developer skills in 2025.pdf
PDF
How to Choose the Right IT Partner for Your Business in Malaysia
PDF
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
PDF
Understanding Forklifts - TECH EHS Solution
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PDF
How Creative Agencies Leverage Project Management Software.pdf
PPTX
L1 - Introduction to python Backend.pptx
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PDF
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
PPTX
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
PDF
medical staffing services at VALiNTRY
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
PDF
Design an Analysis of Algorithms I-SECS-1021-03
ISO 45001 Occupational Health and Safety Management System
AI in Product Development-omnex systems
Odoo Companies in India – Driving Business Transformation.pdf
Nekopoi APK 2025 free lastest update
top salesforce developer skills in 2025.pdf
How to Choose the Right IT Partner for Your Business in Malaysia
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
Understanding Forklifts - TECH EHS Solution
VVF-Customer-Presentation2025-Ver1.9.pptx
How Creative Agencies Leverage Project Management Software.pdf
L1 - Introduction to python Backend.pptx
Adobe Illustrator 28.6 Crack My Vision of Vector Design
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
Navsoft: AI-Powered Business Solutions & Custom Software Development
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
medical staffing services at VALiNTRY
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
How to Migrate SBCGlobal Email to Yahoo Easily
Design an Analysis of Algorithms I-SECS-1021-03

Webinar: How to Use Integrated Version Control in Rasa X

  • 1. How to Use Integrated Version Control in Rasa X Ty Dunn Product Manager Karen White Developer Marketing Manager
  • 2. Agenda HOW TO USE INTEGRATED VERSION CONTROL IN RASA X Intro Rasa X: a toolset for building mission-critical AI assistants ● What’s new: Integrated Version Control Software Development Workflows for Building AI Assistants ● Version control ● Testing ● CI/CD Demo: Integrated Version Control Q&A
  • 3. OUR MISSION Empower all makers to create AI assistants that work for everyone
  • 4. Rasa X: downloaded in 135 countries
  • 5. Rasa X is For Teams Building Mission-Critical Assistants
  • 6. Going beyond simple FAQ chatbots Level 1: Notifications Level 2: “Chatbots” - FAQs Level 3: Contextual Assistants Level 4: Personalized Assistants Level 5: Autonomous Organization
  • 7. Build minimum viable assistant Improve by talking to the assistant Improve using conversations with real users Improve using conversations with test users Quality of assistant Rasa Open Source (Local) Rasa X (Server) Rasa Open Source is an open source framework for natural language understanding, dialogue management, and integrations. Rasa X is a toolset used to improve a contextual assistant built using Rasa Open Source. Deploy your minimum viable assistant on a server and improve it using Rasa X
  • 8. Continually improve your assistant using Rasa X Review conversations and improve your assistant based on what you learn Collect conversations between users and your assistant Ensure your new assistant passes tests using continuous integration (CI) and redeploy it to users using continuous deployment (CD)
  • 9. Rasa X was designed for one purpose: To help product teams go from simple bots to advanced AI assistants HOW TO USE INTEGRATED VERSION CONTROL IN RASA X Conversational datasets, specific to the assistant’s task Powerful tools for reviewing past conversations Integration with development workflows Teams building AI assistants need 3 things: With Integrated Version Control, Rasa X now does all 3. 1 2 3
  • 10. NEW: Integrated Version Control HOW TO USE INTEGRATED VERSION CONTROL IN RASA X What does it do? ● Creates a two-way sync with a remote git repository ● Allows you to version training data and push changes made in Rasa X to a target branch By extension… ● Connects Rasa X to downstream workflows like automated testing and deployments ● Brings Rasa X in line with software engineering best practices Enable in version 0.23.0+ as an experimental feature
  • 11. Overview: Getting Started INTEGRATED VERSION CONTROL 1 Deploy Rasa X Install Rasa X on a server Generate SSH key Create a new SSH key pair on your server 2 Add key to GitHub Add your public key to your repository settings 3 Connect with Rasa X Establish the connection by posting your private SSH key and repository URL to a Rasa X API endpoint 4
  • 13. Applications using machine learning still need engineering best practices. HOW TO USE INTEGRATED VERSION CONTROL IN RASA X
  • 14. End-to-end workflow for managing assistant updates INTEGRATED VERSION CONTROL
  • 15. After you build, run model tests using Rasa CLI HOW TO USE INTEGRATED VERSION CONTROL IN RASA X Split data into a test set, or estimate how well your model generalizes using cross-validation. NLU Model Evaluation $ rasa test nlu -u data/nlu.md --config config.yml --cross-validation Evaluate your trained model on a set of test stories and generate a confusion matrix. Core Evaluation $ rasa test core --stories test_stories.md --out results End to End Evaluation $ rasa test --stories e2e_stories.md --e2e Run through test conversations to make sure that both NLU and Core make correct predictions. See an example using GitHub Actions!
  • 17. Q&A
  • 18. If I push changes from my local files to my GitHub repo, do they automatically get pulled into Rasa X?
  • 19. Can different Rasa X users push changes to their own branches?
  • 20. When I launch Rasa X, I don’t see an option to enable experimental features. What could cause this?
  • 22. ● Installing Rasa X on a server ● Connecting your assistant using Integrated Version Control ● Common workflows with Rasa Open Source and Rasa X Check out Episodes 9 and 10 of the Rasa Masterclass
  • 23. ● Integrated Version Control: Linking Rasa X with Git-based Development Workflows (Rasa blog) ● Model testing and CI for conversational software (Rasa blog) ● Integrated Version Control Installation and Setup (docs) ● Improving the Assistant - Integrated Version Control (docs) ● Masterclass Ep #9 - Improving the assistant: Setting up the Rasa X (YouTube) ● How Rasa’s Research Team Uses Rasa X to Build Carbon Bot (YouTube) Further Reading
  • 25. Ty Dunn Product Manager t.dunn@rasa.com Rasa Technologies GmbH, Schönhauser Allee 175, 10119 Berlin, Germany Get in touch!