SlideShare a Scribd company logo
Machine LearningSystem Architecture 
Microsoft Translator, a Case Study. 
Vishal Chowdhary (@talktovishal, vishalc@microsoft)
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Outline
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Translation APIs and UX 
TranslationEngine 
Distributed Runtime 
HPC/HadoopCluster 
Bing IndexPublic corpora 
Train statisticalmodels 
Find and gather parallel data
Common Problems 
Our Solution 
ExamplesDemo 
Summarize 
Evaluation 
Release 
(Feature + Model) Selection 
Data Acquisition 
Training
Data Acquisition 
Evaluation 
Release 
(Feature + Model) Selection 
Data Acquisition 
Training
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Web 
JRC. Europarl 
Microsoftlocalization 
Preprocess, Sentence Align 
MT Store 
Extract: Filter Chain 
Train SMTEngine
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
 
 
 
 
 

Evaluation 
Release 
(Feature + Model) Selection 
Data Acquisition 
Training 
Training
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Level 5 
Easy 
Level 7 
Challenging 
Level 9 
Grueling 
Level 5 
Easy 
Level 8 
Demanding 
Level 10 
Mind Boggling
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
 
 
 
 
 
 
 
 
 
 

Evaluation 
Release 
(Feature + Model) Selection 
Data Acquisition 
Training 
Debugging & Evaluation
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
 
 
 
 
 
 
 
 

Evaluation 
Release 
(Feature + Model) Selection 
Data Acquisition 
Training 
Release
Machine Learning system architecture – Microsoft Translator, a Case Study :  Vishal chowdhary Strata 2014
 
 

vishalc@microsoft.com 
@talktovishal
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. 
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. 
blogs.msdn.com/translator 
twitter.com/MSTranslator 
facebook.com/BingTranslator

More Related Content

PDF
Architecting for Data Science
PDF
Agile Machine Learning for Real-time Recommender Systems
PPTX
Is that a Time Machine? Some Design Patterns for Real World Machine Learning ...
PPTX
Design Patterns for Machine Learning in Production - Sergei Izrailev, Chief D...
PPTX
Real-time Recommendations for Retail: Architecture, Algorithms, and Design
PPTX
MLOps and Data Quality: Deploying Reliable ML Models in Production
PPTX
Production and Beyond: Deploying and Managing Machine Learning Models
PDF
Data ops: Machine Learning in production
Architecting for Data Science
Agile Machine Learning for Real-time Recommender Systems
Is that a Time Machine? Some Design Patterns for Real World Machine Learning ...
Design Patterns for Machine Learning in Production - Sergei Izrailev, Chief D...
Real-time Recommendations for Retail: Architecture, Algorithms, and Design
MLOps and Data Quality: Deploying Reliable ML Models in Production
Production and Beyond: Deploying and Managing Machine Learning Models
Data ops: Machine Learning in production

What's hot (20)

PDF
AISF19 - Building Scalable, Kubernetes-Native ML/AI Pipelines with TFX, KubeF...
PPTX
Lessons Learned from Building Machine Learning Software at Netflix
PPTX
ML-Ops: From Proof-of-Concept to Production Application
PPTX
Ai use cases
PDF
Rsqrd AI: How to Design a Reliable and Reproducible Pipeline
PDF
Accelerating the ML Lifecycle with an Enterprise-Grade Feature Store
PDF
Modern Machine Learning Infrastructure and Practices
PPTX
MLOps - The Assembly Line of ML
PPTX
Machine Learning In Production
PDF
MLOps Using MLflow
PDF
Hamburg Data Science Meetup - MLOps with a Feature Store
PDF
Ml ops past_present_future
PDF
What is MLOps
PPTX
From Data Science to MLOps
PDF
MLOps Bridging the gap between Data Scientists and Ops.
PDF
Ml infra at an early stage
PDF
Managers guide to effective building of machine learning products
PPTX
Machine Learning for .NET Developers - ADC21
PDF
Seamless MLOps with Seldon and MLflow
PDF
Productionizing Machine Learning in Our Health and Wellness Marketplace
AISF19 - Building Scalable, Kubernetes-Native ML/AI Pipelines with TFX, KubeF...
Lessons Learned from Building Machine Learning Software at Netflix
ML-Ops: From Proof-of-Concept to Production Application
Ai use cases
Rsqrd AI: How to Design a Reliable and Reproducible Pipeline
Accelerating the ML Lifecycle with an Enterprise-Grade Feature Store
Modern Machine Learning Infrastructure and Practices
MLOps - The Assembly Line of ML
Machine Learning In Production
MLOps Using MLflow
Hamburg Data Science Meetup - MLOps with a Feature Store
Ml ops past_present_future
What is MLOps
From Data Science to MLOps
MLOps Bridging the gap between Data Scientists and Ops.
Ml infra at an early stage
Managers guide to effective building of machine learning products
Machine Learning for .NET Developers - ADC21
Seamless MLOps with Seldon and MLflow
Productionizing Machine Learning in Our Health and Wellness Marketplace
Ad

Viewers also liked (18)

PDF
An Architecture for Agile Machine Learning in Real-Time Applications
PPTX
Recommendations for Building Machine Learning Software
PDF
Predictive Analytics and Machine Learning …with SAS and Apache Hadoop
PPTX
Real time machine learning
PDF
Tensorflow in production with AWS Lambda
PDF
Машинное обучение в Яндексе
PDF
Applying Machine Learning to Software Clustering
PDF
Naive application of Machine Learning to Software Development
PDF
018 20160902 Machine Learning Framework for Analysis of Transport through Com...
PDF
Introduction to Model-Based Machine Learning
PDF
Machine Learning Software Design Pattern with PredictionIO
PDF
PredictionIO - Scalable Machine Learning Architecture
PDF
Closing The Loop for Evaluating Big Data Analysis
PPTX
Роман Абдульманов, Wrike "С бэкенда во фронтенд: мой опыт перехода на Dart"
PDF
Digital Dashboard for Key Performance indicators and Project Management (Exce...
PDF
Yuriy Golikov, Wrike: Team of teams how to organize effective development of...
PDF
Machine Learning for Recommender Systems MLSS 2015 Sydney
PDF
12 Hidden Tips of Popular Remote Work Tools
An Architecture for Agile Machine Learning in Real-Time Applications
Recommendations for Building Machine Learning Software
Predictive Analytics and Machine Learning …with SAS and Apache Hadoop
Real time machine learning
Tensorflow in production with AWS Lambda
Машинное обучение в Яндексе
Applying Machine Learning to Software Clustering
Naive application of Machine Learning to Software Development
018 20160902 Machine Learning Framework for Analysis of Transport through Com...
Introduction to Model-Based Machine Learning
Machine Learning Software Design Pattern with PredictionIO
PredictionIO - Scalable Machine Learning Architecture
Closing The Loop for Evaluating Big Data Analysis
Роман Абдульманов, Wrike "С бэкенда во фронтенд: мой опыт перехода на Dart"
Digital Dashboard for Key Performance indicators and Project Management (Exce...
Yuriy Golikov, Wrike: Team of teams how to organize effective development of...
Machine Learning for Recommender Systems MLSS 2015 Sydney
12 Hidden Tips of Popular Remote Work Tools
Ad

Recently uploaded (20)

PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Empathic Computing: Creating Shared Understanding
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
Spectroscopy.pptx food analysis technology
PDF
Electronic commerce courselecture one. Pdf
PDF
KodekX | Application Modernization Development
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Approach and Philosophy of On baking technology
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PPT
Teaching material agriculture food technology
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Spectral efficient network and resource selection model in 5G networks
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Empathic Computing: Creating Shared Understanding
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Spectroscopy.pptx food analysis technology
Electronic commerce courselecture one. Pdf
KodekX | Application Modernization Development
Understanding_Digital_Forensics_Presentation.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Approach and Philosophy of On baking technology
Network Security Unit 5.pdf for BCA BBA.
Dropbox Q2 2025 Financial Results & Investor Presentation
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Teaching material agriculture food technology
20250228 LYD VKU AI Blended-Learning.pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?
“AI and Expert System Decision Support & Business Intelligence Systems”
Agricultural_Statistics_at_a_Glance_2022_0.pdf

Machine Learning system architecture – Microsoft Translator, a Case Study : Vishal chowdhary Strata 2014

  • 1. Machine LearningSystem Architecture Microsoft Translator, a Case Study. Vishal Chowdhary (@talktovishal, vishalc@microsoft)
  • 8. Translation APIs and UX TranslationEngine Distributed Runtime HPC/HadoopCluster Bing IndexPublic corpora Train statisticalmodels Find and gather parallel data
  • 9. Common Problems Our Solution ExamplesDemo Summarize Evaluation Release (Feature + Model) Selection Data Acquisition Training
  • 10. Data Acquisition Evaluation Release (Feature + Model) Selection Data Acquisition Training
  • 12. Web JRC. Europarl Microsoftlocalization Preprocess, Sentence Align MT Store Extract: Filter Chain Train SMTEngine
  • 16.      
  • 17. Evaluation Release (Feature + Model) Selection Data Acquisition Training Training
  • 19. Level 5 Easy Level 7 Challenging Level 9 Grueling Level 5 Easy Level 8 Demanding Level 10 Mind Boggling
  • 25.           
  • 26. Evaluation Release (Feature + Model) Selection Data Acquisition Training Debugging & Evaluation
  • 34.         
  • 35. Evaluation Release (Feature + Model) Selection Data Acquisition Training Release
  • 39. © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. blogs.msdn.com/translator twitter.com/MSTranslator facebook.com/BingTranslator