SlideShare a Scribd company logo
The Quality Gatekeeper
Rakuten Travel QA
Created by Nokota Susumu
QA Manager of Rakuten Travel
Tech Conference 2016
Contents
1.Introduce about Travel & Myself
2.Travel Development Organization
3.Travel QA Improvement
3-1. Service Improvement Story
3-2. Sustainable QA Process Improvement
4.Summary Rap Up
Introduction about Myself
15
Introduce about Myself
2001
2003
2005
2011
2014
Join in my trip company working
as Engineer
Job’s Biography
Join in Rakuten working as
Engineer
In charge of Domestic Services
working as Team leader
In charge of
Overseas/Accounting Services
working as Group Manager
In charge of Quality Assurance
working as Group Manager
Private Info
Nokota Susumu
⁃Rakuten Travel
⁃QA Manager
Mt.FUJI
Introduction about Travel Service
The Quality Gatekeeper Rakuten Travel QA
The Quality Gatekeeper Rakuten Travel QA
9
Mytrip.net Rakuten Travel Inc.
2004: Rakuten Travel Inc. and Mytrip.net were merged. The company name became Rakuten Travel
Inc.
2005: Star Tours Japan (currently Rakuten Bus Service) was acquired.
2014: Rakuten Inc. and Rakuten Travel Inc. were merged
1996: Hitachi Zosen’s service “Hotel no
madoguchi” was launched
2000: Separation from Hitachi Zosen
1999: Renewal as “Tabi no madoguchi”
2001: Rakuten Inc. begins a new service called
“Rakuten Travel”
2002: Separation from Rakuten Inc.
2003: Rakuten Inc. acquires 100% of
Mytrip.net.
2006: Rakuten Group and ANA Group formed Rakuten ANA Travel Online.
Rakuten Travel History in Details
Hotel rooms & plans,
Airplane seats,
Rental cars,
Bus etc…
SEO/SEM,
Mail magazine,
Affiliate Partners
Cross Use with
Rakuten Ichiba,
Super Point
Rakuten Travel services are based on the triangle concept of
Matching , Inventory and User Traffic.
Search, User reviews,
Recommendations,
Personalization
Matching
(Booking)
Web
Traffic
Inventory
Basic Concept of Service Produce
11
Online Travel Agent
in the world
No.1
12
Travel Development Organization
Travel
Service
PDM
DevQA
Travel Development Organization
Travel Development Organization is
consists of 3 section’s.
SDD = Development Team
PDM = Product Management Team
QA = Quality Assurance
Also, we are working with overseas
company such as India & China & USA.
Development Sections
Travel Development Organization Expansion Plan to 2020
2015 2016 2017 2018 2019 2020
SDD(DEV ENG) PDM(Product Management) QA (Quality Assuarance)
Growing Development Organization
Current Travel Development Flow & Figure
Travel Development Flow
Issue/idea
Come up
Discuss the
business
Opportunity
impact
File a Wish list
Entry
Review inspect
The Wish list
Write down a
PRD
Anyone
In a Brainstorming
In Daily Business
BU
PDM
Support Desk
BU
PDM
Lead / SSD / BU
Prioritize the Wish list
Sort out Bug / DCR / Feature
Assign PDM / SSD
PDM
SSD
Designer
Integrator
Lead
SSD
Integrator
Developer
SSD
Architect
PDM
Integrator
Lead
Integrator
PDM
Developer
Tester
Integrator
PDM/BU UT
Review the
PRD
Developer
Spec
Test Spec Develop Release
100
200
400
20 30 6030 40
80
50
100
150
0
50
100
150
200
250
300
350
400
450
2015 2016 2017
PRD (Large Project)/DCR (Small Project) DEV (Development Improvement)
MenteBug (DevOps, Bug & Improvement) Urgent Bug Fix
How many projects we have testing a year?
Number of Development PRD/DCR’s
More than 400 PRD’s
More than 200 PRD’s
Number of Kaizen Figure (Reported at 2016/1-6)
How many Kaizen we have last half year?
Urgent: Need to fix this as soon as possible. (Incident level)
P1: Need to investigate within a few weeks at latest
P2: Need to investigate within a few months at latest
P3: Nice to investigate and it will be fixed when the dev are available
Need to Investigate
To Be - Future Test Coverage
As Is - Current Test Coverage
QA Responsible Test Coverage Goal
Engineers QA
UT IT QA Release SAT
Engineers QA
UT IT QA Release SAT
Travel QA Improvement
Service improvement story of Domestic DP Service
Legacy
Architecture
New
Architecture
Something in between
Monolithic to Micro Service?!
Too many bugs
(Not enough test)
Domestic DP Development Issue vs Regression
Development Speed&AgilitySlow Fast
Legacy
Architecture
New
Architecture
Domestic DP Development Issue vs Regression
Development Speed&AgilitySlow Fast
Take off all bugs
(QA Process)
Legacy
Architecture
New
Architecture
How to improve QA Process?!
PRD/DCR
DEV
Mente
JIRA
1 Test
Scope
2 Test
Planning
3 Test
Case
Design
4 Test
Execution
5 Release
Confirmat
ion QA Process
Improvement
Domestic DP Development Issue vs Regression
Small LargeRegression Manual
Development Speed&AgilitySlow Fast
Take off all bugs
(QA Process)
Legacy
Architecture
New
Architecture
Domestic DP Development Issue vs Regression
Small SmallRegression Manual + Automation
Development Speed&AgilitySlow Fast
Take off all bugs
(QA Process)
Legacy
Architecture
New
Architecture
Travel QA Improvement
Sustainable QA Process management
Travel Development Flow
Issue/idea
Come up
Discuss the
business
Opportunity
impact
File a Wish list
Entry
Review inspect
The Wish list
Write down a
PRD
Anyone
In a Brainstorming
In Daily Business
BU
PDM
Support Desk
BU
PDM
Lead / SSD / BU
Prioritize the Wish list
Sort out Bug / DCR / Feature
Assign PDM / SSD
PDM
SSD
Designer
Integrator
Lead
SSD
Integrator
Developer
SSD
Architect
PDM
Integrator
Lead
Integrator
PDM
Developer
Tester
Integrator
PDM/BU UT
Development Main Frame
Review the
PRD
Developer
Spec
Test Spec Develop Release
Travel Development Flow
Current Development Flow
Test Spec
Test Case
Design
Manual
QA (STG)
Manual
QA (PRD)
DevelopmentPRD / DCR DEV Spec
Bug Fix &
Integration
Release
Operation
Lead
SSD
Integrator
Developer
SSD
Architect
PDM
Integrator
Lead
Integrator
PDM
Developer
Tester
Integrator
PDM/BU UT
Development Main Frame
Review the
PRD
Developer
Spec
Test Spec Develop Release
Sustainable QA Process Improvement
Release
Planning
Release
Management
To be
Test Spec
Test Case
Design
Manual
QA (STG)
Manual
QA (PRD)
DevelopmentPRD / DCR DEV Spec
Bug Fix &
Integration
Release
Operation
Test Spec
Test Case
Design
Manual
QA (STG)
Manual
QA (PRD)
Development
PRD / DCR
DEV / Mente
DEV Spec
Bug Fix &
Integration
Release
Operation
Merge to
Regression
As Is
1
2
3
Sustainable QA Process Improvement
Release
Management
QA Process Management Vision for 2017
Manual Test
Spec
Test Case
Design
Manual
QA (STG)
Manual
QA (PRD)
Development
PRD / DCR
DEV / Mente
DEV Spec
Bug Fix &
Integration
Release
Operation
Marge to
regression test
Automation
Case Design
Spec
Automation
QA (STG)
Automation
Development
Marge to
regression test
Release
Planning
Automation test (IT & E2E)
adapt to DEV team
Travel QA is the Final Quality Gatekeeper
Travel QA has the responsibility for all bugs, after the product
environment release. Therefore, we have 2 Authorities about QA testing
& Product Release. This is the one of the big difference between other
internet companies.
Judge all projects, whether QA Testing is necessary or not.
Judge and determine, whether it can release or not.
1, QA Testing
2, Application Release
Summary & Wrap Up
Summary & Rap Up
1 2
43
http://travel.rakuten.co.jp/
We want you!!
Be a quality gatekeeper

More Related Content

PPT
jVoiD - the enterprise ecommerce Java by Schogini
PPTX
The Journey of Craftmanship – Kotlin in Action
PPTX
Java EE 6 Adoption in One of the World's Largest Online Financial Systems (fo...
PDF
Building RIA Applications with JavaFX
PPT
Agile Development Management Tools webinar presentation
PDF
Adding Modularity Afterward with Embedded OSGi
PDF
Collaboration and Productivity: The Missing Links in API Development
PDF
JavaFX 2 Rich Desktop Platform
jVoiD - the enterprise ecommerce Java by Schogini
The Journey of Craftmanship – Kotlin in Action
Java EE 6 Adoption in One of the World's Largest Online Financial Systems (fo...
Building RIA Applications with JavaFX
Agile Development Management Tools webinar presentation
Adding Modularity Afterward with Embedded OSGi
Collaboration and Productivity: The Missing Links in API Development
JavaFX 2 Rich Desktop Platform

Viewers also liked (20)

PDF
Rakuten Ichiba_Rakuten Technology Conference 2016
PDF
楽天トラベルの開発プロセスに関して
PDF
Introduction to Mindfulness
PDF
Creating a team of DevOps “Super Sentai”
PDF
USING VISION SENSORS FOR INNOVATIVE HCI
PDF
Huge Enterprise Systems Architecture Design with Java EE
PDF
Sora Raku (Rakuten Drone Project)
PDF
楽天のプライベートクラウドを支えるフラッシュストレージ
PDF
Experiences with PlayStation VR
PDF
IBM Watson Question-Answering System and Cognitive Computing
PDF
Intro to GraphQL
PDF
Designing kinder Experiences
PDF
Large-Scale Machine Learning for E-commerce
PDF
Introduction to Deep Learning (NVIDIA)
PDF
AI Playing Go and Driving Cars, What’s Next?
PDF
Beyond Breakpoints: Improving Performance for Responsive Sites
PDF
Blockchain - Systems Without Boundaries
PDF
Using Algorithmia to leverage AI and Machine Learning APIs
PDF
The web‘s next adventure(s)
PDF
Automation for the Humans
Rakuten Ichiba_Rakuten Technology Conference 2016
楽天トラベルの開発プロセスに関して
Introduction to Mindfulness
Creating a team of DevOps “Super Sentai”
USING VISION SENSORS FOR INNOVATIVE HCI
Huge Enterprise Systems Architecture Design with Java EE
Sora Raku (Rakuten Drone Project)
楽天のプライベートクラウドを支えるフラッシュストレージ
Experiences with PlayStation VR
IBM Watson Question-Answering System and Cognitive Computing
Intro to GraphQL
Designing kinder Experiences
Large-Scale Machine Learning for E-commerce
Introduction to Deep Learning (NVIDIA)
AI Playing Go and Driving Cars, What’s Next?
Beyond Breakpoints: Improving Performance for Responsive Sites
Blockchain - Systems Without Boundaries
Using Algorithmia to leverage AI and Machine Learning APIs
The web‘s next adventure(s)
Automation for the Humans
Ad

Similar to The Quality Gatekeeper Rakuten Travel QA (20)

PPTX
Skillset and mind for Product Manager
PDF
UX strategy for digital transformation
DOC
Arzu Sahu
PPTX
[Rakuten TechConf2014] [B-6] Rakuten Travel Architecture and Development Process
PPTX
Lessons From the DesignOps Journey of the World’s Largest Travel Site (Eniola...
PDF
Seioglobal Profile
PDF
Product + UX: How to combine strengths to make something truly great!
PDF
Shaun Bradley Nov 2015 CV v1.0
DOCX
Srikanth QA Analyst
PDF
UX Antwerp Meetup March 2019: "defining-digital-products"
PDF
Resume Jackson Lee
PDF
PeopleSoft Upgrades: Best Practices
DOCX
Emad Samy Mahmoud Mekdad
DOC
CV Coral
PPT
Birth of the OPT2027 Portugal
PDF
The Internal And External And Media Relations...
DOC
Sunetra banerjee-sr-qa-engineer-project-lead resume
DOC
Jayanth_Resume
PDF
Kunal Desai
DOC
CV Amol Dethe
Skillset and mind for Product Manager
UX strategy for digital transformation
Arzu Sahu
[Rakuten TechConf2014] [B-6] Rakuten Travel Architecture and Development Process
Lessons From the DesignOps Journey of the World’s Largest Travel Site (Eniola...
Seioglobal Profile
Product + UX: How to combine strengths to make something truly great!
Shaun Bradley Nov 2015 CV v1.0
Srikanth QA Analyst
UX Antwerp Meetup March 2019: "defining-digital-products"
Resume Jackson Lee
PeopleSoft Upgrades: Best Practices
Emad Samy Mahmoud Mekdad
CV Coral
Birth of the OPT2027 Portugal
The Internal And External And Media Relations...
Sunetra banerjee-sr-qa-engineer-project-lead resume
Jayanth_Resume
Kunal Desai
CV Amol Dethe
Ad

More from Rakuten Group, Inc. (20)

PDF
EPSS (Exploit Prediction Scoring System)モニタリングツールの開発
PPTX
コードレビュー改善のためにJenkinsとIntelliJ IDEAのプラグインを自作してみた話
PDF
楽天における安全な秘匿情報管理への道のり
PDF
What Makes Software Green?
PDF
Simple and Effective Knowledge-Driven Query Expansion for QA-Based Product At...
PDF
DataSkillCultureを浸透させる楽天の取り組み
PDF
大規模なリアルタイム監視の導入と展開
PDF
楽天における大規模データベースの運用
PDF
楽天サービスを支えるネットワークインフラストラクチャー
PDF
楽天の規模とクラウドプラットフォーム統括部の役割
PDF
Rakuten Services and Infrastructure Team.pdf
PDF
The Data Platform Administration Handling the 100 PB.pdf
PDF
Supporting Internal Customers as Technical Account Managers.pdf
PDF
Making Cloud Native CI_CD Services.pdf
PDF
How We Defined Our Own Cloud.pdf
PDF
Travel & Leisure Platform Department's tech info
PDF
Travel & Leisure Platform Department's tech info
PDF
OWASPTop10_Introduction
PDF
Introduction of GORA API Group technology
PDF
100PBを越えるデータプラットフォームの実情
EPSS (Exploit Prediction Scoring System)モニタリングツールの開発
コードレビュー改善のためにJenkinsとIntelliJ IDEAのプラグインを自作してみた話
楽天における安全な秘匿情報管理への道のり
What Makes Software Green?
Simple and Effective Knowledge-Driven Query Expansion for QA-Based Product At...
DataSkillCultureを浸透させる楽天の取り組み
大規模なリアルタイム監視の導入と展開
楽天における大規模データベースの運用
楽天サービスを支えるネットワークインフラストラクチャー
楽天の規模とクラウドプラットフォーム統括部の役割
Rakuten Services and Infrastructure Team.pdf
The Data Platform Administration Handling the 100 PB.pdf
Supporting Internal Customers as Technical Account Managers.pdf
Making Cloud Native CI_CD Services.pdf
How We Defined Our Own Cloud.pdf
Travel & Leisure Platform Department's tech info
Travel & Leisure Platform Department's tech info
OWASPTop10_Introduction
Introduction of GORA API Group technology
100PBを越えるデータプラットフォームの実情

Recently uploaded (20)

PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
KodekX | Application Modernization Development
PDF
cuic standard and advanced reporting.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Encapsulation theory and applications.pdf
PPTX
Big Data Technologies - Introduction.pptx
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Approach and Philosophy of On baking technology
PDF
Chapter 3 Spatial Domain Image Processing.pdf
NewMind AI Weekly Chronicles - August'25 Week I
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
KodekX | Application Modernization Development
cuic standard and advanced reporting.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Machine learning based COVID-19 study performance prediction
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Advanced methodologies resolving dimensionality complications for autism neur...
The AUB Centre for AI in Media Proposal.docx
Encapsulation theory and applications.pdf
Big Data Technologies - Introduction.pptx
NewMind AI Monthly Chronicles - July 2025
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Understanding_Digital_Forensics_Presentation.pptx
Building Integrated photovoltaic BIPV_UPV.pdf
20250228 LYD VKU AI Blended-Learning.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Approach and Philosophy of On baking technology
Chapter 3 Spatial Domain Image Processing.pdf

The Quality Gatekeeper Rakuten Travel QA

  • 1. The Quality Gatekeeper Rakuten Travel QA Created by Nokota Susumu QA Manager of Rakuten Travel Tech Conference 2016
  • 2. Contents 1.Introduce about Travel & Myself 2.Travel Development Organization 3.Travel QA Improvement 3-1. Service Improvement Story 3-2. Sustainable QA Process Improvement 4.Summary Rap Up
  • 4. 15
  • 5. Introduce about Myself 2001 2003 2005 2011 2014 Join in my trip company working as Engineer Job’s Biography Join in Rakuten working as Engineer In charge of Domestic Services working as Team leader In charge of Overseas/Accounting Services working as Group Manager In charge of Quality Assurance working as Group Manager Private Info Nokota Susumu ⁃Rakuten Travel ⁃QA Manager Mt.FUJI
  • 9. 9 Mytrip.net Rakuten Travel Inc. 2004: Rakuten Travel Inc. and Mytrip.net were merged. The company name became Rakuten Travel Inc. 2005: Star Tours Japan (currently Rakuten Bus Service) was acquired. 2014: Rakuten Inc. and Rakuten Travel Inc. were merged 1996: Hitachi Zosen’s service “Hotel no madoguchi” was launched 2000: Separation from Hitachi Zosen 1999: Renewal as “Tabi no madoguchi” 2001: Rakuten Inc. begins a new service called “Rakuten Travel” 2002: Separation from Rakuten Inc. 2003: Rakuten Inc. acquires 100% of Mytrip.net. 2006: Rakuten Group and ANA Group formed Rakuten ANA Travel Online. Rakuten Travel History in Details
  • 10. Hotel rooms & plans, Airplane seats, Rental cars, Bus etc… SEO/SEM, Mail magazine, Affiliate Partners Cross Use with Rakuten Ichiba, Super Point Rakuten Travel services are based on the triangle concept of Matching , Inventory and User Traffic. Search, User reviews, Recommendations, Personalization Matching (Booking) Web Traffic Inventory Basic Concept of Service Produce
  • 11. 11 Online Travel Agent in the world No.1
  • 12. 12
  • 14. Travel Service PDM DevQA Travel Development Organization Travel Development Organization is consists of 3 section’s. SDD = Development Team PDM = Product Management Team QA = Quality Assurance Also, we are working with overseas company such as India & China & USA. Development Sections
  • 15. Travel Development Organization Expansion Plan to 2020 2015 2016 2017 2018 2019 2020 SDD(DEV ENG) PDM(Product Management) QA (Quality Assuarance) Growing Development Organization
  • 16. Current Travel Development Flow & Figure Travel Development Flow Issue/idea Come up Discuss the business Opportunity impact File a Wish list Entry Review inspect The Wish list Write down a PRD Anyone In a Brainstorming In Daily Business BU PDM Support Desk BU PDM Lead / SSD / BU Prioritize the Wish list Sort out Bug / DCR / Feature Assign PDM / SSD PDM SSD Designer Integrator Lead SSD Integrator Developer SSD Architect PDM Integrator Lead Integrator PDM Developer Tester Integrator PDM/BU UT Review the PRD Developer Spec Test Spec Develop Release
  • 17. 100 200 400 20 30 6030 40 80 50 100 150 0 50 100 150 200 250 300 350 400 450 2015 2016 2017 PRD (Large Project)/DCR (Small Project) DEV (Development Improvement) MenteBug (DevOps, Bug & Improvement) Urgent Bug Fix How many projects we have testing a year? Number of Development PRD/DCR’s More than 400 PRD’s More than 200 PRD’s
  • 18. Number of Kaizen Figure (Reported at 2016/1-6) How many Kaizen we have last half year? Urgent: Need to fix this as soon as possible. (Incident level) P1: Need to investigate within a few weeks at latest P2: Need to investigate within a few months at latest P3: Nice to investigate and it will be fixed when the dev are available Need to Investigate
  • 19. To Be - Future Test Coverage As Is - Current Test Coverage QA Responsible Test Coverage Goal Engineers QA UT IT QA Release SAT Engineers QA UT IT QA Release SAT
  • 20. Travel QA Improvement Service improvement story of Domestic DP Service
  • 22. Too many bugs (Not enough test) Domestic DP Development Issue vs Regression Development Speed&AgilitySlow Fast Legacy Architecture New Architecture
  • 23. Domestic DP Development Issue vs Regression Development Speed&AgilitySlow Fast Take off all bugs (QA Process) Legacy Architecture New Architecture
  • 24. How to improve QA Process?! PRD/DCR DEV Mente JIRA 1 Test Scope 2 Test Planning 3 Test Case Design 4 Test Execution 5 Release Confirmat ion QA Process Improvement
  • 25. Domestic DP Development Issue vs Regression Small LargeRegression Manual Development Speed&AgilitySlow Fast Take off all bugs (QA Process) Legacy Architecture New Architecture
  • 26. Domestic DP Development Issue vs Regression Small SmallRegression Manual + Automation Development Speed&AgilitySlow Fast Take off all bugs (QA Process) Legacy Architecture New Architecture
  • 27. Travel QA Improvement Sustainable QA Process management
  • 28. Travel Development Flow Issue/idea Come up Discuss the business Opportunity impact File a Wish list Entry Review inspect The Wish list Write down a PRD Anyone In a Brainstorming In Daily Business BU PDM Support Desk BU PDM Lead / SSD / BU Prioritize the Wish list Sort out Bug / DCR / Feature Assign PDM / SSD PDM SSD Designer Integrator Lead SSD Integrator Developer SSD Architect PDM Integrator Lead Integrator PDM Developer Tester Integrator PDM/BU UT Development Main Frame Review the PRD Developer Spec Test Spec Develop Release
  • 29. Travel Development Flow Current Development Flow Test Spec Test Case Design Manual QA (STG) Manual QA (PRD) DevelopmentPRD / DCR DEV Spec Bug Fix & Integration Release Operation Lead SSD Integrator Developer SSD Architect PDM Integrator Lead Integrator PDM Developer Tester Integrator PDM/BU UT Development Main Frame Review the PRD Developer Spec Test Spec Develop Release
  • 30. Sustainable QA Process Improvement Release Planning Release Management To be Test Spec Test Case Design Manual QA (STG) Manual QA (PRD) DevelopmentPRD / DCR DEV Spec Bug Fix & Integration Release Operation Test Spec Test Case Design Manual QA (STG) Manual QA (PRD) Development PRD / DCR DEV / Mente DEV Spec Bug Fix & Integration Release Operation Merge to Regression As Is 1 2 3
  • 31. Sustainable QA Process Improvement Release Management QA Process Management Vision for 2017 Manual Test Spec Test Case Design Manual QA (STG) Manual QA (PRD) Development PRD / DCR DEV / Mente DEV Spec Bug Fix & Integration Release Operation Marge to regression test Automation Case Design Spec Automation QA (STG) Automation Development Marge to regression test Release Planning Automation test (IT & E2E) adapt to DEV team
  • 32. Travel QA is the Final Quality Gatekeeper Travel QA has the responsibility for all bugs, after the product environment release. Therefore, we have 2 Authorities about QA testing & Product Release. This is the one of the big difference between other internet companies. Judge all projects, whether QA Testing is necessary or not. Judge and determine, whether it can release or not. 1, QA Testing 2, Application Release
  • 34. Summary & Rap Up 1 2 43