SlideShare a Scribd company logo
Introduction to ICST 2017
- History, overview, points, Who’s Who, … -
Keizo Tatsumi
Jan. 20, 2017
ICST 2017 Social Networking Chair
Translated into English on Feb. 2017
1 (C) Keizo Tatsumi 2017
Ques - Winter Special Issue -
ICST 2017
 will be held from March 13 to 17 in Tokyo, Japan
2
@Waseda University,
Nishiwaseda Campus
(C) Keizo Tatsumi 2017
Agenda
1. Software Testing Conferences in the World
2. The History of Testing Conference
3. ICST at a Glance
4. ICST 2017 Program Overview
5. Interaction with Foreign Attendees
6. Getting information
3 (C) Keizo Tatsumi 2017
1. Testing Conferences in the World
 Software Testing Conferences 2017
4
Software Testing Magazine http://www.softwaretestingmagazine.com/software-testing-conferences/
(C) Keizo Tatsumi 2017
5
Major Conferences - Academics
 ISSTA (International Symposium on Software Testing and Analysis)
Sponsor: ACM (Association for Computing Machinery)
From 1993. Successor to the testing workshop held in 1978
Participants: Researchers, practitioners. Academic rather than ICST.
Workshops: Constraints, UI test automation, Code analysis framework, etc.
 ICST (International Conference on Software Testing, Verification and Validation)
Sponsor: IEEE (The Institute of Electrical and Electronics Engineers)
From 2008
Participants: Researchers, practitioners. Practical rather than ISSTA.
Workshops: Model-based testing, Mutation analysis, Combinatorial testing, etc.
 ICSE workshops (International Conference on Software Engineering)
AST (Automation of Software Test)
SBST (Search-Based Software Testing)
RST (Requirements Engineering and Testing)
MET (Metamorphic Testing)
(C) Keizo Tatsumi 2017
6
Major Conferences - Practitioners
 STAREAST, STARWEST (Software Testing Analysis & Review Conference)
Host:SQE (Software Quality Engineering)
From 1992
Participants: Consultants, practitioners
 CAST (Conference of the Association for Software Testing)
Host:AST (The Association for Software Testing)
From 2006
Participants: Consultants, practitioners
 EuroSTAR (European conference on Software Testing, Analysis & Review)
Host:QualTech Ltd.
From 1993
Participants: Consultants, practitioners
 その他
GTAC (Google Test Automation Conference)
From 2006, Google’s in-house conference
Agile Testing Days (Europe)
Started in 2009 in Germany.
1st. Agile Testing Days USA will be held in Boston in June, 2017.
(C) Keizo Tatsumi 2017
▲ ▲ ▲ ▲
EDSAC(1st Neumann computer) IBM System/360 IBM System/370 Cray-1
▲ ▲ ▲ ▲ ▲
UNIVAC1(1st commercial computer) DEC PDP-1 DEC PDP-8 Apple PC IBM PC ▲
▲ ▲ ▲ Sun-
IBM 701 IBM 704 Intel 4004MPU
▲ ▲ ▲
Program Test Methods Symposium 1st Workshop 2nd
▲ ▲ on Software Testing Work
Courant Symposium IEEE Symposium on Computer Software Reliability
on Debugging Techniques ▲
in Large Systems International Conference on Reliable Software
1950 1955 1960 1965 1970 1975 1980
Symposium
7
2. The History of Testing Conference
1957, Digital Computer Programming
(McRacken)
•The earliest textbook on programming
•Today's debugging and testing are
described in the "Program Checkout"
chapter
1961, Computer Programming Fundamentals
(Leeds & Weinberg)
•Written by Leeds and Weinberg of IBM
•The first book which provided the "Program
Testing" chapter
1970, Debugging Techniques in Large
Systems (Rustin(Ed.))
•W. Elmendorf(developer of Cause-effect
graphing, IBM) presented "Controlling
the functional testing of an operating
system."
1972, The Computer Program Test Methods
Symposium
•First symposium on software testing
•1973, “Program Test Methods“(Hetzel(Ed.)) is
the first book on software testing
(C) Keizo Tatsumi 2017
Cray-1
▲ ▲ ▲ ▲ ▲
Apple PC IBM PC ▲ Apple Macintosh iPhone iPad
Sun-1 ▲ ▲
Sun SPARC Intel Pentium Pro
▲ ▲ ▲ ▲ ▲ ▲ ▲
1st Workshop 2nd 3rd ISSTA (International Symposium on Software Testing and Analysis)
on Software Testing Workshop Workshop Testing, Verification, ▲
sium on Computer Software Reliability and Analysis (TAV) ICST
tional Conference on Reliable Software
20101980 1985 1990 1995 2000 2005
8
The History of Testing Conference
1978, Software Testing and Test Documentation Workshop
•First workshop on software testing
"This workshop, the first of its kind, brought together some 60
technical experts from all over the world..."
E. Miller, Workshop Report: Software Testing and Test Documentation,
IEEE Computer, 98-107, March 1979.
•The workshop was continuously held in 1982 and 1986, and
succeeded to ISSTA(International Symposium on Software
Testing and Analysis).
Ed Miller
Program Chairman
(C) Keizo Tatsumi 2017
9
3. ICST at a Glance
 1st. ICST was held in 2008
A new forum bridging research and practice
in many areas related to software quality
Composed of both research and industry
tracks, plus workshops on specialized topics
The IEEE International Conference on Software Testing Verification and Validation(ICST)
(C) Keizo Tatsumi 2017
http://www.cs.colostate.edu/icst2008/
 Past events
1. ICST 2008 Lillehammer, Norway April 9-11, 2008
2. ICST 2009 Denver, Colorado, USA April 1-4, 2009
3. ICST 2010 Paris, France April 7-9, 2010
4. ICST 2011 Berlin, Germany March 21-25, 2011
5. ICST 2012 Montreal, QC, Canada April 17-21, 2012
6. ICST 2013 Luxembourg, Luxembourg March 18-22, 2013
7. ICST 2014 Cleveland, Ohio, USA March 31- April 4, 2014
8. ICST 2015 Graz, Austria April 13-17, 2015
9. ICST 2016 Chicago, IL, USA April 10-15, 2016
10. ICST 2017 Tokyo, Japan March 13-17, 2017
10
Schedule (ICST 2013)
Workshops WorkshopsMain Conference
Social Program
(C) Keizo Tatsumi 2017
http://www.icst.lu/site/icst2013/program/schedule
11
Session Topics and Workshops
ICST 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017
Sessions Model Based Testing ○ ○ ○ ○ ○ ○ ○ ○
Test Case Generation ○ ○ ○ ○ ○ ○
Mutation Testing ○ ○ ○ ○ ○ ○
Web Testing ○ ○ ○ ○ ○ ○ ○
GUI Testing ○ ○ ○ ○
Regression Testing ○ ○ ○ ○ ○
Search-Based Testing ○ ○ ○
Security Testing ○ ○ ○
Bugs, Faults, and Failures ○ ○ ○ ○ ○ ○
Coverage, White-box ○ ○ ○ ○ ○ ○
Workshops Model Based Testing ○ ○ ○ ○ ○ ○ ○ ○ ○ ○
Mutation Analysis ○ ○ ○ ○ ○ ○ ○ ○ ○
Security Testing ○ ○ ○ ○ ○ ○
Search-Based Testing ○ ○ ○ ○ ○ ○ ICSEへ
Regression Testing ○ ○ ○ ○
Combinatorial Testing ○ ○ ○ ○ ○ ○
Testing the Cloud ○ ○
Test Architecture ○ ○ ○
TAIC PART ○ ○ ○ ○ ○ ○ ○
11
ITEQS ○
TBD
(C) Keizo Tatsumi 2017
12
# of Attendees, # of Papers
 ICST 2013 Luxemburg
Attendees: 289 (40 countries)
Papers: Submit-120, Accept-30 (25%)
From Japan: Attendees-11, Speakers-6
 ICST 2014 Cleveland, Ohio, USA
Attendees: Main-150, WS-145
Papers: Submit-141, Accept-40 (28%)
From Japan: Attendees-11名, Speakers-6
 ICST 2012 Montreal, Canada
Attendees: 250 (27 countries)
Papers: Submit-176, Accept-46 (26%)
From Japan: Attendees-4, Speakers-0
(C) Keizo Tatsumi 2017
13
# of Attendees, # of Papers
 ICST 2015 Graz, Austria
Attendees: 250
Papers: Submit-129, Accept-32 (25%)
From Japan: Attendees-16, Speakers-10
 ICST 2016 Chicago, IL, USA
Attendees: around 200
Papers: Submit-130, Accept-34 (26%)
From Japan: Attendees-13, Speakers-9
 ICST 2017 Tokyo, Japan
Attendees:
Papers: Submit-135, Accept-36 (27%)
From Japan:
Stay tuned !
(C) Keizo Tatsumi 2017
14
4. ICST 2017 Program Overview
 Program at a Glance
(C) Keizo Tatsumi 2017
3/12(Sun) 3/13(Mon) 3/14(Tue) 3/15(Wed) 3/16(Thu) 3/17(Fri)
Co-located
Events Day
Workshops &
Co-located
Events Day
Main
Conference Day
Main
Conference Day
Main
Conference Day
Workshops &
Doctoral
Symposium Day
・Asian PLoP ・Mutation ・Keynote-1 ・Keynote-2 ・Keynote-3 ・A-MOST
・TAIC PART ・InSTA
・ITEQS ・ACSE
・IWCT
・IWESEP ・Banquet
・Asian PLoP
・IPSJ SIGSE (in
Japanese)
・Doctoral
Symposium
・IPSJ SIGSE (in
Japanese)
・Various
sessions
・Welcome
reception
・Various
sessions
・Various
sessions
・Open steering
committee
15
Main Conference - Keynotes
 Keynote-1 (March 14)
The State of Continuous Integration Testing at Google
Speaker: John Micco, Google, USA
 Keynote-2 (March 15)
Testing and Validation Requirements for Automated
Driving Technology
Speaker: Kenji Nishikawa, Toyota Motor Corporation,
Japan
 Keynote-3 (March 16)
Model-Based Testing and Model Inference: Better
Together!
Speaker: Andreas Zeller, Saarland University, Germany
(C) Keizo Tatsumi 2017
16
Main Conference - Sessions
 Research Sessions
36 full papers and 8 short papers
 Industry Sessions
5 papers
 Testing Tools Sessions
10 papers
 Tool Demonstrations
7 tools
 Software Testing Contest
 Poster Session
13 posters
 Doctoral Symposium
7 papers
(C) Keizo Tatsumi 2017
17
Workshops
 A-MOST: Advances in Model Based Testing
 Mutation: Mutation Analysis
 TAIC PART: Testing: Academia-Industry Collaboration, Practice
and Research Techniques
 IWCT: Combinatorial Testing
 InSTA: Software Test Architecture
 ITEQS: Testing Extra-Functional Properties & Quality Characteristics
of Software Systems
 ACSE: Asian Symposium on Collaborative Software Engineering
(C) Keizo Tatsumi 2017
5. Interaction with Foreign Attendees
18
 Coffee Break
 Welcome Reception
 Banquet
(C) Keizo Tatsumi 2017
Interaction with Foreign Attendees
Social Event (IWCT 2013)
19
 IWCT(Combinatorial Testing Workshop) Folks
With Mr. Jacek Czerwonka
(Developer of PICT) With IWCT 2012 co-chairs
Signatures of the 1st IWCT
attendees on a ICST 2012 tote bag Social Event (IWCT 2016) Authors' autographs! (^^)
(C) Keizo Tatsumi 2017
Interaction with Foreign Attendees
With Prof. Jeff Offutt, George Mason Univ., USA
With Dr. Antonia Bertolino, Italy
 Software testing research leaders at ICST
With Prof. Mauro Pezzé, Italy
Mr. Robert Binder, CMU SEI
Oops!
I wish I had taken a picture …
Many other prominent researchers also participate in ICST.
(C) Keizo Tatsumi 201720
6. Getting Information
21
 ICST 2017 Website
http://aster.or.jp/conference/icst2017/
 ICST 2017 Facebook page
https://www.facebook.com/ICST-2017-
290517964620465/
 ICST 2017 twitter
https://twitter.com/ICST2017
(C) Keizo Tatsumi 2017
Getting Information
22
http://aster.or.jp/activities/investigation.html
 ASTER international investigation activities website
ICST Attendance Reports (2012~2016)
(C) Keizo Tatsumi 2017
(In Japanese)
Why don't you attend
ICST 2017 !
Thank you!
23 (C) Keizo Tatsumi 2017

More Related Content

PDF
「ICST 2017まるわかりDay!」Security Testingトラック論文紹介
PDF
The History of Software Testing
PDF
Content based video summarization into object maps
PDF
ICST 2017の歩き方 -歴史、開催概要、聴きどころ、Who's Who ・・ -
PDF
ICST2015勉強会 ICST2017に向けて
PDF
Combinatorial testing in Japan
PPT
Space-based Information and Solutions for Disaster Management and Emergency ...
PDF
Role of RS & GIS; gis in disaster management prepared by er. bishnu khatri
「ICST 2017まるわかりDay!」Security Testingトラック論文紹介
The History of Software Testing
Content based video summarization into object maps
ICST 2017の歩き方 -歴史、開催概要、聴きどころ、Who's Who ・・ -
ICST2015勉強会 ICST2017に向けて
Combinatorial testing in Japan
Space-based Information and Solutions for Disaster Management and Emergency ...
Role of RS & GIS; gis in disaster management prepared by er. bishnu khatri

Viewers also liked (18)

PDF
鷲崎 愛媛大学講演-プロジェクト型演習2014年12月15日
PDF
Space Technologies for Disaster Management
PDF
Intro to RS and GIS by mndp poonia
PPTX
DROUGHT ANALYSIS
PPTX
Application of gis and remote sensing in disease prevention and control with
PPTX
Rahul Bajpai M.tech Remote sensing & GIS RSACUP
PPTX
GIS IN DISASTER MANAGEMENT
PDF
テスト自動化のこれまでとこれから
PPTX
Application of gis in natural disaster management
PDF
REMOTE SENSING & GIS APPLICATIONS IN WATERSHED MANAGEMENT
PDF
Iirs overview -Remote sensing and GIS application in Water Resources Management
PPTX
Disaster management using Remote sensing and GIS
PPTX
APPLICATIONS OF REMOTE SENSING AND GIS IN WATERSHED MANAGEMENT
PPTX
Application of gis & rs in urban planning
PPT
Intro to GIS and Remote Sensing
PPT
Using ICT for Earthquake Disaster Risk Reduction in Iran
PDF
How to Make Awesome SlideShares: Tips & Tricks
PDF
Getting Started With SlideShare
鷲崎 愛媛大学講演-プロジェクト型演習2014年12月15日
Space Technologies for Disaster Management
Intro to RS and GIS by mndp poonia
DROUGHT ANALYSIS
Application of gis and remote sensing in disease prevention and control with
Rahul Bajpai M.tech Remote sensing & GIS RSACUP
GIS IN DISASTER MANAGEMENT
テスト自動化のこれまでとこれから
Application of gis in natural disaster management
REMOTE SENSING & GIS APPLICATIONS IN WATERSHED MANAGEMENT
Iirs overview -Remote sensing and GIS application in Water Resources Management
Disaster management using Remote sensing and GIS
APPLICATIONS OF REMOTE SENSING AND GIS IN WATERSHED MANAGEMENT
Application of gis & rs in urban planning
Intro to GIS and Remote Sensing
Using ICT for Earthquake Disaster Risk Reduction in Iran
How to Make Awesome SlideShares: Tips & Tricks
Getting Started With SlideShare
Ad

Similar to Introduction to ICST 2017 (20)

PDF
Serviceoriented Computing Icsoc 2008 Workshops Icsoc 2008 International Works...
PDF
Serviceoriented Computing 7th International Joint Conference Icsocservicewave...
PDF
Software Analytics - Achievements and Challenges
PPTX
Intelligent Software Engineering: Synergy between AI and Software Engineering
PDF
202212APSEC.pptx.pdf
PDF
Thirteen Years of SysML: A Systematic Mapping Study
PDF
Research-Based Innovation with Industry: Project Experience and Lessons Learned
PDF
Software Engineering Research: Leading a Double-Agent Life.
PDF
Testing Of Software And Communicating Systems 19th Ifip Tc6wg61 International...
PDF
System Analysis And Modeling 4th International Sdl And Msc Workshop Sam 2004 ...
PDF
Tomorrow's software testing for embedded systems
PDF
Test Automation - Past, Present and Future
PDF
How to Learn The History of Software Testing
PDF
Formal Methods And Software Engineering 10th International Conference On Form...
PDF
Engineering Interactive Systems Second Conference On Humancentered Software E...
PDF
Computer Aided Verification 22nd International Conference Cav 2010 Edinburgh ...
PDF
Logic Programming 24th International Conference Iclp 2008 Udine Italy Decembe...
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PDF
Se research update
PDF
Seminar VU Amsterdam 2015
Serviceoriented Computing Icsoc 2008 Workshops Icsoc 2008 International Works...
Serviceoriented Computing 7th International Joint Conference Icsocservicewave...
Software Analytics - Achievements and Challenges
Intelligent Software Engineering: Synergy between AI and Software Engineering
202212APSEC.pptx.pdf
Thirteen Years of SysML: A Systematic Mapping Study
Research-Based Innovation with Industry: Project Experience and Lessons Learned
Software Engineering Research: Leading a Double-Agent Life.
Testing Of Software And Communicating Systems 19th Ifip Tc6wg61 International...
System Analysis And Modeling 4th International Sdl And Msc Workshop Sam 2004 ...
Tomorrow's software testing for embedded systems
Test Automation - Past, Present and Future
How to Learn The History of Software Testing
Formal Methods And Software Engineering 10th International Conference On Form...
Engineering Interactive Systems Second Conference On Humancentered Software E...
Computer Aided Verification 22nd International Conference Cav 2010 Edinburgh ...
Logic Programming 24th International Conference Iclp 2008 Udine Italy Decembe...
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
Se research update
Seminar VU Amsterdam 2015
Ad

More from Keizo Tatsumi (20)

PDF
ソフトウェアテストの変遷と最近の品質管理の方向性
PDF
SQuBOKの変遷 (SQuBOK V3発行記念イベント)
PDF
ソフトウェアテストの歴史と近年の動向
PDF
組み合わせテストの設計(PictMaster勉強会) 2008年7月17日
PDF
ニューノーマル時代のテストエンジニアへの"food for thought" (JaSST'18 Kansai)
PDF
Timeline to the New Normal for Software Testing
PDF
ソフトウェアテスト年表 - テストのニューノーマルへの流れ
PDF
世界のソフトウェアテストの会議 (JaSST 2018 東京)
PDF
日本における組み合わせテスト - 歴史、適用状況、技法、ツール -
PDF
ソフトウェア品質技術の歴史を振り返る - ソフトウェア品質測定を中心に -
PDF
テスト自動化クロニクル (JaSST 東海 2016)
PDF
ソフトウェアテスト年表-WACATE2015冬
PDF
ソフトウェアテストの最新動向の学び方
PDF
世界に目を向けよう - ASTER国際連携活動事例(JaSST'15 tokyo)
PDF
SQuBOKガイドV2で測る日本のソフトウェア品質技術力
PDF
SQuBOKガイドで測る日本の実力(2007年12月10日)
PDF
Software testing magazines in the world
PDF
ソフトウェアテストの最新動向
PDF
ソフトウェアテスト・ヒストリーの学び方 (WACATE 2010冬 クロージングセッション) 20101219
PDF
Conceptual support for test case design (COMPSAC 87)
ソフトウェアテストの変遷と最近の品質管理の方向性
SQuBOKの変遷 (SQuBOK V3発行記念イベント)
ソフトウェアテストの歴史と近年の動向
組み合わせテストの設計(PictMaster勉強会) 2008年7月17日
ニューノーマル時代のテストエンジニアへの"food for thought" (JaSST'18 Kansai)
Timeline to the New Normal for Software Testing
ソフトウェアテスト年表 - テストのニューノーマルへの流れ
世界のソフトウェアテストの会議 (JaSST 2018 東京)
日本における組み合わせテスト - 歴史、適用状況、技法、ツール -
ソフトウェア品質技術の歴史を振り返る - ソフトウェア品質測定を中心に -
テスト自動化クロニクル (JaSST 東海 2016)
ソフトウェアテスト年表-WACATE2015冬
ソフトウェアテストの最新動向の学び方
世界に目を向けよう - ASTER国際連携活動事例(JaSST'15 tokyo)
SQuBOKガイドV2で測る日本のソフトウェア品質技術力
SQuBOKガイドで測る日本の実力(2007年12月10日)
Software testing magazines in the world
ソフトウェアテストの最新動向
ソフトウェアテスト・ヒストリーの学び方 (WACATE 2010冬 クロージングセッション) 20101219
Conceptual support for test case design (COMPSAC 87)

Recently uploaded (20)

PDF
Design an Analysis of Algorithms II-SECS-1021-03
PDF
Design an Analysis of Algorithms I-SECS-1021-03
PDF
Upgrade and Innovation Strategies for SAP ERP Customers
PDF
How Creative Agencies Leverage Project Management Software.pdf
PDF
System and Network Administration Chapter 2
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
PPTX
Operating system designcfffgfgggggggvggggggggg
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
PDF
AI in Product Development-omnex systems
PDF
PTS Company Brochure 2025 (1).pdf.......
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PDF
Digital Strategies for Manufacturing Companies
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PDF
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
PDF
Which alternative to Crystal Reports is best for small or large businesses.pdf
PDF
System and Network Administraation Chapter 3
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
PPTX
CHAPTER 2 - PM Management and IT Context
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
Design an Analysis of Algorithms II-SECS-1021-03
Design an Analysis of Algorithms I-SECS-1021-03
Upgrade and Innovation Strategies for SAP ERP Customers
How Creative Agencies Leverage Project Management Software.pdf
System and Network Administration Chapter 2
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
Internet Downloader Manager (IDM) Crack 6.42 Build 41
Operating system designcfffgfgggggggvggggggggg
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
AI in Product Development-omnex systems
PTS Company Brochure 2025 (1).pdf.......
Adobe Illustrator 28.6 Crack My Vision of Vector Design
Digital Strategies for Manufacturing Companies
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
Which alternative to Crystal Reports is best for small or large businesses.pdf
System and Network Administraation Chapter 3
How to Migrate SBCGlobal Email to Yahoo Easily
CHAPTER 2 - PM Management and IT Context
VVF-Customer-Presentation2025-Ver1.9.pptx

Introduction to ICST 2017

  • 1. Introduction to ICST 2017 - History, overview, points, Who’s Who, … - Keizo Tatsumi Jan. 20, 2017 ICST 2017 Social Networking Chair Translated into English on Feb. 2017 1 (C) Keizo Tatsumi 2017 Ques - Winter Special Issue -
  • 2. ICST 2017  will be held from March 13 to 17 in Tokyo, Japan 2 @Waseda University, Nishiwaseda Campus (C) Keizo Tatsumi 2017
  • 3. Agenda 1. Software Testing Conferences in the World 2. The History of Testing Conference 3. ICST at a Glance 4. ICST 2017 Program Overview 5. Interaction with Foreign Attendees 6. Getting information 3 (C) Keizo Tatsumi 2017
  • 4. 1. Testing Conferences in the World  Software Testing Conferences 2017 4 Software Testing Magazine http://www.softwaretestingmagazine.com/software-testing-conferences/ (C) Keizo Tatsumi 2017
  • 5. 5 Major Conferences - Academics  ISSTA (International Symposium on Software Testing and Analysis) Sponsor: ACM (Association for Computing Machinery) From 1993. Successor to the testing workshop held in 1978 Participants: Researchers, practitioners. Academic rather than ICST. Workshops: Constraints, UI test automation, Code analysis framework, etc.  ICST (International Conference on Software Testing, Verification and Validation) Sponsor: IEEE (The Institute of Electrical and Electronics Engineers) From 2008 Participants: Researchers, practitioners. Practical rather than ISSTA. Workshops: Model-based testing, Mutation analysis, Combinatorial testing, etc.  ICSE workshops (International Conference on Software Engineering) AST (Automation of Software Test) SBST (Search-Based Software Testing) RST (Requirements Engineering and Testing) MET (Metamorphic Testing) (C) Keizo Tatsumi 2017
  • 6. 6 Major Conferences - Practitioners  STAREAST, STARWEST (Software Testing Analysis & Review Conference) Host:SQE (Software Quality Engineering) From 1992 Participants: Consultants, practitioners  CAST (Conference of the Association for Software Testing) Host:AST (The Association for Software Testing) From 2006 Participants: Consultants, practitioners  EuroSTAR (European conference on Software Testing, Analysis & Review) Host:QualTech Ltd. From 1993 Participants: Consultants, practitioners  その他 GTAC (Google Test Automation Conference) From 2006, Google’s in-house conference Agile Testing Days (Europe) Started in 2009 in Germany. 1st. Agile Testing Days USA will be held in Boston in June, 2017. (C) Keizo Tatsumi 2017
  • 7. ▲ ▲ ▲ ▲ EDSAC(1st Neumann computer) IBM System/360 IBM System/370 Cray-1 ▲ ▲ ▲ ▲ ▲ UNIVAC1(1st commercial computer) DEC PDP-1 DEC PDP-8 Apple PC IBM PC ▲ ▲ ▲ ▲ Sun- IBM 701 IBM 704 Intel 4004MPU ▲ ▲ ▲ Program Test Methods Symposium 1st Workshop 2nd ▲ ▲ on Software Testing Work Courant Symposium IEEE Symposium on Computer Software Reliability on Debugging Techniques ▲ in Large Systems International Conference on Reliable Software 1950 1955 1960 1965 1970 1975 1980 Symposium 7 2. The History of Testing Conference 1957, Digital Computer Programming (McRacken) •The earliest textbook on programming •Today's debugging and testing are described in the "Program Checkout" chapter 1961, Computer Programming Fundamentals (Leeds & Weinberg) •Written by Leeds and Weinberg of IBM •The first book which provided the "Program Testing" chapter 1970, Debugging Techniques in Large Systems (Rustin(Ed.)) •W. Elmendorf(developer of Cause-effect graphing, IBM) presented "Controlling the functional testing of an operating system." 1972, The Computer Program Test Methods Symposium •First symposium on software testing •1973, “Program Test Methods“(Hetzel(Ed.)) is the first book on software testing (C) Keizo Tatsumi 2017
  • 8. Cray-1 ▲ ▲ ▲ ▲ ▲ Apple PC IBM PC ▲ Apple Macintosh iPhone iPad Sun-1 ▲ ▲ Sun SPARC Intel Pentium Pro ▲ ▲ ▲ ▲ ▲ ▲ ▲ 1st Workshop 2nd 3rd ISSTA (International Symposium on Software Testing and Analysis) on Software Testing Workshop Workshop Testing, Verification, ▲ sium on Computer Software Reliability and Analysis (TAV) ICST tional Conference on Reliable Software 20101980 1985 1990 1995 2000 2005 8 The History of Testing Conference 1978, Software Testing and Test Documentation Workshop •First workshop on software testing "This workshop, the first of its kind, brought together some 60 technical experts from all over the world..." E. Miller, Workshop Report: Software Testing and Test Documentation, IEEE Computer, 98-107, March 1979. •The workshop was continuously held in 1982 and 1986, and succeeded to ISSTA(International Symposium on Software Testing and Analysis). Ed Miller Program Chairman (C) Keizo Tatsumi 2017
  • 9. 9 3. ICST at a Glance  1st. ICST was held in 2008 A new forum bridging research and practice in many areas related to software quality Composed of both research and industry tracks, plus workshops on specialized topics The IEEE International Conference on Software Testing Verification and Validation(ICST) (C) Keizo Tatsumi 2017 http://www.cs.colostate.edu/icst2008/  Past events 1. ICST 2008 Lillehammer, Norway April 9-11, 2008 2. ICST 2009 Denver, Colorado, USA April 1-4, 2009 3. ICST 2010 Paris, France April 7-9, 2010 4. ICST 2011 Berlin, Germany March 21-25, 2011 5. ICST 2012 Montreal, QC, Canada April 17-21, 2012 6. ICST 2013 Luxembourg, Luxembourg March 18-22, 2013 7. ICST 2014 Cleveland, Ohio, USA March 31- April 4, 2014 8. ICST 2015 Graz, Austria April 13-17, 2015 9. ICST 2016 Chicago, IL, USA April 10-15, 2016 10. ICST 2017 Tokyo, Japan March 13-17, 2017
  • 10. 10 Schedule (ICST 2013) Workshops WorkshopsMain Conference Social Program (C) Keizo Tatsumi 2017 http://www.icst.lu/site/icst2013/program/schedule
  • 11. 11 Session Topics and Workshops ICST 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 Sessions Model Based Testing ○ ○ ○ ○ ○ ○ ○ ○ Test Case Generation ○ ○ ○ ○ ○ ○ Mutation Testing ○ ○ ○ ○ ○ ○ Web Testing ○ ○ ○ ○ ○ ○ ○ GUI Testing ○ ○ ○ ○ Regression Testing ○ ○ ○ ○ ○ Search-Based Testing ○ ○ ○ Security Testing ○ ○ ○ Bugs, Faults, and Failures ○ ○ ○ ○ ○ ○ Coverage, White-box ○ ○ ○ ○ ○ ○ Workshops Model Based Testing ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ Mutation Analysis ○ ○ ○ ○ ○ ○ ○ ○ ○ Security Testing ○ ○ ○ ○ ○ ○ Search-Based Testing ○ ○ ○ ○ ○ ○ ICSEへ Regression Testing ○ ○ ○ ○ Combinatorial Testing ○ ○ ○ ○ ○ ○ Testing the Cloud ○ ○ Test Architecture ○ ○ ○ TAIC PART ○ ○ ○ ○ ○ ○ ○ 11 ITEQS ○ TBD (C) Keizo Tatsumi 2017
  • 12. 12 # of Attendees, # of Papers  ICST 2013 Luxemburg Attendees: 289 (40 countries) Papers: Submit-120, Accept-30 (25%) From Japan: Attendees-11, Speakers-6  ICST 2014 Cleveland, Ohio, USA Attendees: Main-150, WS-145 Papers: Submit-141, Accept-40 (28%) From Japan: Attendees-11名, Speakers-6  ICST 2012 Montreal, Canada Attendees: 250 (27 countries) Papers: Submit-176, Accept-46 (26%) From Japan: Attendees-4, Speakers-0 (C) Keizo Tatsumi 2017
  • 13. 13 # of Attendees, # of Papers  ICST 2015 Graz, Austria Attendees: 250 Papers: Submit-129, Accept-32 (25%) From Japan: Attendees-16, Speakers-10  ICST 2016 Chicago, IL, USA Attendees: around 200 Papers: Submit-130, Accept-34 (26%) From Japan: Attendees-13, Speakers-9  ICST 2017 Tokyo, Japan Attendees: Papers: Submit-135, Accept-36 (27%) From Japan: Stay tuned ! (C) Keizo Tatsumi 2017
  • 14. 14 4. ICST 2017 Program Overview  Program at a Glance (C) Keizo Tatsumi 2017 3/12(Sun) 3/13(Mon) 3/14(Tue) 3/15(Wed) 3/16(Thu) 3/17(Fri) Co-located Events Day Workshops & Co-located Events Day Main Conference Day Main Conference Day Main Conference Day Workshops & Doctoral Symposium Day ・Asian PLoP ・Mutation ・Keynote-1 ・Keynote-2 ・Keynote-3 ・A-MOST ・TAIC PART ・InSTA ・ITEQS ・ACSE ・IWCT ・IWESEP ・Banquet ・Asian PLoP ・IPSJ SIGSE (in Japanese) ・Doctoral Symposium ・IPSJ SIGSE (in Japanese) ・Various sessions ・Welcome reception ・Various sessions ・Various sessions ・Open steering committee
  • 15. 15 Main Conference - Keynotes  Keynote-1 (March 14) The State of Continuous Integration Testing at Google Speaker: John Micco, Google, USA  Keynote-2 (March 15) Testing and Validation Requirements for Automated Driving Technology Speaker: Kenji Nishikawa, Toyota Motor Corporation, Japan  Keynote-3 (March 16) Model-Based Testing and Model Inference: Better Together! Speaker: Andreas Zeller, Saarland University, Germany (C) Keizo Tatsumi 2017
  • 16. 16 Main Conference - Sessions  Research Sessions 36 full papers and 8 short papers  Industry Sessions 5 papers  Testing Tools Sessions 10 papers  Tool Demonstrations 7 tools  Software Testing Contest  Poster Session 13 posters  Doctoral Symposium 7 papers (C) Keizo Tatsumi 2017
  • 17. 17 Workshops  A-MOST: Advances in Model Based Testing  Mutation: Mutation Analysis  TAIC PART: Testing: Academia-Industry Collaboration, Practice and Research Techniques  IWCT: Combinatorial Testing  InSTA: Software Test Architecture  ITEQS: Testing Extra-Functional Properties & Quality Characteristics of Software Systems  ACSE: Asian Symposium on Collaborative Software Engineering (C) Keizo Tatsumi 2017
  • 18. 5. Interaction with Foreign Attendees 18  Coffee Break  Welcome Reception  Banquet (C) Keizo Tatsumi 2017
  • 19. Interaction with Foreign Attendees Social Event (IWCT 2013) 19  IWCT(Combinatorial Testing Workshop) Folks With Mr. Jacek Czerwonka (Developer of PICT) With IWCT 2012 co-chairs Signatures of the 1st IWCT attendees on a ICST 2012 tote bag Social Event (IWCT 2016) Authors' autographs! (^^) (C) Keizo Tatsumi 2017
  • 20. Interaction with Foreign Attendees With Prof. Jeff Offutt, George Mason Univ., USA With Dr. Antonia Bertolino, Italy  Software testing research leaders at ICST With Prof. Mauro Pezzé, Italy Mr. Robert Binder, CMU SEI Oops! I wish I had taken a picture … Many other prominent researchers also participate in ICST. (C) Keizo Tatsumi 201720
  • 21. 6. Getting Information 21  ICST 2017 Website http://aster.or.jp/conference/icst2017/  ICST 2017 Facebook page https://www.facebook.com/ICST-2017- 290517964620465/  ICST 2017 twitter https://twitter.com/ICST2017 (C) Keizo Tatsumi 2017
  • 22. Getting Information 22 http://aster.or.jp/activities/investigation.html  ASTER international investigation activities website ICST Attendance Reports (2012~2016) (C) Keizo Tatsumi 2017 (In Japanese)
  • 23. Why don't you attend ICST 2017 ! Thank you! 23 (C) Keizo Tatsumi 2017