SlideShare a Scribd company logo
Myths about static analysis. The third
myth - dynamic analysis is better than
static analysis
Author: Andrey Karpov
Date: 03.11.2011
While communicating with people on forums, I noticed there are a few lasting misconceptions
concerning the static analysis methodology. I decided to write a series of brief articles where I want to
show you the real state of things.
The third myth is: "Dynamic analysis performed by tools like valgrind for C/C++ is much better than
static code analysis".
The statement is rather strange. Dynamic and static analyses are just two different methodologies which
supplement each other. Programmers seem to understand it, but I hear it again and again that dynamic
analysis is better than static analysis.
Let me list advantages of static code analysis.
Diagnostics of all the branches in a program
Dynamic analysis in practice cannot cover all the branches of a program. After these words, fans of
valgrind tell me that one should create appropriate tests. They are right in theory. But anyone who tried
to create them understands how complicated and long it is. In practice, even good tests cover not more
than 80% of program code.
It is especially noticeable in code fragments handling non-standard/emergency situations. If you take an
old project and check it with a static analyzer, most errors will be detected in these very places. The
reason is that even if the project is old, these fragments stay almost untested. Here is a brief example to
show you what I mean (FCE Ultra project):
fp = fopen(name,"wb");
int x = 0;
if (!fp)
int x = 1;
The 'x' flag will not be equal to one if the file wasn't opened. It is because of such errors that something
goes wrong in programs: they crash or generate meaningless messages instead of adequate error
messages.
Scalability
To be able to check large projects through dynamic methods regularly, you have to create a special
infrastructure. You need special tests. You need to launch several instances of an application in parallel
with different input data.
Static analysis is scaled several times easier. Usually you need only a multi-core computer to run a tool
performing static analysis.
Analysis at a higher level
One of the advantages of dynamic analysis is that it knows what function and with what arguments is
being called. Consequently, it can check if the call is correct. Static analysis can't know it and can't check
arguments' values in most cases. This is a disadvantage of this method. But static analysis performs
analysis at a higher level than dynamic analysis. This feature allows a static analyzer to detect issues
which are correct from the viewpoint of dynamic analysis. Here is a simple example (ReactOS project):
void Mapdesc::identify( REAL dest[MAXCOORDS][MAXCOORDS] )
{
memset( dest, 0, sizeof( dest ) );
for( int i=0; i != hcoords; i++ )
dest[i][i] = 1.0;
}
Everything is good here from the viewpoint of dynamic analysis, while static analysis gives the alarm
because it is very suspicious that the number of bytes being cleared in an array coincides with the
number of bytes the pointer consists of.
Here you are another example from the Clang project:
MapTy PerPtrTopDown;
MapTy PerPtrBottomUp;
void clearBottomUpPointers() {
PerPtrTopDown.clear();
}
void clearTopDownPointers() {
PerPtrTopDown.clear();
}
Is there anything here dynamic analysis may find suspicious? Nothing. But a static analyzer can suspect
there is something wrong. The error is this: inside clearBottomUpPointers() there must be this code:
"PerPtrBottomUp.clear();".

More Related Content

PDF
Static and Dynamic Code Analysis
PPTX
Interesting MATLAB Projects Research Help
PPTX
IEEE MATLAB Projects Research Ideas
PPTX
MATLAB Research Project Topics
PPTX
Software Evaluation
PPTX
Ai project report
PPTX
Excception handling
ODP
RandomTest - Random Software Integration Tests That Just Work for C/C++, Java...
Static and Dynamic Code Analysis
Interesting MATLAB Projects Research Help
IEEE MATLAB Projects Research Ideas
MATLAB Research Project Topics
Software Evaluation
Ai project report
Excception handling
RandomTest - Random Software Integration Tests That Just Work for C/C++, Java...

Viewers also liked (20)

PPTX
Mobile vs. Desktop Browsers
PPTX
公共圖書館建設規劃工作的幾點思考
PDF
Future of Testing, Test Automation and The Quality Analyst
PPTX
PDF
Deciding what to build without killing each other
DOCX
Employee performance review phrases
PDF
Get Internet Number Resources from ARIN (IPv4, IPv6, ASNs)
PDF
Snap: The SME's guide to the social media landscape
DOC
Questionnaire on Work Culture
PPT
Tata Motors & JLR Merger
PDF
Permendiknas Nomor 20 Tahun 2007: Standar Penilaian Pendidikan
PPT
Ratio Analysis No. 1 CMD
PDF
InMobi Insights : The State of Mobile App Monetization, Q3 - 2014
PDF
Pmp 簡易快速記憶圖法
PDF
100 energizers
PDF
Domain Event - The Hidden Gem of DDD
PDF
Say Cheese! Using Pictures to Teach Reading
PDF
100 images for visual brainstorming
PDF
Apps for the Connected World: Supercharge Customer Data with Code Halos
PDF
Hardware trends 2015
 
Mobile vs. Desktop Browsers
公共圖書館建設規劃工作的幾點思考
Future of Testing, Test Automation and The Quality Analyst
Deciding what to build without killing each other
Employee performance review phrases
Get Internet Number Resources from ARIN (IPv4, IPv6, ASNs)
Snap: The SME's guide to the social media landscape
Questionnaire on Work Culture
Tata Motors & JLR Merger
Permendiknas Nomor 20 Tahun 2007: Standar Penilaian Pendidikan
Ratio Analysis No. 1 CMD
InMobi Insights : The State of Mobile App Monetization, Q3 - 2014
Pmp 簡易快速記憶圖法
100 energizers
Domain Event - The Hidden Gem of DDD
Say Cheese! Using Pictures to Teach Reading
100 images for visual brainstorming
Apps for the Connected World: Supercharge Customer Data with Code Halos
Hardware trends 2015
 
Ad

Similar to Myths about static analysis. The third myth - dynamic analysis is better than static analysis (20)

PDF
0136 ideal static_analyzer
PDF
An ideal static analyzer, or why ideals are unachievable
PDF
Dynamic Program Analysis for Fun and Profit
PDF
Static analysis is most efficient when being used regularly. We'll tell you w...
PDF
Static analysis is most efficient when being used regularly. We'll tell you w...
PPTX
What a DevOps specialist has to know about static code analysis
PDF
Regular use of static code analysis in team development
PDF
Difficulties of comparing code analyzers, or don't forget about usability
PDF
Difficulties of comparing code analyzers, or don't forget about usability
PDF
Difficulties of comparing code analyzers, or don't forget about usability
PDF
Videos about static code analysis
PPTX
Static-Analysis-in-Industry.pptx
PDF
What's the Difference Between Static Analysis and Compiler Warnings?
PPTX
The Use of Static Code Analysis When Teaching or Developing Open-Source Software
PPTX
Does static analysis need machine learning?
PPTX
Why every dev team needs static analysis
PDF
OORPT Dynamic Analysis
PDF
talk_2015_07_01_Imperial_College_slides
PDF
Regular use of static code analysis in team development
PDF
Regular use of static code analysis in team development
0136 ideal static_analyzer
An ideal static analyzer, or why ideals are unachievable
Dynamic Program Analysis for Fun and Profit
Static analysis is most efficient when being used regularly. We'll tell you w...
Static analysis is most efficient when being used regularly. We'll tell you w...
What a DevOps specialist has to know about static code analysis
Regular use of static code analysis in team development
Difficulties of comparing code analyzers, or don't forget about usability
Difficulties of comparing code analyzers, or don't forget about usability
Difficulties of comparing code analyzers, or don't forget about usability
Videos about static code analysis
Static-Analysis-in-Industry.pptx
What's the Difference Between Static Analysis and Compiler Warnings?
The Use of Static Code Analysis When Teaching or Developing Open-Source Software
Does static analysis need machine learning?
Why every dev team needs static analysis
OORPT Dynamic Analysis
talk_2015_07_01_Imperial_College_slides
Regular use of static code analysis in team development
Regular use of static code analysis in team development
Ad

Myths about static analysis. The third myth - dynamic analysis is better than static analysis

  • 1. Myths about static analysis. The third myth - dynamic analysis is better than static analysis Author: Andrey Karpov Date: 03.11.2011 While communicating with people on forums, I noticed there are a few lasting misconceptions concerning the static analysis methodology. I decided to write a series of brief articles where I want to show you the real state of things. The third myth is: "Dynamic analysis performed by tools like valgrind for C/C++ is much better than static code analysis". The statement is rather strange. Dynamic and static analyses are just two different methodologies which supplement each other. Programmers seem to understand it, but I hear it again and again that dynamic analysis is better than static analysis. Let me list advantages of static code analysis. Diagnostics of all the branches in a program Dynamic analysis in practice cannot cover all the branches of a program. After these words, fans of valgrind tell me that one should create appropriate tests. They are right in theory. But anyone who tried to create them understands how complicated and long it is. In practice, even good tests cover not more than 80% of program code. It is especially noticeable in code fragments handling non-standard/emergency situations. If you take an old project and check it with a static analyzer, most errors will be detected in these very places. The reason is that even if the project is old, these fragments stay almost untested. Here is a brief example to show you what I mean (FCE Ultra project): fp = fopen(name,"wb"); int x = 0; if (!fp) int x = 1; The 'x' flag will not be equal to one if the file wasn't opened. It is because of such errors that something goes wrong in programs: they crash or generate meaningless messages instead of adequate error messages.
  • 2. Scalability To be able to check large projects through dynamic methods regularly, you have to create a special infrastructure. You need special tests. You need to launch several instances of an application in parallel with different input data. Static analysis is scaled several times easier. Usually you need only a multi-core computer to run a tool performing static analysis. Analysis at a higher level One of the advantages of dynamic analysis is that it knows what function and with what arguments is being called. Consequently, it can check if the call is correct. Static analysis can't know it and can't check arguments' values in most cases. This is a disadvantage of this method. But static analysis performs analysis at a higher level than dynamic analysis. This feature allows a static analyzer to detect issues which are correct from the viewpoint of dynamic analysis. Here is a simple example (ReactOS project): void Mapdesc::identify( REAL dest[MAXCOORDS][MAXCOORDS] ) { memset( dest, 0, sizeof( dest ) ); for( int i=0; i != hcoords; i++ ) dest[i][i] = 1.0; } Everything is good here from the viewpoint of dynamic analysis, while static analysis gives the alarm because it is very suspicious that the number of bytes being cleared in an array coincides with the number of bytes the pointer consists of. Here you are another example from the Clang project: MapTy PerPtrTopDown; MapTy PerPtrBottomUp; void clearBottomUpPointers() { PerPtrTopDown.clear(); } void clearTopDownPointers() { PerPtrTopDown.clear(); } Is there anything here dynamic analysis may find suspicious? Nothing. But a static analyzer can suspect there is something wrong. The error is this: inside clearBottomUpPointers() there must be this code: "PerPtrBottomUp.clear();".