Qa test managed_code_varhol
Download as PPTX, PDF0 likes67 views
The document discusses testing and assessing performance in managed code for embedded systems. It begins by explaining what managed code is and how it automatically handles memory allocation and deallocation. It then discusses how memory usage affects performance and the importance of testing managed code applications for memory usage. A variety of tools for performance profiling and memory analysis are presented, with caveats about needing to build test harnesses to use the tools for embedded systems. The presentation recommends understanding how managed code works and using tools to examine performance and memory usage to avoid issues from memory misuse in embedded applications.
Qa test managed_code_varhol
- 1. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT Testing and Assessing Performance in Managed Code in Embedded Systems Peter Varhol Test Studio Evangelist email: peter.varhol@telerik.com twitter: @pvarhol
- 2. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT Agenda Why managed code? The role of memory in performance Testing for memory use Summary and questions
- 3. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT Why Managed Code? Courtesy VDC
- 4. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • What is managed code? • Managed code automatically manages memory allocation and deallocation • No programmer intervention Why Managed Code?
- 5. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Allocation involves a request to the free memory list • Deallocation is a process called garbage collection Why Managed Code?
- 6. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Examples of managed languages • C#, Visual Basic, or anything running on Microsoft .NET • Java • Smalltalk and other minor languages Why Managed Code?
- 7. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Embedded systems are more complex • Managed code helps deal with complexities • Fewer defects from automatically managed memory • But . . . • What about performance? Why We Care
- 8. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Performance is about equal to native code • Some caveats • Allocating memory is very fast • Deallocation is non-determinate Why Managed Code?
- 9. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • This means that hard real time performance is problematic • Some coders run GC programmatically • Better know what you’re doing Why Managed Code?
- 10. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Managed alternatives • PERC • Java ME • Others Why Managed Code
- 11. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Memory use is inversely related to performance • Amount of memory • Allocations and deallocations The Role of Memory in Performance
- 12. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • But that doesn’t mean you should allocate only static memory • Total memory matters, too • And embedded devices are limited The Role of Memory in Performance
- 13. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Performance Profiling • Profiling is a sampling technique • Time to execute • Number of times a routine is executed Testing for Memory in Performance
- 14. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Performance analysis • Full look at performance • Method time • Number of passes Testing for Memory in Performance
- 15. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Memory profiling • Object allocations • Object lifespans • Garbage collection Testing for Memory in Performance
- 16. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Excessive time in methods • Something waiting to be synchronized? • Long database calls? • Many cycles through a method • Bad coding practices? What to Look For
- 17. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Memory usage • Allocations are important • But understand the GC model • .NET has multiple generations What to Look For
- 18. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Memory analysis • An ongoing display of memory allocations, size, and deallocations What to Look For
- 19. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • .NET memory generations • 0 – temporary variables • 1 – short-lived objects • 2 – long-lived objects What to Look For
- 20. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Why do you need to know this? • It affects performance • You can provide feedback to development What to Look For
- 21. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Do you need to replace the GC • Third party garbage collectors are available What to Look For
- 22. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • Microsoft Patterns and Practices • And VS Profiler • Just Tools • DevPartner • AQTime Tools for Performance Profiling
- 23. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • MSDN resources • DevPartner • Ants Profiler • MemProfiler Tools for Memory Analysis
- 24. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT • These tools are built for desktop/web applications • You will likely have to build a test harness • And possibly a UI to drive it Caveats
- 25. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT Summary • Memory is a precious commodity in embedded systems • Misuse can cause performance issues and defects • Understand how managed code works • What can go wrong • Use tools to look at performance and memory
- 26. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT Questions
- 27. DEVELOPER TOOLS | HYBRID MOBILE DEVELOPMENT | HTML5 / JAVASCRIPT DEVELOPMENT | SOFTWARE TESTING | WEB PRESENCE PLATFORM | AGILE PROJECT MANAGEMENT www.telerik.com/test-studio @TelerikTesting www.youtube.com/TelerikTestStudio Thank You Peter Varhol Peter.Varhol@telerik.com @pvarhol
Editor's Notes
- #11: "Java ME is now the third-most frequently-used language for embedded development [..], rivaling C/C++“ http://adtmag.com/articles/2013/07/23/java-me-update.aspx The Aonix Perc product line offers Ahead-of-Time (AOT) and Just-in-Time (JIT) compilation, remote debug support, deterministic garbage collection, standard graphics and extended commercial RTOS support.