SlideShare a Scribd company logo

Advanced Malware Analysis Training Session 4 - Anti-Analysis Techniques

Download as PPTX, PDF
securityxploded, profile picture
securityxploded

This document provides an overview of an advanced malware analysis training program. It includes sections on anti-reversing techniques used by malware like anti-debugging and anti-VM methods. It also covers anti-anti-reversing techniques and includes an agenda for the training with topics like API-based debugging detection, flags-based checks, and virtual machine detection techniques.

Related topics:
Malware Analysis Guide
1 of 28
Downloaded 305 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
Advanced Malware Analysis Training Series www.SecurityXploded.com
Disclaimer The Content, Demonstration, Source Code and Programs presented here is "AS IS" without any warranty or conditions of any kind. Also the views/ideas/knowledge expressed here are solely of the trainer‟s only and nothing to do with the company or the organization in which the trainer is currently working. However in no circumstances neither the Trainer nor SecurityXploded is responsible for any damage or loss caused due to use or misuse of the information presented here. www.SecurityXploded.com
Acknowledgement  Special thanks to Null community for their extended support and co-operation.  Special thanks to ThoughtWorks for the beautiful venue.  Thanks to all the trainers who have devoted their precious time and countless hours to make it happen. www.SecurityXploded.com
Advanced Malware Analysis Training This presentation is part of our Advanced Malware Analysis Training program. Currently it is delivered only during our local meets for FREE of cost. For complete details of this course, visit our Security Training page. www.SecurityXploded.com
Who am I? Swapnil Pathak  Security Researcher  Reversing, Malware Analysis, Exploit Analysis etc.  E-mail: swapnilpathak101@gmail.com www.SecurityXploded.com
Agenda  Introduction  Anti-Reversing techniques  Anti-Debugging  Anti-VM  Anti-Anti-Reversing techniques  Q&A www.SecurityXploded.com
Anti-Reversing  Implementation of techniques in code to hinder attempts at reverse engineering or debugging a target binary.  Used by commercial protectors, packers and malicious software  Covers  Anti-Debugging  Anti-VM  Anti-Disassembly  Code Obfuscation www.SecurityXploded.com
Anti-Debug Techniques  Techniques implemented to detect if the program is running under control of a debugger.  Categorized as below  API Based  Flags Based  Timing Based  Exception Based  Breakpoint Detection www.SecurityXploded.com
PEB (Process Environment Block)  Structure maintained by OS for each running process  Contains user mode parameters associated with a process  Including loaded modules list, debugger status etc  Referenced through fs:[30h]  !peb command in Windbg www.SecurityXploded.com
www.SecurityXploded.com
API Based  IsDebuggerPresent  Exported by kernel32.dll  Function accepts no parameters  Checks if BeingDebugged flag in Process Environment Block (PEB) is set  Returns 1 if process is being debugged, 0 otherwise call IsDebuggerPresent test eax,eax jnz debugger_detected CheckRemoteDebuggerPresent => NtQueryInformationProcess  CheckRemoteDubggerPresent(Handle to the target process, Pointer to a variable  Sets the variable to TRUE if the specified process is being debugged or FALSE otherwise push offset dbg push -1 call CheckRemoteDebuggerPresent test eax, eax jne debugger_detected www.SecurityXploded.com
API Based  NtQueryInformationProcess => ZwQueryInformationProcess  Exported by ntdll.dll  Retrieves information about the specified process.  NtQueryInformationProcess(ProcessHandle, ProcessInformationClass, ProcessInformation, ProcessInformationLength, ReturnLength)  ProcessHandle – Handle to the process for which information is to be retrieved.  ProcessInformationClass : Type of process information to be retrieved. ○ Accepts following values : ProcessBasicInformation(0x0), ProcessDebugPort(0x07), ProcessWow64Information(0x26), ProcessImageFileName(0x27)  ProcessDebugPort : Retrieves port number of the debugger for the process.  Non Zero value indicates that the process is being debugged. www.SecurityXploded.com
API Based  OutputDebugString  Exported by kernel32.dll  Accepts one parameter : Null terminated string to be displayed  Sends a string to the debugger for display  Sends an error if there is no active debugger for the process to receive the string.  No error indicates presence of a debugger.  FindWindow  Exported by user32.dll  Used to search windows by name or class.  Detect debugger with graphical user interface www.SecurityXploded.com
API Based  CloseHandle  Exported by kernel32.dll  Involves passing invalid handle  If debugger present EXCEPTION_INVALID_HANDLE (0xC0000008) will be raised  Above exception if intercepted by an exception handler, indicates presence of a debugger. push 12ab ; any illegal value call CloseHandle www.SecurityXploded.com
Flags Based  BeingDebugged Flag  Present in PEB ( Process Environment Block) at offset 0x2  Set to 1 if the process is being debugged. mov eax, dword [fs:0x30] movzx eax, byte [eax + 0x02] ; PEB.BeingDebugged test eax, eax jnz debugger_detected www.SecurityXploded.com
Flags Based  NTGlobal Flag  Present in PEB ( Process Environment Block) at offset ○ 0x68 - 32 bit systems ○ 0xBC - 64 bit systems  Contains value 0x70 if the process is being debugged.  FLG_HEAP_ENABLE_TAIL_CHECK(0x10), FLG_HEAP_ENABLE_FREE_CHECK(0x20), FLG_HEAP_VALIDATE_PARAMETERS(0x40) mov eax, fs :[30h] mov eax, [eax+68h] and eax, 0x70 test eax, eax jne debugger_detected www.SecurityXploded.com
Flags Based  Heap Flags  ProcessHeap present in PEB ( Process Environment Block) at offset 0x18  Has Flags and ForceFlags Fields set to 0x02 (HEAP_GROWABLE) and 0x0 respectively if the process is not being debugged. mov eax, fs:[30h] mov eax, [eax + 18h] ; eax = PEB.ProcessHeap cmp [eax + 10h] , 0 ; ProcessHeap.ForceFlags jne debugger_detected cmp [eax + 0x0c], 2 ; ProcessHeap.Flags jne debugger_detected www.SecurityXploded.com
Timing Based  Timing Checks  Compares time spent executing instructions normally and while being debugged.  Longer time taken compared to normal run indicates that the binary is being debugged.  RDTSC ( Read Time Stamp Counter)  GetTickCount()  QueryPerformanceCounter() rdtsc mov eax, ebx ……. rdtsc sub eax, ecx cmp eax, 0x100 ja debugger_detected www.SecurityXploded.com
Exception Based  Interrupts  Consists of inserting interrupt instructions in middle of valid sequence of instructions.  INT3 breakpoint (0xCC, 0xCD 0x03)  INT 1 single step INT2D are stepped through inside the debugger, exception is raised.  If the process is being debugged, exception handler is not invoked as the debugger typically handles the exception  Checks such as setting of flags inside exception handler are used to detect presence of the debugger. www.SecurityXploded.com
Breakpoint Detection  Hardware Breakpoints  Whenever an exception occurs, a context structure is created and passed to the exception handler.  Context structure contains values of general registers, control registers, debug registers.  Binary being debugged with hardware breakpoints in use will contain values in debug registers indicating presence of debugger.  Memory Breakpoints  Implemented using Guard pages.  Guard Pages are set using the PAGE_GUARD page protection modifier.  Address accessed part of Guard Page will result in STATUS_GUARD_PAGE_VIOLATION exception.  Process being debugged under Ollydbg will treat this as a memory breakpoint and no exception will be raised. www.SecurityXploded.com
VM Detection  Techniques implemented to detect if the binary is being executed in a virtual environment.  Techniques include  Memory based  Backdoor I/O communication port  Process/Registry www.SecurityXploded.com
Techniques  Memory specific techniques include Red Pill  Only one IDT, GDT, LDT per processor.  IDT : Used by OS to determine correct response to interrupts and exceptions  GDT/LDT : Define characteristics of the various memory areas used during program execution such as base address, size and access privileges.  IDTR, GDTR, LDTR are internal registers that store the address of these respective tables.  To avoid conflicts between host and guest OS , virtual machine needs to relocate IDT, GDT, LDT  SIDT, SGDT and SLDT are instructions to retrieve values from IDTR, GDTR and LDTR respectively.  Base address stored in the register define if under Virtualized environment.  IDT is at 0x80ffffff in Windows, 0xE8xxxxxx in VirtualPC, 0xFFxxxxxx in Vmware. www.SecurityXploded.com
www.SecurityXploded.com
Techniques  Backdoor I/O port  OS running inside a VMWware uses port name „VX‟ for communication between the host and guest OS.  Data from this port can be read using various opcodes using “IN” instruction ○ 0x0A provides Vmware version. ○ 0x14 gets the memory size. ○ Value checked against „VMXh‟ to detect presence of Vmware  Process/Service Check  Check for Vmware related process, services  Process Name ( Associated Service Name )  vmacthlp.exe ( Vmware Physical Disk Helper Service )  vmtoolsd.exe ( Vmware Tools ) www.SecurityXploded.com
Anti-Anti-Debug Techniques  Manually patch values in memory, registers, return values from APIs  NOP sequence of instructions  Use of Plugins  OllyAdvanced  HideDebugger  Phantom  Anti-Anti-Debugger Plugins : https://code.google.com/p/aadp/ www.SecurityXploded.com
OllyDbg Screenshots www.SecurityXploded.com
References Complete Reference Guide for Advanced Malware Analysis Training [Include links for all the Demos & Tools] www.SecurityXploded.com
Thank You ! www.SecurityXploded.com www.SecurityXploded.com

More Related Content

PPTX
Reversing & Malware Analysis Training Part 13 - Future Roadmap
securityxploded
 
PPTX
Advanced Malware Analysis Training Session 6 - Malware Sandbox Analysis
securityxploded
 
PPTX
Reversing & Malware Analysis Training Part 9 - Advanced Malware Analysis
securityxploded
 
PPTX
Reversing & malware analysis training part 1 lab setup guide
securityxploded
 
PPTX
Advanced Malware Analysis Training Session 8 - Introduction to Android
securityxploded
 
PPTX
Reversing & malware analysis training part 2 introduction to windows internals
securityxploded
 
PPTX
Advanced Malware Analysis Training Session 3 - Botnet Analysis Part 2
securityxploded
 
PPTX
Advanced Malware Analysis Training Session 1 - Detection and Removal of Malwares
securityxploded
 
Reversing & Malware Analysis Training Part 13 - Future Roadmap
securityxploded
 
Advanced Malware Analysis Training Session 6 - Malware Sandbox Analysis
securityxploded
 
Reversing & Malware Analysis Training Part 9 - Advanced Malware Analysis
securityxploded
 
Reversing & malware analysis training part 1 lab setup guide
securityxploded
 
Advanced Malware Analysis Training Session 8 - Introduction to Android
securityxploded
 
Reversing & malware analysis training part 2 introduction to windows internals
securityxploded
 
Advanced Malware Analysis Training Session 3 - Botnet Analysis Part 2
securityxploded
 
Advanced Malware Analysis Training Session 1 - Detection and Removal of Malwares
securityxploded
 

What's hot (20)

PPTX
Advanced Malware Analysis Training Session 5 - Reversing Automation
securityxploded
 
PPTX
Reversing & Malware Analysis Training Part 11 - Exploit Development [Advanced]
securityxploded
 
PPTX
Advanced Malware Analysis Training Session 2 - Botnet Analysis Part 1
securityxploded
 
PPTX
Advanced Malware Analysis Training Session 7 - Malware Memory Forensics
securityxploded
 
PPTX
Reversing & malware analysis training part 3 windows pe file format basics
securityxploded
 
PPTX
Primer on password security
securityxploded
 
PPTX
Advanced malware analysis training session 7 malware memory forensics
Cysinfo Cyber Security Community
 
PPTX
Anti-Virus Evasion Techniques and Countermeasures
n|u - The Open Security Community
 
PPTX
Reversing malware analysis training part1 lab setup guide
Cysinfo Cyber Security Community
 
PPTX
Advanced malware analysis training session8 introduction to android
Cysinfo Cyber Security Community
 
PPTX
Anatomy of Exploit Kits
securityxploded
 
PPTX
Automating Malware Analysis
securityxploded
 
PPTX
Application Virtualization
securityxploded
 
PPTX
Advanced malwareanalysis training session2 botnet analysis part1
Cysinfo Cyber Security Community
 
PPTX
Reversing malware analysis trainingpart9 advanced malware analysis
Cysinfo Cyber Security Community
 
PDF
Reversing & malware analysis training part 12 rootkit analysis
Abdulrahman Bassam
 
PPTX
Advanced malware analysis training session4 anti-analysis techniques
Cysinfo Cyber Security Community
 
PPTX
Reversing malware analysis training part7 unpackingupx
Cysinfo Cyber Security Community
 
PPTX
Reversing malware analysis training part2 introduction to windows internals
Cysinfo Cyber Security Community
 
PPTX
Reversing malware analysis training part11 exploit development advanced
Cysinfo Cyber Security Community
 
Advanced Malware Analysis Training Session 5 - Reversing Automation
securityxploded
 
Reversing & Malware Analysis Training Part 11 - Exploit Development [Advanced]
securityxploded
 
Advanced Malware Analysis Training Session 2 - Botnet Analysis Part 1
securityxploded
 
Advanced Malware Analysis Training Session 7 - Malware Memory Forensics
securityxploded
 
Reversing & malware analysis training part 3 windows pe file format basics
securityxploded
 
Primer on password security
securityxploded
 
Advanced malware analysis training session 7 malware memory forensics
Cysinfo Cyber Security Community
 
Anti-Virus Evasion Techniques and Countermeasures
n|u - The Open Security Community
 
Reversing malware analysis training part1 lab setup guide
Cysinfo Cyber Security Community
 
Advanced malware analysis training session8 introduction to android
Cysinfo Cyber Security Community
 
Anatomy of Exploit Kits
securityxploded
 
Automating Malware Analysis
securityxploded
 
Application Virtualization
securityxploded
 
Advanced malwareanalysis training session2 botnet analysis part1
Cysinfo Cyber Security Community
 
Reversing malware analysis trainingpart9 advanced malware analysis
Cysinfo Cyber Security Community
 
Reversing & malware analysis training part 12 rootkit analysis
Abdulrahman Bassam
 
Advanced malware analysis training session4 anti-analysis techniques
Cysinfo Cyber Security Community
 
Reversing malware analysis training part7 unpackingupx
Cysinfo Cyber Security Community
 
Reversing malware analysis training part2 introduction to windows internals
Cysinfo Cyber Security Community
 
Reversing malware analysis training part11 exploit development advanced
Cysinfo Cyber Security Community
 
Ad

Similar to Advanced Malware Analysis Training Session 4 - Anti-Analysis Techniques (20)

PDF
Anti Debugging
n|u - The Open Security Community
 
PPT
Reverse engineering20151112
Bordeaux I
 
PPTX
44CON London 2015 - How to drive a malware analyst crazy
44CON
 
PPTX
How to drive a malware analyst crazy
Michael Boman
 
PPTX
CarolinaCon 2009 Anti-Debugging
Tyler Shields
 
PDF
CNIT 126: 8: Debugging
Sam Bowne
 
PDF
Anti-Debugging - A Developers View
Tyler Shields
 
PPTX
Reversing & Malware Analysis Training Part 4 - Assembly Programming Basics
securityxploded
 
PPTX
Malware 101 by saurabh chaudhary
Saurav Chaudhary
 
PDF
Practical Malware Analysis: Ch 8: Debugging
Sam Bowne
 
PDF
CNIT 126 8: Debugging
Sam Bowne
 
PDF
Reversing & malware analysis training part 6 practical reversing (i)
Abdulrahman Bassam
 
PDF
Security Bootcamp 2013 - Difficulties of malware analysis - Nguyễn Chấn Việt
Security Bootcamp
 
PPTX
Windows Debugging with WinDbg
Arno Huetter
 
PPTX
Vxcon 2016
Kelvin Chan
 
PDF
Smash the Stack: Writing a Buffer Overflow Exploit (Win32)
Elvin Gentiles
 
PPTX
Reverse Engineering 101
ysurer
 
PDF
Source Boston 2009 - Anti-Debugging A Developers Viewpoint
Tyler Shields
 
PPTX
Driver Debugging Basics
Bala Subra
 
PPTX
Advanced Windows Debugging
Bala Subra
 
Anti Debugging
n|u - The Open Security Community
 
Reverse engineering20151112
Bordeaux I
 
44CON London 2015 - How to drive a malware analyst crazy
44CON
 
How to drive a malware analyst crazy
Michael Boman
 
CarolinaCon 2009 Anti-Debugging
Tyler Shields
 
CNIT 126: 8: Debugging
Sam Bowne
 
Anti-Debugging - A Developers View
Tyler Shields
 
Reversing & Malware Analysis Training Part 4 - Assembly Programming Basics
securityxploded
 
Malware 101 by saurabh chaudhary
Saurav Chaudhary
 
Practical Malware Analysis: Ch 8: Debugging
Sam Bowne
 
CNIT 126 8: Debugging
Sam Bowne
 
Reversing & malware analysis training part 6 practical reversing (i)
Abdulrahman Bassam
 
Security Bootcamp 2013 - Difficulties of malware analysis - Nguyễn Chấn Việt
Security Bootcamp
 
Windows Debugging with WinDbg
Arno Huetter
 
Vxcon 2016
Kelvin Chan
 
Smash the Stack: Writing a Buffer Overflow Exploit (Win32)
Elvin Gentiles
 
Reverse Engineering 101
ysurer
 
Source Boston 2009 - Anti-Debugging A Developers Viewpoint
Tyler Shields
 
Driver Debugging Basics
Bala Subra
 
Advanced Windows Debugging
Bala Subra
 
Ad

More from securityxploded (20)

PPTX
Fingerprinting healthcare institutions
securityxploded
 
PDF
Hollow Process Injection - Reversing and Investigating Malware Evasive Tactics
securityxploded
 
PDF
Buffer Overflow Attacks
securityxploded
 
PPTX
Malicious Client Detection Using Machine Learning
securityxploded
 
PDF
Understanding CryptoLocker (Ransomware) with a Case Study
securityxploded
 
PDF
Linux Malware Analysis using Limon Sandbox
securityxploded
 
PPT
Introduction to SMPC
securityxploded
 
PPTX
Breaking into hospitals
securityxploded
 
PPTX
Bluetooth [in]security
securityxploded
 
PPTX
Basic malware analysis
securityxploded
 
PPTX
Reverse Engineering Malware
securityxploded
 
PPTX
DLL Preloading Attack
securityxploded
 
PPTX
Partial Homomorphic Encryption
securityxploded
 
PPTX
Hunting Rootkit From the Dark Corners Of Memory
securityxploded
 
PPTX
Return Address – The Silver Bullet
securityxploded
 
PPTX
Defeating public exploit protections (EMET v5.2 and more)
securityxploded
 
PPTX
Hunting Ghost RAT Using Memory Forensics
securityxploded
 
PPTX
Malicious Url Detection Using Machine Learning
securityxploded
 
PPTX
MalwareNet Project
securityxploded
 
PPTX
Reversing and Decrypting the Communications of APT Malware (Etumbot)
securityxploded
 
Fingerprinting healthcare institutions
securityxploded
 
Hollow Process Injection - Reversing and Investigating Malware Evasive Tactics
securityxploded
 
Buffer Overflow Attacks
securityxploded
 
Malicious Client Detection Using Machine Learning
securityxploded
 
Understanding CryptoLocker (Ransomware) with a Case Study
securityxploded
 
Linux Malware Analysis using Limon Sandbox
securityxploded
 
Introduction to SMPC
securityxploded
 
Breaking into hospitals
securityxploded
 
Bluetooth [in]security
securityxploded
 
Basic malware analysis
securityxploded
 
Reverse Engineering Malware
securityxploded
 
DLL Preloading Attack
securityxploded
 
Partial Homomorphic Encryption
securityxploded
 
Hunting Rootkit From the Dark Corners Of Memory
securityxploded
 
Return Address – The Silver Bullet
securityxploded
 
Defeating public exploit protections (EMET v5.2 and more)
securityxploded
 
Hunting Ghost RAT Using Memory Forensics
securityxploded
 
Malicious Url Detection Using Machine Learning
securityxploded
 
MalwareNet Project
securityxploded
 
Reversing and Decrypting the Communications of APT Malware (Etumbot)
securityxploded
 

Advanced Malware Analysis Training Session 4 - Anti-Analysis Techniques

  • 1. Advanced Malware Analysis Training Series www.SecurityXploded.com
  • 2. Disclaimer The Content, Demonstration, Source Code and Programs presented here is "AS IS" without any warranty or conditions of any kind. Also the views/ideas/knowledge expressed here are solely of the trainer‟s only and nothing to do with the company or the organization in which the trainer is currently working. However in no circumstances neither the Trainer nor SecurityXploded is responsible for any damage or loss caused due to use or misuse of the information presented here. www.SecurityXploded.com
  • 3. Acknowledgement  Special thanks to Null community for their extended support and co-operation.  Special thanks to ThoughtWorks for the beautiful venue.  Thanks to all the trainers who have devoted their precious time and countless hours to make it happen. www.SecurityXploded.com
  • 4. Advanced Malware Analysis Training This presentation is part of our Advanced Malware Analysis Training program. Currently it is delivered only during our local meets for FREE of cost. For complete details of this course, visit our Security Training page. www.SecurityXploded.com
  • 5. Who am I? Swapnil Pathak  Security Researcher  Reversing, Malware Analysis, Exploit Analysis etc.  E-mail: swapnilpathak101@gmail.com www.SecurityXploded.com
  • 6. Agenda  Introduction  Anti-Reversing techniques  Anti-Debugging  Anti-VM  Anti-Anti-Reversing techniques  Q&A www.SecurityXploded.com
  • 7. Anti-Reversing  Implementation of techniques in code to hinder attempts at reverse engineering or debugging a target binary.  Used by commercial protectors, packers and malicious software  Covers  Anti-Debugging  Anti-VM  Anti-Disassembly  Code Obfuscation www.SecurityXploded.com
  • 8. Anti-Debug Techniques  Techniques implemented to detect if the program is running under control of a debugger.  Categorized as below  API Based  Flags Based  Timing Based  Exception Based  Breakpoint Detection www.SecurityXploded.com
  • 9. PEB (Process Environment Block)  Structure maintained by OS for each running process  Contains user mode parameters associated with a process  Including loaded modules list, debugger status etc  Referenced through fs:[30h]  !peb command in Windbg www.SecurityXploded.com
  • 11. API Based  IsDebuggerPresent  Exported by kernel32.dll  Function accepts no parameters  Checks if BeingDebugged flag in Process Environment Block (PEB) is set  Returns 1 if process is being debugged, 0 otherwise call IsDebuggerPresent test eax,eax jnz debugger_detected CheckRemoteDebuggerPresent => NtQueryInformationProcess  CheckRemoteDubggerPresent(Handle to the target process, Pointer to a variable  Sets the variable to TRUE if the specified process is being debugged or FALSE otherwise push offset dbg push -1 call CheckRemoteDebuggerPresent test eax, eax jne debugger_detected www.SecurityXploded.com
  • 12. API Based  NtQueryInformationProcess => ZwQueryInformationProcess  Exported by ntdll.dll  Retrieves information about the specified process.  NtQueryInformationProcess(ProcessHandle, ProcessInformationClass, ProcessInformation, ProcessInformationLength, ReturnLength)  ProcessHandle – Handle to the process for which information is to be retrieved.  ProcessInformationClass : Type of process information to be retrieved. ○ Accepts following values : ProcessBasicInformation(0x0), ProcessDebugPort(0x07), ProcessWow64Information(0x26), ProcessImageFileName(0x27)  ProcessDebugPort : Retrieves port number of the debugger for the process.  Non Zero value indicates that the process is being debugged. www.SecurityXploded.com
  • 13. API Based  OutputDebugString  Exported by kernel32.dll  Accepts one parameter : Null terminated string to be displayed  Sends a string to the debugger for display  Sends an error if there is no active debugger for the process to receive the string.  No error indicates presence of a debugger.  FindWindow  Exported by user32.dll  Used to search windows by name or class.  Detect debugger with graphical user interface www.SecurityXploded.com
  • 14. API Based  CloseHandle  Exported by kernel32.dll  Involves passing invalid handle  If debugger present EXCEPTION_INVALID_HANDLE (0xC0000008) will be raised  Above exception if intercepted by an exception handler, indicates presence of a debugger. push 12ab ; any illegal value call CloseHandle www.SecurityXploded.com
  • 15. Flags Based  BeingDebugged Flag  Present in PEB ( Process Environment Block) at offset 0x2  Set to 1 if the process is being debugged. mov eax, dword [fs:0x30] movzx eax, byte [eax + 0x02] ; PEB.BeingDebugged test eax, eax jnz debugger_detected www.SecurityXploded.com
  • 16. Flags Based  NTGlobal Flag  Present in PEB ( Process Environment Block) at offset ○ 0x68 - 32 bit systems ○ 0xBC - 64 bit systems  Contains value 0x70 if the process is being debugged.  FLG_HEAP_ENABLE_TAIL_CHECK(0x10), FLG_HEAP_ENABLE_FREE_CHECK(0x20), FLG_HEAP_VALIDATE_PARAMETERS(0x40) mov eax, fs :[30h] mov eax, [eax+68h] and eax, 0x70 test eax, eax jne debugger_detected www.SecurityXploded.com
  • 17. Flags Based  Heap Flags  ProcessHeap present in PEB ( Process Environment Block) at offset 0x18  Has Flags and ForceFlags Fields set to 0x02 (HEAP_GROWABLE) and 0x0 respectively if the process is not being debugged. mov eax, fs:[30h] mov eax, [eax + 18h] ; eax = PEB.ProcessHeap cmp [eax + 10h] , 0 ; ProcessHeap.ForceFlags jne debugger_detected cmp [eax + 0x0c], 2 ; ProcessHeap.Flags jne debugger_detected www.SecurityXploded.com
  • 18. Timing Based  Timing Checks  Compares time spent executing instructions normally and while being debugged.  Longer time taken compared to normal run indicates that the binary is being debugged.  RDTSC ( Read Time Stamp Counter)  GetTickCount()  QueryPerformanceCounter() rdtsc mov eax, ebx ……. rdtsc sub eax, ecx cmp eax, 0x100 ja debugger_detected www.SecurityXploded.com
  • 19. Exception Based  Interrupts  Consists of inserting interrupt instructions in middle of valid sequence of instructions.  INT3 breakpoint (0xCC, 0xCD 0x03)  INT 1 single step INT2D are stepped through inside the debugger, exception is raised.  If the process is being debugged, exception handler is not invoked as the debugger typically handles the exception  Checks such as setting of flags inside exception handler are used to detect presence of the debugger. www.SecurityXploded.com
  • 20. Breakpoint Detection  Hardware Breakpoints  Whenever an exception occurs, a context structure is created and passed to the exception handler.  Context structure contains values of general registers, control registers, debug registers.  Binary being debugged with hardware breakpoints in use will contain values in debug registers indicating presence of debugger.  Memory Breakpoints  Implemented using Guard pages.  Guard Pages are set using the PAGE_GUARD page protection modifier.  Address accessed part of Guard Page will result in STATUS_GUARD_PAGE_VIOLATION exception.  Process being debugged under Ollydbg will treat this as a memory breakpoint and no exception will be raised. www.SecurityXploded.com
  • 21. VM Detection  Techniques implemented to detect if the binary is being executed in a virtual environment.  Techniques include  Memory based  Backdoor I/O communication port  Process/Registry www.SecurityXploded.com
  • 22. Techniques  Memory specific techniques include Red Pill  Only one IDT, GDT, LDT per processor.  IDT : Used by OS to determine correct response to interrupts and exceptions  GDT/LDT : Define characteristics of the various memory areas used during program execution such as base address, size and access privileges.  IDTR, GDTR, LDTR are internal registers that store the address of these respective tables.  To avoid conflicts between host and guest OS , virtual machine needs to relocate IDT, GDT, LDT  SIDT, SGDT and SLDT are instructions to retrieve values from IDTR, GDTR and LDTR respectively.  Base address stored in the register define if under Virtualized environment.  IDT is at 0x80ffffff in Windows, 0xE8xxxxxx in VirtualPC, 0xFFxxxxxx in Vmware. www.SecurityXploded.com
  • 24. Techniques  Backdoor I/O port  OS running inside a VMWware uses port name „VX‟ for communication between the host and guest OS.  Data from this port can be read using various opcodes using “IN” instruction ○ 0x0A provides Vmware version. ○ 0x14 gets the memory size. ○ Value checked against „VMXh‟ to detect presence of Vmware  Process/Service Check  Check for Vmware related process, services  Process Name ( Associated Service Name )  vmacthlp.exe ( Vmware Physical Disk Helper Service )  vmtoolsd.exe ( Vmware Tools ) www.SecurityXploded.com
  • 25. Anti-Anti-Debug Techniques  Manually patch values in memory, registers, return values from APIs  NOP sequence of instructions  Use of Plugins  OllyAdvanced  HideDebugger  Phantom  Anti-Anti-Debugger Plugins : https://code.google.com/p/aadp/ www.SecurityXploded.com
  • 26. OllyDbg Screenshots www.SecurityXploded.com
  • 27. References Complete Reference Guide for Advanced Malware Analysis Training [Include links for all the Demos & Tools] www.SecurityXploded.com
  • 28. Thank You ! www.SecurityXploded.com www.SecurityXploded.com