Automated Historical Performance Analysis with kmemtracer

Automated Historical
Performance Analysis
with kmemtracer
LG전자 이경민

Contents
Why Automated Historical Performance Testing?

kmemtracer: What and How?
Enhancement I : Automating UI Interaction
Enhancement II: Adding More Performance Metrics

12th Kandroid Conference - www.kandroid.org

2

If you can’t measure it,
you can’t manage it.
Peter F. Drucker
(1909~2005)


3

If you can’t measure it,
you can’t manage it.
Peter F. Drucker
(1909~2005)

If you can’t automate
the measurement of it,
it is difficult to improve it.


4

Diversity or Fragmentation
Platform
Versions

http://developer.android.com/about/dashboards/index.html

5

Diversity or Fragmentation
Platform
Versions

Screen Sizes
and Densities

http://developer.android.com/about/dashboards/index.html

6

http://www.mactrast.com/2012/05/visualized-the-truth-about-android-fragmentation/

7

Historical Performance Analysis
Why Historical Analysis?

Source: Memory and Performance at the 11th Korea Android Conference

8



9


Activity
Navigation
& Lifecycle

10

How to Track Activity Navigation & Lifecycle?


11


Override onCreate, onStart, …
of your Activity classes


12


Modify android.app.Activity
in the framework


13


Is there a way that does not
require the modification of
an application or framework?


14


Is there a way that does not
require the modification of
an application or framework?

Instrumentation

15


16

Android instrumentation is a set of control methods
or "hooks" in the Android system.
These hooks control an Android component
independently of its normal lifecycle.
They also control how Android loads applications.
(http://developer.android.com/tools/testing/testing_android.html)

17

Contents



18

Historical Analysis w/ kmemtracer
Application
Package

Control
android.test.
Instrumentation
TestRunner

Test
Package

19

Historical Analysis w/ kmemtracer
https://github.com/snailee/kmemtracer-libs

Application
Package

Control

Track

android.test.
Instrumentation
TestRunner

org.kandroid.
memtracer.Memory
Instrumentation

Test
Package

Trace
Package

20

android.app.Instrumentation
void
void
void
void
void
void
void
void
void
void
void
void
void

callActivityOnCreate(Activity, Bundle)
callActivityOnDestroy(Activity)
callActivityOnNewIntent(Activity, Intent)
callActivityOnPause(Activity)
callActivityOnPostCreate(Activity, Bundle)
callActivityOnRestart(Activity)
callActivityOnRestoreInstanceState(Activity, Bundle)
callActivityOnResume(Activity)
callActivityOnSaveInstanceState(Activity, Bundle)
callActivityOnStart(Activity)
callActivityOnStop(Activity)
callActivityOnUserLeaving(Activity)
callApplicationOnCreate(Application)


21

void
void
void
void
void
void
void
void
void
void
void
void
void


Call for
Control

22

void
void
void
void
void
void
void
void
void
void
void
void
void


Call for
Control

Override for
Track

23

org.kandroid.memtracer.MemoryInstrumentation
public class MemoryInstrumentation extends Instrumentation {
private static final String ARGUMENT_INSTRUMENT_CLASS = "class";
private MemoryTracer mMemoryTracer;
private String mMainActivityName;
...
@Override
public void onCreate(Bundle arguments) {
mMainActivityName = arguments.getString(ARGUMENT_INSTRUMENT_CLASS);
mMemoryTracer = createMemoryTracer();
mMemoryTracer.startTracing(getTargetContext().getPackageName());
start();
}
@Override
public void callActivityOnCreate(Activity activity, Bundle icicle) {
String tag = activity.getLocalClassName()+"-OnCreate";
Bundle snapshot = mMemoryTracer.addSnapshot(tag);
super.callActivityOnCreate(activity, icicle);
}
}


24

Tracing Performance Snapshots in kmemtracer
...

...

}


25

...
...
@Override
...
...
}
...

Create an instance
of MemoryTracer

...

}


26

...
...
@Override
...
...
}
...
@Override
public void callActivityOnCreate(Activity activity, Bundle icicle) {
String tag = activity.getLocalClassName()+"-OnCreate";
Bundle snapshot = mMemoryTracer.addSnapshot(tag);
...
}
...
}

Create an instance
of MemoryTracer

Add performance snapshot


27

MemoryTracer.addSnapshot
public Bundle addSnapshot(String label) {
...


28

...
long nativeMax = Debug.getNativeHeapSize() / 1024;
long nativeAllocated = Debug.getNativeHeapAllocatedSize() / 1024;
long nativeFree = Debug.getNativeHeapFreeSize() / 1024;
Debug.MemoryInfo memInfo = new Debug.MemoryInfo();
Debug.getMemoryInfo(memInfo);
...

Get usage data


29

...
...
Bundle snapshot = new Bundle();
snapshot.putString(METRIC_KEY_LABEL, label);
...
snapshot.putLong(METRIC_KEY_NATIVE_SIZE, nativeMax);
snapshot.putLong(METRIC_KEY_NATIVE_ALLOCATED, nativeAllocated);
snapshot.putLong(METRIC_KEY_NATIVE_FREE, nativeFree);
...

Get usage data

Save data to
a bundle


30

...
...
Bundle snapshot = new Bundle();
snapshot.putString(METRIC_KEY_LABEL, label);
...
snapshot.putLong(METRIC_KEY_NATIVE_SIZE, nativeMax);
snapshot.putLong(METRIC_KEY_NATIVE_ALLOCATED, nativeAllocated);
snapshot.putLong(METRIC_KEY_NATIVE_FREE, nativeFree);
...
if (mResultsWriter != null) {
mResultsWriter.writeTraceSnapshot(snapshot);
}
return snapshot;
}

Get usage data

Save data to
a bundle

Write date using
ResultsWriter


31

MemoryTracerCsvWriter$writeTraceSnapshot
public class MemoryTraceCsvWriter implements MemoryTracer.ResultsWriter {
...


32

...
public MemoryTraceCsvWriter(String[] metricKeys) {
mMetricKeys = metricKeys;
}
...

Create an instance
with metrics to print


33

...
}
...
private void openTraceFile(String filename) {
...
mTraceOut = new PrintStream(new FileOutputStream(traceFile));
...
}
...

Create an instance

Open a trace file in
the sdcard at init


34

...
}
...
private void openTraceFile(String filename) {
...
mTraceOut = new PrintStream(new FileOutputStream(traceFile));
...
}
...
@Override
public void writeTraceSnapshot(Bundle snapshot) {
PrintStream out = mTraceOut;
for (String key : mMetricKeys) {
out.print(snapshot.get(key));
out.print(',');
}
out.println();
out.flush();
}
...
}
12 Kandroid Conference - www.kandroid.org

Create an instance

Open a trace file in
the sdcard at init
Write snapshot to
a line of the file

th

35

How to Use kmemtracer?


36

1. Create an Android Test Project for the trace package.


37

2. Add ‘kmemtracer-libs.jar’ in the ‘libs’ directory.


38

3. Edit the <instrumentation> element in the Manifest file.
<manifest xmlns:android="http://schemas.android.com/apk/res/android"
package="com.example.android.apis.test"
android:versionCode="1"
android:versionName="1.0">
<instrumentation
android:name="org.kandroid.memtracer.MemoryInstrumentation"
android:targetPackage="com.example.android.apis" />

<uses-permission
android:name="android.permission.WRITE_EXTERNAL_STORAGE"/>
<application android:label="@string/app_name"
android:icon="@drawable/ic_launcher“>
<uses-library android:theme="android.text.runner“>
</application>
</manifest>

39

4. Install the trace package as well as the application package.
$ adb install –r ApiDemos.apk
$ adb install –r ApiDemosTest.apk


40


5. Start the instrumentation with ‘am instrument’ in the shell.
$
>
>
>

adb shell am instrument -e class
com.example.android.apis.ApiDemos
com.example.android.apis.tests/


41


$
>
>
>


6. Do interact with the application.


42


$
>
>
>


6. Do interact with the application.
7. Pull the trace file ‘kmemtrace.csv’ from /sdcard/kmemtracer.
$ adb pull /sdcard/kmemtracer/kmemtrace.csv .


43

8. Open the trace file with Excel and create charts.


44

Contents



45

Automate Controlling UI
Application
Package

Control

Track

android.test.
Instrumentation
TestRunner

org.kandroid.
memtracer.Memory
Instrumentation

Test
Package

Trace
Package

46

Application
Package

Control

Track

android.test.
Instrumentation
TestRunner

org.kandroid.
memtracer.Memory
Instrumentation

Test
Package

Trace
Package

47

Application
Package

Control

Track

android.test.
Instrumentation
TestRunner

org.kandroid.
memtracer.Memory
Instrumentation

Test
Package

Trace
Package

48

Three Alternatives


49

Three Alternatives
Instrumentation
API Level 1 ~
Single activity
Framework APIs
White-box

http://developer.android.com/tools/testing/testing_android.html


50

Three Alternatives
Instrumentation
API Level 1 ~
Single activity
Framework APIs
White-box

Robotium
2010/01 ~
Multiple activities
High-level APIs
White-box & black-box

https://code.google.com/p/robotium/


51

Three Alternatives
Instrumentation
API Level 1 ~
Single activity
Framework APIs
White-box

Robotium

uiautomator

2010/01 ~
Multiple activities
High-level APIs
White-box & black-box

API Level 17 ~
Multiple processes
Simple APIs
Black-box

https://code.google.com/p/robotium/
http://developer.android.com/tools/testing/testing_ui.html

52

Case Study: ApiDemos
https://github.com/snailee/deview-2013-samples


53


Click


54


Click


55


Click

Scroll
down


56


Click

Scroll
down


57


Click

Scroll
down
Click


58


Click

Scroll
down
Click


59


Click

Scroll
down
Click

Click


60


Click

Scroll
down
Click

Click


61

Controlling UI Using Instrumentation


62

1. Create an Android Test Project for the test package.
$ android create test-project --main ../ApiDemos
> –-name ApiDemosInstrumentTest --path ApiDemosInstrumentTest


63


2. Add a test class inheriting ActivityInstrumentationTestCase2.
public class ApiDemosInstrumentTest extends
ActivityInstrumentationTestCase2<ApiDemos> {
...
public ApiDemosInstrumentTest() {
super(ApiDemos.class);
}


64


public class ApiDemosInstrumentTest extends
...
public ApiDemosInstrumentTest() {
}

3. Add a test method and launch the activity.
public void testNavigate() {
final ApiDemos apiDemos = getActivity();
...
}


65

4. Find and act on a control.
...


66

public void testNavigate()
...
final ListView demoList
final View graphicsDemo
assertNotNull("Graphics

{

Find a view
to control

= apiDemos.getListView();
= getChildViewByText(demoList, "Graphics");
demo should exist", graphicsDemo);


67

...

{

Find a view
to control


apiDemos.runOnUiThread(new Runnable() {
public void run() {
int pos = demoList.getPositionForView(graphicsDemo);
demoList.smoothScrollToPosition(pos);
demoList.setSelection(pos);
demoList.performItemClick(graphicsDemo, pos,
graphicsDemo.getId());
}
});
...

Act on
the view


68

...

{

Find a view
to control


apiDemos.runOnUiThread(new Runnable() {
public void run() {
int pos = demoList.getPositionForView(graphicsDemo);
demoList.smoothScrollToPosition(pos);
demoList.setSelection(pos);
demoList.performItemClick(graphicsDemo, pos,
graphicsDemo.getId());
}
});
...

Act on
the view


69

4. Find and act on a control: getChildViewByText.
private View getChildViewByText(ListView listView, String text) {


70

View view = null;
int count = listView.getCount();
Log.e(TAG, “no. children = " + count);
for (int i = 0; i < count; i++) {
TextView textView = (TextView) listView.getChildAt(i);

Iterate through
child views


71

View view = null;
Log.e(TAG, i + "-th text view is " + textView);
if (textView != null && textView.getText().equals(text)) {
view = textView;
break;
}
}
return view;
}

Iterate through
child views

Compare
texts


72

View view = null;
Log.e(TAG, i + "-th text view is " + textView);
view = textView;
break;
}
}
return view;
}
com.example.android.apis.instrument.test.ApiDemosInstrumentTest:
INSTRUMENTATION_RESULT: shortMsg=junit.framework.AssertionFailedError
INSTRUMENTATION_RESULT: longMsg=
junit.framework.AssertionFailedError: OpenGL ES demo should exist
INSTRUMENTATION_CODE: 0

Iterate through
child views

Compare
texts


73

4. Find and act on a control: Revised getChildViewByText.
private View getChildViewByText(final ListView listView, String text) {
...
view = textView;
break;
}
if (textView == null) {
final int lastPos = listView.getLastVisiblePosition();
getInstrumentation().runOnMainSync(new Runnable() {
public void run() {
listView.smoothScrollToPosition(lastPos + 5, lastPos);
}
});
getInstrumentation().waitForIdleSync();
i = listView.getFirstVisiblePosition();
}
}
return view;
}

74

4. Find and act on a control: Revised getChildViewByText.
private View getChildViewByText(final ListView listView, String text) {
...
view = textView;
break;
}
if (textView == null) {
final int lastPos = listView.getLastVisiblePosition();
getInstrumentation().runOnMainSync(new Runnable() {
public void run() {
listView.smoothScrollToPosition(lastPos + 5, lastPos);
}
});
getInstrumentation().waitForIdleSync();
i = listView.getFirstVisiblePosition();
}
}
return view;
}

Scroll down


75

4. Find and act on a control: getPositionForChildViewByText.
private int getPositionForChildViewByText(ListView listView, String text) {
ListAdapter listAdapter = listView.getAdapter();
int count = listAdapter.getCount();
Log.e(TAG, "children: " + count);
String itemText = (String) ((Map)listAdapter.getItem(i)).get("title");
Log.e(TAG, i + "-th text item " + itemText);
if (itemText != null && itemText.equals(text)) {
return i;
}
}
return -1;
}
...
final ListView graphicsDemoList = graphicsDemoActivity.getListView();
int pos = getPositionForChildViewByText(graphicsDemoList, "OpenGL ES");
assertTrue("Cannot find OpenGL ES", pos != -1);
...

76

4. Find and act on a control: getPositionForChildViewByText.
private int getPositionForChildViewByText(ListView listView, String text) {
ListAdapter listAdapter = listView.getAdapter();
int count = listAdapter.getCount();
Log.e(TAG, "children: " + count);
String itemText = (String) ((Map)listAdapter.getItem(i)).get("title");
Log.e(TAG, i + "-th text item " + itemText);
if (itemText != null && itemText.equals(text)) {
return i;
}
}
return -1;
}
...
final ListView graphicsDemoList = graphicsDemoActivity.getListView();
int pos = getPositionForChildViewByText(graphicsDemoList, "OpenGL ES");
assertTrue("Cannot find OpenGL ES", pos != -1);
...

77

5. Monitor a new Activity to launch.
...
Instrumentation.ActivityMonitor graphicsDemoActivityMonitor =
getInstrumentation().addMonitor(
ApiDemos.class.getName(), null, false);
final ApiDemos graphicsDemoActivity =
(ApiDemos) graphicsDemoActivityMonitor.waitForActivity();
assertNotNull("Graphics Demo (ApiDemos) activity should not be null",
graphicsDemoActivity);
...


78

5. Monitor a new Activity to launch.
...
Instrumentation.ActivityMonitor graphicsDemoActivityMonitor =
getInstrumentation().addMonitor(
ApiDemos.class.getName(), null, false);
final ApiDemos graphicsDemoActivity =
(ApiDemos) graphicsDemoActivityMonitor.waitForActivity();
assertNotNull("Graphics Demo (ApiDemos) activity should not be null",
graphicsDemoActivity);
...

6. Iterate step 4 & 5.


79

7. Build and Install the test package.
$ cd ApiDemosInstrumentTest
$ ant debug
$ adb install –r bin/ApiDemosInstrumentTest-debug.apk


80

$ ant debug

8. Run the test and see the result.
$ adb shell am instrument -w
> com.example.android.apis.instrument.test/
> android.test.InstrumentationTestRunner


81

$ ant debug


$ ant test


82

Controlling UI Using Robotium


83

> –-name ApiDemosRobotiumTest --path ApiDemosRobotiumTest


84


2. Add ‘robotium-solo-<ver>.jar’ in the ‘libs’ directory.


85


2. Add ‘robotium-solo-<ver>.jar’ in the ‘libs’ directory.
public class ApiDemosRobotiumTest extends
...
public ApiDemosRobotiumTest() {
}
...


86

4. Create an instance of Solo in the setUp method and
close open activities in the tearDown method.
...
private Solo solo;
...
@Override
public void setUp() throws Exception {
solo = new Solo(getInstrumentation(), getActivity());
}
@Override
public void tearDown() throws Exception {
solo.finishOpenedActivities();
}
...


87

solo.assertCurrentActivity("Should be on ApiDemos",
ApiDemos.class);

solo.clickOnText("^Graphics$", 1, true);
solo.assertCurrentActivity("Should be on a new ApiDemos",
ApiDemos.class, true);
solo.clickOnText("^OpenGL ES$", 1, true);
solo.assertCurrentActivity("Should be on a new ApiDemos",
ApiDemos.class, true);

solo.clickOnText("^Kube$", 1, true);
solo.assertCurrentActivity("Should be on a Kube",
Kube.class, true);
solo.sleep(3000);
}


88

$ cd ApiDemosRobotiumTest
$ ant debug
$ adb install –r bin/ApiDemosRobotiumTest-debug.apk


89

$ ant debug

> com.example.android.apis.robotium.test/


90

$ ant debug

> com.example.android.apis.robotium.test/

$ ant test


91

Controlling UI Using uiautomator
1. Create an Java Project for the test jar.


92

2. Add ‘android.jar’ and ‘uiautomator.jar’ in the build path.


93

2. Add ‘android.jar’ and ‘uiautomator.jar’ in the build path.
3. Add a test class inheriting UiAutomatorTestCase.
public class ApiDemosUiAutoTest extends UiAutomatorTestCase {
...
}


94

4. Launch ApiDemos.
public void testNavigate() throws UiObjectNotFoundException {


95

4. Launch ApiDemos.
getUiDevice().pressHome();

Press home button


96

4. Launch ApiDemos.
UiObject allAppsButton = new UiObject(
new UiSelector().description("Apps"));
allAppsButton.clickAndWaitForNewWindow();


Press home button
Click ‘All Apps’
button

97

4. Launch ApiDemos.

Press home button
button

UiObject appsTab = new UiObject(new UiSelector().text("Apps"));
appsTab.click();

Click ‘Apps’ tab


98

4. Launch ApiDemos.

Press home button
button

appsTab.click();


UiScrollable appList = new UiScrollable(
new UiSelector().scrollable(true));
appList.setAsHorizontalList();
UiObject apiDemos = appList.getChildByText(
new UiSelector().className(TextView.class.getName()), "API Demos");
apiDemos.clickAndWaitForNewWindow();

Click ‘ApiDemos’
icon


99

4. Launch ApiDemos.

Press home button
button

appsTab.click();


UiScrollable appList = new UiScrollable(
new UiSelector().scrollable(true));
appList.setAsHorizontalList();
UiObject apiDemos = appList.getChildByText(
new UiSelector().className(TextView.class.getName()), "API Demos");
apiDemos.clickAndWaitForNewWindow();

Click ‘ApiDemos’
icon

Validate the launch
of ‘ApiDemos’

UiObject apiDemosPackage = new UiObject(
new UiSelector().packageName("com.example.android.apis"));
assertTrue("Should be on ApiDemos", apiDemosPackage.exists());
...

100

...
UiScrollable demoList = new UiScrollable(
new UiSelector().className("android.widget.ListView"));
UiObject graphicsDemo = demoList.getChildByText(
new UiSelector().className(TextView.class.getName()), “Graphics");
graphicsDemo.clickAndWaitForNewWindow();

UiObject alphaBitmapDemo = new UiObject(
new UiSelector().text(“AlphaBitmap"));
assertTrue(“AlphaBitmap should be visible", alpahBitmapDemo.exists());
...


101

...
UiScrollable demoList = new UiScrollable(
new UiSelector().className("android.widget.ListView"));
UiObject graphicsDemo = demoList.getChildByText(
new UiSelector().className(TextView.class.getName()), “Graphics");
graphicsDemo.clickAndWaitForNewWindow();

UiObject alphaBitmapDemo = new UiObject(
new UiSelector().text(“AlphaBitmap"));
assertTrue(“AlphaBitmap should be visible", alpahBitmapDemo.exists());
...

6. Iterate step 5.


102

7. Compile your test case into a JAR file.
$
>
$
$

android create uitest-project --name ApiDemosUiAutoTest
--target 1 --path ApiDemosUiAutoTest
cd ApiDemosUiAutoTest
ant build


103

$
>
$
$

ant build

8. Install the jar on your test device.
$ adb push bin/ApiDemosUiAutoTest.jar /data/local/tmp/


104

$
>
$
$

ant build


9. Run the test and view the test result.
$ adb shell uiautomator runtest ApiDemosUiAutoTest.jar
> –c com.example.android.apis.uiauto.test.ApiDemosUiAutoTest


105

$
>
$
$

ant build



$ ant test

106

$
>
$
$

ant build



$ ant test

107

Doing both Controlling and Tracking


108

1. Modify org.kandroid.memtracer.MemoryInstrumentation.
public class MemoryInstrumentation extends InstrumentationTestRunner {
...
@Override
...
start();
super.onCreate(arguments);
}
@Override
public void onStart() {
String mainActivityName = getMainActivityName();
if (mainActivityName != null && mainActivityName.length() > 0) {
launchMainActivity(getTargetContext().getPackageName(),
getMainActivityName());
} else {
super.onStart();
}
}
...

109

...
@Override
...
start();
}
@Override
} else {
super.onStart();
}
}
...

110

...
@Override
...
start();
}
@Override
} else {
super.onStart();
}
}
...

111

...
@Override
...
start();
}
@Override
} else {
super.onStart();
}
}
...

112



113

3. Edit the <instrumentation> element in the manifest file.


114

$ ant debug


115

$ ant debug

> org.kandroid.memtracer.MemoryInstrumentation


116

$ ant debug

> org.kandroid.memtracer.MemoryInstrumentation

6. Pull the trace file ‘kmemtrace.csv’ from /sdcard/kmemtracer.
$ adb pull /sdcard/kmemtracer/kmemtrace.csv .


117

Comparison
Instrument

Robotium

uiautomator

Compatibility

O

O

X

Multi-activities



O

O

Multi-processes

X

X

O

Ease of APIs

X

O



Black box

X



O


118

Contents



119

What to Measure?
Rendering (or GUI) Performance
Frame Rate (FPS), Frame Time , Jankiness, Input Latency, …

Resource Consumption
Memory, CPU, I/O (Disk, Network), Battery, …

Network Performance
Response time, Throughput, …
…


120

What to Measure?
Rendering (or GUI) Performance
Frame Rate (FPS), Frame Time , Jankiness, Input Latency, …

Resource Consumption
Memory, CPU, I/O (Disk, Network), Battery, …

Network Performance
Response time, Throughput, …
…


121

How to Measure Resource Consumption?


122


cmds

API


123


cmds

API

Public

Internal


124


cmds

API

Public

Internal

Android


Linux

125


cmds

API

Public

Internal

Android

Easy

Linux

Flexible


126

Measuring Memory Usage


127

Public
android.app.ActivityManager.MemoryInfo
android.os.Debug
android.os.Debug.MemoryInfo


128

Public

Internal

android.os.Debug
dalvik.system.VMDebug


129

Public

Internal

Android

android.os.Debug
adb shell dumpsys meminfo [pid|pname]
adb shell dumpsys gfxinfo [pid|pname]
adb shell procrank


130

Public

Internal

Android

Linux

android.os.Debug
adb shell dumpsys meminfo [pid|pname]
adb shell dumpsys gfxinfo [pid|pname]
adb shell procrank
adb shell cat /proc/meminfo
adb shell cat /proc/<pid>/[s]maps
adb shell cat /proc/vmstat
adb shell top
adb shell ps

131

Measuring Memory Usage: dumpsys meminfo
$ adb shell dumpsys meminfo com.example.android.apis
Applications Memory Usage (kB):
Uptime: 93065 Realtime: 93065

** MEMINFO in pid 1259 [com.example.android.apis] **
native
dalvik
other
total
size:
3548
5831
N/A
9379
allocated:
3475
3335
N/A
6810
free:
48
2496
N/A
2544
(Pss):
699
382
4889
5970
(shared dirty):
1500
1876
8356
11732
(priv dirty):
628
40
2472
3140
...

GB (API Level 10)


132

Applications Memory Usage (kB):
Uptime: 93065 Realtime: 93065

native
dalvik
other
total
size:
3548
5831
N/A
9379
allocated:
3475
3335
N/A
6810
free:
48
2496
N/A
2544
(Pss):
699
382
4889
5970
(shared dirty):
1500
1876
8356
11732
(priv dirty):
628
40
2472
3140
...

GB (API Level 10)


133

...
Shared Private
Heap
Heap
Pss
Dirty
Dirty
Size
Alloc
-------------------------Native
1377
1256
1300
12084
7332
Dalvik
5274
5476
4952
6260
5712
Stack
76
12
76
Cursor
0
0
0
Ashmem
0
0
0
Other dev
4
20
0
.so mmap
1526
4836
592
.jar mmap
0
0
0
.apk mmap
267
0
0
.ttf mmap
5
0
0
.dex mmap
1085
0
0
Other mmap
18
8
4
Unknown
824
0
824
TOTAL
10456
11608
7748
18344
13044
...

Heap
Free
-----567
548

1115

JB (API Level 18)

134

...
Shared Private
Heap
Heap
Pss
Dirty
Dirty
Size
Alloc
-------------------------Native
1377
1256
1300
12084
7332
Dalvik
5274
5476
4952
6260
5712
Stack
76
12
76
Cursor
0
0
0
Ashmem
0
0
0
Other dev
4
20
0
.so mmap
1526
4836
592
.jar mmap
0
0
0
.apk mmap
267
0
0
.ttf mmap
5
0
0
.dex mmap
1085
0
0
Other mmap
18
8
4
Unknown
824
0
824
TOTAL
10456
11608
7748
18344
13044
...

Heap
Free
-----567
548

1115

JB (API Level 18)

135

https://android.googlesource.com/platform/frameworks/base.git/+/0e3328fbdd3845b0e2bec364e951498eaee6b079

136

How ‘dumpsys meminfo’ works?
adb shell dumpsys meminfo [-a] [-oom] [-process]


137

com.android.server.am.
ActivityManagerService


138


android.app.ActivityThread.
ApplicationThread
ApplicationThread
ApplicationThread
android.os
Debug


139


ApplicationThread
ApplicationThread
ApplicationThread
android.os
Debug


140


ApplicationThread
ApplicationThread
ApplicationThread
android.os
Debug
getNativeHeap*()

getMemoryInfo()

mallinfo()

/proc/<pid>/smaps


141

android.app.ActivityThread.ApplicationThread.dumpMemInfo()

Runtime runtime = Runtime.getRuntime();

long dalvikMax = runtime.totalMemory() / 1024;
long dalvikFree = runtime.freeMemory() / 1024;
long dalvikAllocated = dalvikMax - dalvikFree;


142

android.app.ActivityThread.ApplicationThread.dumpMemInfo()

Runtime runtime = Runtime.getRuntime();

long dalvikMax = runtime.totalMemory() / 1024;
long dalvikFree = runtime.freeMemory() / 1024;
long dalvikAllocated = dalvikMax - dalvikFree;

android.os.Debug.getNativeHeap*()
struct mallinfo info = mallinfo();
(jlong) info.usmblks; // Debug.getNativeHeapSize()
(jlong) info.uordblks; // Debug.getNativeHeapAllocatedSize()
(jlong) info.fordblks; // Debug.getNativeHeapFreeSize()


143

struct mallinfo {
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
MALLINFO_FIELD_TYPE
};

arena;
ordblks;
smblks;
hblks;
hblkhd;
usmblks;
fsmblks;
uordblks;
fordblks;
keepcost;

/*
/*
/*
/*
/*
/*
/*
/*
/*
/*

non-mmapped space allocated from system */
number of free chunks */
always 0 */
always 0 */
space in mmapped regions */
maximum total allocated space */
always 0 */
total allocated space */
total free space */
releasable (via malloc_trim) space */

bioniclibcupstream-dlmallocmalloc.c

2

4
3

1

① Total allocated = uordblks
② Total free = fordblks
③ Footprint = uordblks + fordblks
④ Max footprint = usmblks


144

Measuring CPU Usage


145

Measuring CPU Usage
Public
android.os.Process
android.os.Debug.InstructionCount


146

Measuring CPU Usage
Public

Internal

android.os.Process
com.android.internal.os.ProcessStats


147

Measuring CPU Usage
Public

Internal

Android

android.os.Process

adb shell dumpsys cpuinfo


148

Measuring CPU Usage
Public

Internal

Android

Linux

android.os.Process

adb shell cat /proc/stat
adb shell cat /proc/<pid>/stat
adb shell top


149

Measuring CPU Usage: dumpsys cpuinfo
$ adb shell dumpsys cpuinfo
Load: 0.0 / 0.01 / 0.05
CPU usage from 27006ms to 5405ms ago:
1.1% 1421/com.android.launcher: 0.3% user + 0.8% kernel / faults:
2187 minor
2.4% 1225/system_server: 0.4% user + 1.9% kernel / faults: 2030 minor
0.1% 949/surfaceflinger: 0% user + 0.1% kernel / faults: 3 minor
0% 952/mediaserver: 0% user + 0% kernel / faults: 8 minor
0% 959/adbd: 0% user + 0% kernel / faults: 11 minor
0% 1295/com.android.systemui: 0% user + 0% kernel / faults: 5 minor
+0% 1901/com.example.android.apis: 0% user + 0% kernel
56% TOTAL: 10% user + 45% kernel + 0.7% softirq


150

How ‘dumpsys cpuinfo’ works?


151



152

com.android.internal.os
ProcessStats


153

ProcessStats
ProcessStats.Stats
ProcessStats.Stats
ProcessStats.Stats


154

android.os
Process

ProcessStats
ProcessStats.Stats
ProcessStats.Stats
ProcessStats.Stats

android_util_
Process.cpp
/proc/stat
/proc/loadavg
/proc/<pid>/stat
/proc/<ppid>/task/<pid>/stat


155

procfs (or the proc filesystem) is a special filesystem in UNIXlike operating systems that presents information about processes
and other system information in a hierarchical file-like structure,
providing a more convenient and standardized method for
dynamically accessing process data held in the kernel than
traditional tracing methods or direct access to kernel memory.
http://en.wikipedia.org/wiki/Procfs


156

procfs (or the proc filesystem) is a special filesystem in UNIXlike operating systems that presents information about processes
and other system information in a hierarchical file-like structure,
providing a more convenient and standardized method for
dynamically accessing process data held in the kernel than
traditional tracing methods or direct access to kernel memory.
http://en.wikipedia.org/wiki/Procfs

http://manpages.courier-mta.org/htmlman5/proc.5.html

157

Measuring I/O Usage


158

Measuring I/O Usage
Public
android.net.TrafficStats


159

Measuring I/O Usage
Public

Internal

android.net.NetworkStats
android.net.NetworkStatsHistory
com.android.internal.net.NetworkStatsFactory


160

Measuring I/O Usage
Public

Internal

Android

adb shell dumpsys netstats
adb shell dumpsys diskstats


161

Measuring I/O Usage
Public

Internal

Android

Linux

adb shell dumpsys netstats
adb shell dumpsys diskstats

/proc/net/*


162

Measuring Network IO Usage: dumpsys netstats
$ adb shell dumpsys netstats
Active interfaces:
iface=eth0 ident=[[type=MOBILE, subType=COMBINED, subscriberId=310260000000000]]
Dev stats:
Pending bytes: 43783
History since boot:
ident=[[type=MOBILE_HIPRI, subType=COMBINED, subscriberId=310260000000000],
[type=MOBILE, subType=COMBINED, subscriberId=310260000000000]] uid=-1 set=ALL
tag=0x0
NetworkStatsHistory: bucketDuration=3600000
bucketStart=1382443200000 activeTime=4813 rxBytes=17410 rxPackets=203
txBytes=25579 txPackets=173 operations=0
...
Xt stats:
Pending bytes: 37557
History since boot:
ident=[[type=MOBILE_HIPRI, subType=COMBINED, subscriberId=310260000000000],
[type=MOBILE, subType=COMBINED, subscriberId=310260000000000]] uid=-1 set=ALL
tag=0x0
...
UID stats:
...
UID tag stats:
...


163

How ‘dumpsys netstats’ works?
adb shell dumpsys netstats [--full] [--uid] [--tag]


164

com.android.server.net.
NetworkStatsService


165

NetworkStatsService
com.android.server.net
NetworkStatsRecorder


166

NetworkStatsService
NetworkStatsCollection
android.net
android.net
NetworkStatsHistory
android.net
NetworkStatsHistory
NetworkStatsHistory

167

com.android.server
NetworkManagementService

NetworkStatsService
NetworkStatsCollection
android.net
android.net
NetworkStatsHistory
android.net
NetworkStatsHistory
NetworkStatsHistory

com.android.internal.net
NetworkStatsFactory
/proc/net/xt_qtaguid/iface_stat_all
/proc/net/xt_qtaguid/iface_stat_fmt
/proc/net/xt_qtaguid/stats


android.net
NetworkStats
168

com.android.server.net.NetworkStatsService.DefaultNetworkStatsSettings
@Override
public Config getDevConfig() {
return new Config(getSecureLong(NETSTATS_DEV_BUCKET_DURATION, HOUR_IN_MILLIS),
getSecureLong(NETSTATS_DEV_ROTATE_AGE, 15 * DAY_IN_MILLIS),
getSecureLong(NETSTATS_DEV_DELETE_AGE, 90 * DAY_IN_MILLIS));
}
@Override
public Config getXtConfig() {
return getDevConfig();
}
@Override
public Config getUidConfig() {
return new Config(getSecureLong(NETSTATS_UID_BUCKET_DURATION, 2 * HOUR_IN_MILLIS),
getSecureLong(NETSTATS_UID_ROTATE_AGE, 15 * DAY_IN_MILLIS),
getSecureLong(NETSTATS_UID_DELETE_AGE, 90 * DAY_IN_MILLIS));
}
@Override
public Config getUidTagConfig() {
return new Config(getSecureLong(NETSTATS_UID_TAG_BUCKET_DURATION, 2 *
HOUR_IN_MILLIS),
getSecureLong(NETSTATS_UID_TAG_ROTATE_AGE, 5 * DAY_IN_MILLIS),
getSecureLong(NETSTATS_UID_TAG_DELETE_AGE, 15 * DAY_IN_MILLIS));
}

169

Dev: IP + Non IP layer traffic
$ adb shell cat /proc/net/xt_qtaguid/iface_stat_all
eth0 1 0 0 0 0 220609 3228 2891157 2995

Xt: Only IP layer traffic
$ adb shell cat /proc/net/xt_qtaguid/iface_stat_fmt
ifname total_skb_rx_bytes total_skb_rx_packets total_skb_tx_bytes
total_skb_tx_packets
eth0 163781 3231 2846738 2994

Uid: UID level details
$ adb shell cat /proc/net/xt_qtaguid/stats
idx iface acct_tag_hex uid_tag_int cnt_set rx_bytes rx_packets tx_bytes
tx_packets rx_tcp_bytes rx_tcp_packets rx_udp_bytes rx_udp_packets
rx_other_bytes rx_other_packets tx_tcp_bytes tx_tcp_packets tx_udp_bytes
tx_udp_packets tx_other_bytes tx_other_packets
2 eth0 0x0 0 0 163335 3226 2846228 2988 161473 3222 1862 4 0 0 2845850 2982
266 4 112 2
3 eth0 0x0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
4 eth0 0x0 1000 0 819 11 965 12 667 9 152 2 0 0 813 10 152 2 0 0
5 eth0 0x0 1000 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

170

Measuring Battery Usage


171

Public
android.os.BatteryManager


172

Public

Internal

android.os.BatteryStats
com.android.internal.os.BatteryStatsImpl
com.android.internal.os.PowerProfile
com.android.server.os.BatteryStatsService


173

Public

Internal

Android


adb shell dumpsys battery
adb shell dumpsys batteryinfo


174

Public

Internal

Android

Linux


adb shell dumpsys battery

None (?)


175

Measuring Battery Usage: dumpsys batteryinfo
$ adb shell dumpsys batteryinfo
Battery History:
-1d00h43m02s057ms START
-1d00h40m00s730ms 050 20080002 status=charging health=good plug=ac temp=0 volt=0
+plugged +sensor brightness=medium
-1d00h39m57s332ms 050 60080002 +wake_lock
-1d00h39m57s202ms 050 60080302 phone_state=off
...
Per-PID Stats:
PID 1227 wake time: +3s445ms
PID 1227 wake time: +199ms
...
Statistics since last charge:
System starts: 29, currently on battery: false
Time on battery: 0ms (0.0%) realtime, 0ms (0.0%) uptime
Total run time: 1d 2h 1m 3s 606ms realtime, 1d 2h 1m 3s 603ms uptime,
...
#1000:
User activity: 26 other, 27 button, 93 touch
Sensor 0: (not used)
Apk com.android.keychain:
(nothing executed)
...
Statistics since last unplugged:
Time on battery: 0ms (0.0%) realtime, 0ms (0.0%) uptime
...

176

How ‘dumpsys batteryinfo’ works?


177

BatteryStatsService


178

BatteryStatsService

BatteryStatsImpl


179

BatteryStatsService

BatteryStatsImpl

android.os
BatteryStats


180

BatteryStatsService

BatteryStatsImpl

android.os
BatteryStats

noteBluetoothOff()
noteBluetoothOn()
noteFullWifiLockAcquired(int)
noteFullWifiLockAcquiredFromSource(WorkSource)
noteFullWifiLockReleased(int)
noteFullWifiLockReleasedFromSource(WorkSource)
noteInputEvent()
noteNetworkInterfaceType(String, int)
notePhoneDataConnectionState(int, boolean)
notePhoneOff()
notePhoneOn()
notePhoneSignalStrength(SignalStrength)
notePhoneState(int)
noteScreenBrightness(int)
noteScreenOff()
noteScreenOn()
...
noteWifiScanStarted(int)
noteWifiScanStartedFromSource(WorkSource)
noteWifiScanStopped(int)
noteWifiScanStoppedFromSource(WorkSource)
noteWifiStopped(WorkSource)

181



182

If you can’t understand
the measurement results,
it is impossible to improve it.

183

Automated Historical Performance Analysis with kmemtracer

Automated Historical Performance Analysis with kmemtracer

More Related Content

What's hot (20)

Viewers also liked (14)

Similar to Automated Historical Performance Analysis with kmemtracer (13)

Recently uploaded (20)

Automated Historical Performance Analysis with kmemtracer