Santa Clara University: The Jesuit university in Silicon Valley

TMAPP -- Typical Mobile Applications Benchmark

View all School of Engineering Syllabi







TMAPP is a benchmark developed to analyze the performance of Mobile Internet Devices (MID) under a typical workload. A Mobile Internet Device is a hand-held computer that is smaller than a laptop computer but larger than a smart phone and with a larger and more useable screen. MID's provide wireless Internet access and location-based services through use of G.P.S. MID's provide entertainment through replay of multimedia and gaming.

TMAPP is formed by independent components, which are representative of these devices' typical usage. The usage model was based on available statistical analysis of MID usage across different population categories. The idea of this benchmark suite is to browser and OS agnostic and to minimize the run-to-run variation.

A usage model describes how a system is used by a typical user and emphasizes the features of the system that benefit the user. The SCU benchmark attempts to measure the performance of a MID device when it is used in a normal setting and performing tasks that a typical user would want to do. This is unlike most benchmark programs which test specific parts of the device's hardware. The rationale for the SCU approach is that it makes little difference if a device cache has 512 KB or 1 MB if neither configuration will play your favorite movie acceptably.

The usage model is based on available statistical analysis for MID usages across different population categories. The benchmark covers a typical usage by measuring the performance of the device in a typical usage scenario. Our MID users browse the web, use the G.P.S. capabilities for navigation, listen to and watch multimedia, play games and use productivity applications such as M.S. Word, Excel and PowerPoint. Therefore, the main features of the benchmark are web browsing, G.P.S. navigation, multimedia, games and productivity applications. Other usage categories can be implemented by adding or removing certain categories based on different usage modules.

The benchmark is designed to be OS agnostic as much as possible. The workload is also browser and OS agnostic while minimizing the run-to-run variation. The objective for the benchmark is to run on ATOM based MIDs as well as ARM based MIDs. In addition to the processors, the benchmark should run on Android and Moblin OS to determine performance dependencies on operating systems.

Current components:
  • Web browser
  • Multimedia functionality: Video Playback, Audio Playback, Video Capture, Video Transcoding, Picture Capture, Image Preview, Image Animation
  • Productivity applications (OpenOffice)
  • Gaming
  • GPS Navigation
Primarily written for Mobile Internet Devices (MID) benchmarking. Currently, TMAPP supports MeeGo running on SoC (System-on-Chip) Intel Atom and ARM CORTEX-A8 based platforms, and will be further extended to support multiple OS such as Moblin, Ubuntu and Angstrom Linux.

Project news:

  • Jun, 2011

    Paper is accepted to "Seventh Annual Workshop on Modeling, Benchmarking and Simulation", MoBS 2011. Authors: Joseph Issa, Quoc Le, Soohong Min, Johann Steinbrecher, Rajesh Turlapati, Silvia Figueira, JoAnne Holliday, Weijia Shang, Moenes Iskarous and Dharmesh Jani

  • Apr 1, 2011

    Paper is submitted to MoBS 2011

  • Dec 12, 2010

    TMAPP 1.0 has been released.