Main Page

Overview

This page contains information about the on-going projects in human activity recognition at the University of Washington.

Mobile Sensing Platform

The current platform that we're using consists of an embedded processor component, called an iMote2, and a sensing component called the MSB2 (Multi-modal Sensor Board). The combination of the iMote2, MSB2, and the system software is often referred to as the MSP (Mobile Sensing Platform).

Getting Started

If you're new to the MSP, you'll probably want to read Getting started with the MSP.

iMote2 Details

• iMote2 - The Linux embedded computational platform that forms the heart of our wearable sensing platform
  • More information about the iMote2 and the Linux software can be found at the PlatformX wiki
• Current system images
  • Compiling the iMote2 kernel
• iMote2 How To's
  • GPRS - Information on using a cell phone's GPRS connection on the iMote2 over Bluetooth.
  • iMote2 GPIO pins/Alternate functions
  • Connecting to the iMote2

Sensor Boards

• Sensor Boards - A brief description of the sensor boards that are being used
  • Parts ordering for the Sensor Boards
  • Programming the sensor boards
• MSB2/LSB Firmware - Current firmware images and protocol information

Hardware Notes

• Attaching a GPS unit to an MSB
• Attaching a GPS unit to an LSB
• Attaching a WiFi dongle to the iMote2
• Assembling an MSP
• Assembling an ASSIST unit

System Software

• MSP Boot Process - A brief description of the MSP boot process
• MSP System Software - Everything below, all on one page.

MSB Software

• msb-server - MSB hardware interface application
• msb-test - MSB testing application

LSB Software

• lsb-server - LSB hardware interface application
• lsb-test - LSB testing application
• cam-server - OV9650 camera image acquisition application

GPS Software

• gps-server - GPS hardware interface application, for use when a GPS unit is directly attached to an iMote2 serial port
• gps-debug - GPS status and debugging application

Network Streaming Software

• cam-net-stream - Streams camera images over TCP/IP
• audio-stream - Streams audio samples over TCP/IP

Bluetooth Software

Misc

• logger - MSB/LSB/GPS/Camera-to-UWAR logger
• central - IPC dispatcher
• proccontrol - Process monitor
• sb-update - Utility to reflash sensor board firmware
• buttonwatchdog - Utility that handles the power-off command from the power button

Developing Software for the MSP

• Cross-compiling to the iMote2
• Compiling the MSP source code -- Required to build applications that depend on the sensor servers or other components
• Reading sensor values and controlling the MSP using IPC
• Using shared memory streams

Phone Platforms

In addition to the MSP we've also been using a number of cell phone platforms to provide wide area communications, display, local interaction capabilities, and additional sensors. Most questions about phones should go to yanokwa@cs

Nokia

• Nokia Overview – An overview of the platform
• Nokia Development – How to build apps on the phones
• Nokia Tips – Things that make life easier
• N95 - Code for the N95

Motorola

• Motorola Overview – An overview of the platform

Phone Codes

• T-Mobile Phone Codes - Information for T-Mobile Phones
• Nokia Phone Codes - Information for Nokia Phones

Software Tools

Virtual Machines

• Ubuntu 6.10 VMWare image - can be used with the free VMPlayer.

Useful Unix Commands

• Mounting a jffs2 image
• Iptables

UWAR Files

UWAR files (University of Washington - Activity Recognition) are a simple binary format used to store data.
• overview - a brief description of the uwar format
• uwar tools - contains a description of the various tools created to work with uwar files
• C Interface for uwar files
• Intel Inference Code

Matlab

• MatlabCommands
• Plotting wide images - Program to plot images with an extremely wide aspect ratio (i.e. hours of data plot vs. a small y-axis with good time resolution)
• Compositing Images - Matlab function to composite images (like those generated by plotting wide images.
• Example Mex Function - Example of how to create a .cpp mex function

Legacy Support

• Journal Viewer - The windows Journal Viewer used for some annotation tasks.

Data Collection Apps

• Logging apps

PostgreSQL Database

• Setting up postGIS

Wiki Help

Please see documentation on customizing the interface and the User's Guide for usage and configuration help...

Wikipedia has some helpful information on how to edit wiki pages:

• MediaWiki FAQ
• Cheat Sheet PDF version
• How to edit a page
• Syle Manual
• Tutorial on using Pictures in a Wiki
• How to use lists in the Wiki
• How to use tables in the Wiki
• Notes on using tables

Wiki Add-Ons Used

• GeSHi has been installed along with an extension for MediaWiki. This enables code to be highlighted in several different languages.
• wikitable wikitables style was added to the common.css style
• Modified Image Gallery modification to mediawiki to support a column argument to image gallerys