Donald J. Patterson

Design a Transreality Game (iOS Capstone)

iOS Capstone: Design a Transreality Game

Together with Sam Kaufman, UCI and Coursera, I’ve launched the final class in a six class specialization on Coursera. It’s called “iOS Capstone: Transreality Game”  We designed this one to be the culmination of everything that the students have learned in the previous 5 classes. Over 60,000 students have enrolled so far! The students have a ton…

iOS Development for Creative Entreprenuers

Mayterm iOS for Creative Entreprenuers

iOS Development For Mayterm 2016 the Westmont Computer Science Department is trying something new.  We are running an intensive iOS 9.0 programming class designed to get upper division students experience working with platform-based computing.  Another first is that we are going to be teaching it in the library’s computer lab. This 5-week course is scheduled to meet…

A Report from an Online Course on Global Disruption and Information Technology

ICS 5 Final Project Focii

“A Report from an Online Course on Global Disruption and Information Technology” accepted for publication in LIMITS 2016 Bill Tomlinson, Bonnie Nardi and I piloted an online undergraduate course with UC Irvine centered on the idea of “Global Disruption and Information Technology.”  We wanted to give students a framework to think about climate change, peak…

“Games, Sensors and Media” is Live!

Asteroid Hitting a Spaceship

This has been the most fun online course that I’ve put together yet.  In 40 lectures, 4 projects and 1 exam we cover everything from geofences and device orientation sensors, to playing sound and making particle emitters, to running the physics engine and interfacing with Game Center.  This is the fourth course in an online series of 6…

Reel{Talk} screening of Citizenfour

Citizenfour Reel{Talk} poster

Citizenfour screening I can’t wait until Thursday March 3rd, because Westmont is hosting a screening of Citizenfour and a post-screening discussion of the themes the movie brings up.  Several Westmont faculty were asked to be present at the discussion to help provide insight and perspective on what is a very complicated issue.   The movie is…

Patent for infant gesture recognition

Patent Diagram US8961438 B2

 video link Patent Published! It’s been a long time coming, but we finally had our patent formally published by the USPTO. Google has it listed under two numbers for some reason, US 9232912 B2 and US 20140066780 A1. The basic idea that we demonstrated was that if one appropriately monitors preterm babies then one can identify those that…

Object-Oriented Programming

Cover of Big Java Early Objects

Object-Oriented Teaching For Spring semester 2016 I am teaching a course on “Object-Oriented” Programming at Westmont College.  It’s been a long time since I’ve taught a lower-division Computer Science course, but I’m really looking forward to introducing students to Java and object-oriented thinking.  So far the group are really newbies to programming (except for one).  This…

Syrian Refugee Teach-In

Graphic from Westmont Syrian Refugee Teach-In

Refugee Teach-In at Westmont College Today There will be a one hour teach-in on the Syrian Refugee crisis today at noon on the Westmont College Dining Commons lawn (or Founder’s if raining). I was asked to speak to the vetting-process/security-threat angle briefly. Between handling the immigration of my oldest son, a Top Secret clearance in…

Toward Alternative Decentralized Infrastructures

Toward Alternative Decentralized Infrastructures

I’m very excited to announce that my colleagues and I had a paper accepted to ACM DEV 2015, “a premier venue to present original and innovative work on the applications, technologies, architectures, and protocols for computing in developing regions.”  We used the paper to put forward a vision of resilient local infrastructures that are coordinated via software…

Information Retrieval and Big Data

Introduction to Information Retrieval Book Cover

For Fall semester 2015 I am teaching a course on “Information Retrieval” at Westmont College.  This is my first time teaching over a semester and I’m looking forward to investigating some new big data tools like Apache Spark! The course webpage can be found here: http://djp3.westmont.edu/classes/2015_09_CS150/structure.html

Software Engineering

Essentials of Software Engineering cover

For Fall semester 2015 I am teaching a new course on “Software Engineering” at Westmont College.  This is my first time teaching over a semester and I’m looking forward to investigating some new tools like Pivotal Tracker! The course webpage can be found here: http://djp3.westmont.edu/classes/2015_09_CS130/structure.html

A French Affair Dot Com

Paris Subway Sign

On opinion piece I wrote at the start of the school year for the Westmont College student paper about the implications of the data breach at the dating site for married people, AshleyMadison.com In our increasingly digitized world there is very little that can be kept hidden anymore. As the Internet of things pursues the…

Haitian Resiliency: A Case Study in Intermittent Infrastructure

LIMITS 2015

This is one of two workshop papers that received a promotion to journal publications as part of this special issue of First Monday: This month: August 2015 Special issue: LIMITS 2015 — First workshop on computing within limits Today’s society is increasingly dependent upon and enmeshed with computing and technology. In parallel with advancements in computing, we have…

Cacophony: Building a Resilient Internet of Things

LIMITS 2015

This is one of two workshop papers that received a promotion to journal publications as part of this special issue of First Monday: This month: August 2015 Special issue: LIMITS 2015 — First workshop on computing within limits Today’s society is increasingly dependent upon and enmeshed with computing and technology. In parallel with advancements in computing, we have…

Haitian Resiliency: A Case Study in Intermittent Infrastructure

Haitian Resiliency: A Case Study in Intermittent Infrastructure Cover Sheet

In 2010 Haiti experienced a catastrophic earthquake that destroyed a substantial amount of infrastructure in the capital of Port-au- Prince. Limited national resources and widespread poverty have made the rebuilding slow and piecemeal. Five years later that infrastructure is still unevenly repaired and maintained. Nevertheless, the Haitian people have, by necessity, continued to adapt in…

Cacophony: Building a Resilient Internet of Things

Cacophony: Building a Resilient Internet of Things cover sheet

The proliferation of sensors in the world has created increased opportunities for context-aware applications. However, it is often cumbersome to capitalize on these opportunities due to the difficulties inherent in collecting, fusing, and reasoning with data from a heterogeneous set of distributed sensors. The fabric that connects sensors lacks resilience and fault tolerance in the…

Instructional Technology Innovation Award

Instructional Technology Innovation 2015

The Office on Information Technology, the Council on Student Experience and the Teaching Learning & Technology Center at UCI awarded Prof. Tomlinson, Prof. Nardi and myself the Instructional Technology Innovation Award for 2015! It comes with a engraved trophy and a $1000 cash award and was for the online course “Global Disruption and Information Technology“

Mobile and Ubiquitous Games

Prof Patterson playing Terra Tower

In Spring Quarter 2015 I will be teaching a course on “Mobile and Ubiquitous Games”. This isn’t a course about making Angry Birds, it’s a course about games that bleed into the real world and leave the confines of devices.  It is about using technology to have fun, while layering game mechanics on top of real…

Colonoscopy Quality Measures

A properly licensed photo of a doctor pretending to be in Minority Report

Dr. William Karnes and I are working on deploying a colonoscopy quality measure application for use in endoscopic suites.  We announced the effort today at the UCI Health 2015 Gastroenterology & Hepatology Symposium. It is a data entry tool that should be useful to endoscopists who are trying to monitor their performance at reducing colon cancer.  I am excited to be…

Patent for Evaluating Infant Movement

Patent Diagram US8961438 B2

First Patent Published! This is the first patent that I successfully saw through the entire patent pipeline process. It is for: A system and method for measuring movements, utilizing one or more wireless accelerometers attached to one or more limbs of a human subject for the purpose of determining certain temporal and spatial gestures of the…

Infrastructure in Haiti

Solar Powered Street light in haiti

I just got back from a trip to Haiti that I took with a diverse group of people from my church.  While there I was working with Haitian kids, schools and churches and studying intermittent infrastructures.  I produced a series of videos that describe the infrastructure hacks that I saw while I was there.  I’m…

Faith and Computer Science

My view of the relationship between my faith and my professional work

Here is a short essay on my view about how my faith impacts the study of computer science.  This is something that I think is important, but is also something that is in flux in my life. “I believe God made me for a purpose, but he also made me fast. And when I run I…

Collapse Informatics and Practice: Theory, Method, and Design

Collapse Informatics and Practice: Theory, Method, and Design cover page

What happens if efforts to achieve sustainability fail? Research in many fields argues that contemporary global industrial civilization will not persist indefinitely in its current form, and may, like many past human societies, eventually collapse. Arguments in environmental studies, anthropology, and other fields indicate that this transformation could begin within the next half-century. While imminent…

Interchange: Bidding for green lights

Interchange: Bidding for green lights

In urban environments great effort is directed toward alleviating traffic including the design and implementation of complex software and hardware infrastructure. We introduce the idea of an auction-based mechanism for resolving vehicle intersections using a multi-way group auction mechanism. We propose a supporting infrastructure that has promise for increasing performance and responsiveness to dynamic traffic…

What if Sustainability Doesn’t Work Out?

What if Sustainability Doesn't Work Out?

This article in Interactions was intended to be an introduction to the idea of Collapse Informatics that was elaborated in other publications in more depth. In a recent NSF-funded National Academies symposium on Science, Innovation, and Partnerships for Sustainability Solutions, there was a great deal of discussion about global change. To offer a few concrete…

Efficiently Scaling up Crowdsourced Video Annotation

Efficiently Scaling up Crowdsourced Video Annotation: A Set of Best Practices for High Quality, Economical Video Labeling

We present an extensive three year study on economically annotating video with crowdsourced marketplaces. Our public framework has annotated thousands of real world videos, including massive data sets unprecedented for their size, complexity, and cost. To accomplish this, we designed a state-of-the-art video annotation user interface and demonstrate that, despite common intuition, many contemporary interfaces…

Augmenting Gesture Recognition with Erlang-Cox Models To Identify Neurological Disorders in Premature Babies

Augmenting Gesture Recognition with Erlang-Cox Models To Identify Neurological Disorders in Premature Babies

In this paper we demonstrate a Markov model based technique for recognizing gestures from accelerometers that explicitly represents duration. We do this by embedding an Erlang-Cox state transition model, which has been shown to accurately represent the first three moments of a general distribution, within a Dynamic Bayesian Network (DBN). The transition probabilities in the…

AI Journal Prominent Paper Award

AI Journal Cover Page

I’m very proud to have been awarded, with my co-authors, a 5-year prominent paper award from the AI Journal for the paper,  Learning and Inferring Transportation Routines.  Here is the text of their award: This paper introduces a hierarchical Markov model that can learn and infer a user’s daily movements through an urban community, and…

Assessment of Infant Movement with a Compact Wireless Accelerometer System

Assessment of Infant Movement with a Compact Wireless Accelerometer System

There is emerging data that patterns of motor activity early in neonatal life can predict impairments in neuromotor development. However, current techniques to monitor infant movement mainly rely on observer scoring, a technique limited by skill, fatigue, and inter-rater reliability. Consequently, we tested the use of a lightweight, wireless, accelerometer system that measures movement and…

Collapse Informatics: Augmenting the Sustainability & ICT4D Discourse in HCI

Collapse informatics: Augmenting the Sustainability & ICT4D Discourse in HCI cover sheet

Research in many fields argues that contemporary global industrial civilization will not persist indefinitely in its current form, and may, like many past human societies, eventually collapse. Arguments in environmental studies, anthropology, and other fields indicate that this transformation could begin within the next half-century. While imminent collapse is far from certain, it is prudent…

Massively Distributed Authorship of Academic Papers

Massively Distributed Authorship of Academic Papers

Wiki-like or crowdsourcing models of collaboration can provide a number of benefits to academic work. These techniques may engage expertise from different disciplines, and potentially increase productivity. This paper presents a model of massively distributed collaborative authorship of academic papers. This model, developed by a collective of thirty authors, identifies key tools and techniques that…

Audia

Whisper Analytics

Audia, formerly whisper.fm, was a start-up that I worked on with George Ruan and Sam Kaufman.  It was a very simple idea.  Instead of downloading a podcast, you could call in and listen to it over the audio channel of the phone.   It enabled you to get podcast content without a data plan.  If the…

Informing and performing: investigating how mediated sociality becomes visible

Informing and performing: investigating how mediated sociality becomes visible

In the human–computer interaction, computer supported cooperative work, and ubiquitous computing literature, making people’s presence and activities visible as a design approach has been extensively explored to enhance computer-mediated interactions and collaborations. This process has developed under the rubrics of “awareness,” “social translucence,” “social activity indicators,” “social navigation,” etc. Although the name and details vary,…

Involuntary Gesture Recognition for Predicting Cerebral Palsy in High-Risk Infants

Involuntary Gesture Recognition for Predicting Cerebral Palsy in High-Risk Infants

In this paper we describe a system that leverages accelerometers to recognize a particular involuntary gesture in babies that have been born preterm. These gestures, known as cramped-synchronized general movements are highly correlated with a diagnosis of Cerebral Palsy. In order to test our system we recorded data from 10 babies admitted to the newborn…

Efficiently Scaling Up Video Annotation with Crowdsourced Marketplaces

Efficiently Scaling Up Video Annotation with Crowdsourced Marketplaces

Accurately annotating entities in video is labor intensive and expensive. As the quantity of online video grows, traditional solutions to this task are unable to scale to meet the needs of researchers with limited budgets. Current practice provides a temporary solution by paying dedicated workers to label a fraction of the total frames and otherwise…

Twitter, Sensors and UI: Robust Context Modeling for Interruption Management

Twitter, Sensors and UI: Robust Context Modeling for Interruption Management

In this paper, we present the results of a two-month field study of fifteen people using a software tool designed to model changes in a user’s availability. The software uses status update messages, as well as sensors, to detect changes in context. When changes are identified using the Kullback-Leibler Divergence metric, users are prompted to…

Supporting the transition from hospital to home for premature infants using integrated mobile computing and sensor support

Supporting the transition from hospital to home for premature infants using integrated mobile computing and sensor support

This paper reports on the requirements for, design of, and preliminary evaluation of a novel pervasive healthcare system for supporting the care of premature infants as they transition from hospital to home. In support of this system, we report the results of gesture sensing in a clinical setting and of interviews and focus groups with…

waitscout

Waitscout logo

waitscout was a start-up that I worked on with several folks, including George Ruan, Brian Silverstein and Ryan Hudson.  It was going to use predictive analytics plus relevant data from the Internet of Things to figure out what the wait time was at popular restaurants.  Then we would add that information to places like OpenTable…

Constructing Topological Maps of Displays with 3-D Positioning Information

Constructing Topological Maps of Displays with 3-D Positioning Information

To better coordinate information displays with moving people and the environment, software must know the locations and three dimensional alignments of the display hardware. In this paper we describe a technique for creating such an enhanced topological map of networked public displays using a mobile phone. The result supports a richer user experience, without the…

Status on Display: a Field Trial of Nomatic*Viz

Status on Display: a Field Trial of Nomatic*Viz

The use of personal status messages is becoming a part of popular culture through wide-spread instant messaging (IM) adoption, the growth of social networking websites and the increased connectivity provided by mobile phones. However, the implications of status broadcasting and people’s behavior in the milieu of social life is still poorly understood. In this paper,…

swayr

Swayr Mock Up

swayr was a start-up that I worked on with several folks, including George Ruan and Paul Limon.  The idea was to use gamification to encourage sharing of media. So we would have links to media that we could track the use of. Then we would build game mechanics that encouraged people to share links. Companies…

Overcoming Blind Spots in Interaction Design: A Case Study in Designing for African AIDS Orphan Care Communities

Overcoming Blind Spots in Interaction Design: A Case Study in Designing for African AIDS Orphan Care Communities

The process of designing technological systems for the developing world is a challenging task. In a project that we undertook in the summer of 2007 using an iterative design process, we attempted to develop delay-tolerant networking technology on mobile phones to support workers at AIDS orphanages in Zambia and South Africa. Despite extensive preparations and…

Online Everywhere: Evolving Mobile Instant Messaging Practices

Online Everywhere: Evolving Mobile Instant Messaging Practices

< In this paper we report on the results of a large scale user survey investigating the status setting and interruption management behavior of mobile instant messaging (IM) users with existing systems. The motivation for this study was to inform the design of interface tools that support users by setting contextually appropriate awareness messages. Our…

Interactive and Intelligent Visual Communication Systems

Interactive and Intelligent Visual Communication Systems

Interventions to support children with cognitive and social developmental disabilities often include visual elements. Use of visual artifacts has been shown to increase the communication and understanding levels of children with disabilities. We describe a research agenda for expanding these capabilities using interactive, collaborative and intelligent systems. ( permanent, local copy ) Published in Interactive Design for…

Informatics at UC Irvine

Informatics at UC Irvine

Computer Science, as a single discipline, can no longer speak to the broad relevance of digital technologies in society. The Department of Informatics in the Donald Bren School of Information and Computer Sciences at the University of California, Irvine, serves as the institutional home for research on relationships between technological, organizational, and social aspects of…

NomaticBubbles: Visualizing Communal Whereabouts

NomaticBubbles: Visualizing Communal Whereabouts

We describe the design of the NomaticBubbles, a visualization that provides cues of communal whereabouts. Unlike most location displays showing whereabouts on a geographical map, the NomaticBubbles depicts historical and aggregate traces of participants’ whereabouts in an abstract and ambiguous manner. We describe the design of the NomaticBubbles, and discuss some early experiences and feedback…

quub

quub logo white

quub was a start-up that I worked on with several folks, including George Ruan and Nathan Esquenazi.  quub was a commercialization of Nomatic*IM.  Basically it was supposed to be automatic status updates that your computer would generate for you based on what it could detect about you from sensors.  The ideal case would be to…

Involving Intelligent Assistants in Active Human Communication

Involving Intelligent Assistants in Active Human Communication

Intelligent assistants that support human communication need to respect the difficulty of understanding the context surrounding the interchange. Rather than attempting to directly communicate for a user, intelligent assistants should support decision making on the part of the involved parties so that complex social negotiations are preserved. We describe an intelligent assistant that does this…

Building Personal Maps from GPS Data

Building Personal Maps from GPS Data

In this article we discuss an assisted cognition information technology system that can learn personal maps customized for each user and infer his daily activities and movements from raw GPS data. The system uses discriminative and generative models for different parts of this task. A discriminative relational Markov network is used to extract significant places…

Nomatic: Location By, For, and Of Crowds.

Nomatic: Location By, For, and Of Crowds.

In this paper we present a social and technical architecture which will enable the study of localization from the perspective of crowds. Our research agenda is to leverage new computing opportunities that arise when many people are simultaneously localizing themselves. By aggregating this and other types of context information we intend to develop a statistically…

Fine-Grained Activity Recognition by Aggregating Abstract Object Usage

Fine-Grained Activity Recognition by Aggregating Abstract Object Usage

In this paper we present results related to achieving fine grained activity recognition for context-aware computing applications. We examine the advantages and challenges of reasoning with globally unique object instances detected by an RFID glove. We present a sequence of increasingly powerful probabilistic graphical models for activity recognition. We show the advantages of adding additional…

2005 ISWC Best Paper Award

2005 IEEE International Symposium on Wearable Computers Best Paper Award

I am thrilled and honored to have been awarded the 2005 ISWC Best Paper award for our paper on “Fine-grained Activity Recognition by Aggregating Abstract Object Usage“. It was a collaborative effort amongst myself, Dieter Fox, Henry Kautz and Matthai Philipose. There are few research honors that are exhilarating as a best paper award.

Opportunity Knocks: a System to Provide Cognitive Assistance with Transportation Services

Opportunity Knocks: a System to Provide Cognitive Assistance with Transportation Services

We present an automated transportation routing system, called “Opportunity Knocks,” whose goal is to improve the efficiency, safety and independence of individuals with mild cognitive disabilities. Our system is implemented on a combination of a Bluetooth sensor beacon that broadcasts GPS data, a GPRS-enabled cell-phone, and remote activity inference software. The system uses a novel…

Ph.D. in Computer Science

Logo for the Computer Science Department at the University of Washington circa 2005

From 1999 to 2005 I was a graduate student in the Department of Computer Science at the University of Washington in Seattle.  For the first couple of years I worked in Sieg Hall and then moved into Allen Hall once it was complete.  My advisors were Henry Kautz and Dieter Fox.  I also owe a debt…

Guide: Towards Understanding Daily Life via Auto-Identification and Statistical Analysis

Guide: Towards Understanding Daily Life via Auto-Identification and Statistical Analysis

Many recent studies have underscored the applicability to healthcare of a system able to observe and understand day-to-day human activities. The Guide project is aimed at building just such a system. The project combines novel sensing technology, expressive but scalable learners and unsupervised mining of activity models from the web to address the problem. An…

Expressive, Tractable and Scalable Techniques for Modeling Activities of Daily Living

Expressive, Tractable and Scalable Techniques for Modeling Activities of Daily Living

One the best qualitative and quantitative tools that elder–care specialists have to monitor the health of elderly individuals is Activity of Daily Living (ADL) tracking [1,2]. By watching the frequency and competency with which an individual can cook, clean the house, engage in socializing, etc, short– and long– term changes in health can be identified.…

Serum Phosphate Levels and Mortality Risk among People with Chronic Kidney Disease

Serum Phosphate Levels and Mortality Risk among People with Chronic Kidney Disease

Elevated serum phosphate levels have been linked with vascular calcification and mortality among dialysis patients. The relationship between phosphate and mortality has not been explored among patients with chronic kidney disease (CKD). A retrospective cohort study was conducted from eight Veterans Affairs’ Medical Centers located in the Pacific Northwest. CKD was defined by two continuously…

Intel Research Seattle

Intel Research Labs Seattle logo

I did two summer internships at Intel Research Seattle while in graduate school at UW.  That organization ceased to exist around 2012-2013, but it was a moment in time that was very cool.  The dawn of ubiquitous computing and lots of great researchers working on it. I designed and implemented a modeling language and statistical…

Pre-mRNA Secondary Structure Prediction Aids Splice Site Prediction

Pre-mRNA Secondary Structure Prediction Aids Splice Site Prediction

Accurate splice site prediction is a critical component of any computational approach to gene prediction in higher organisms. Existing approaches generally use sequence-based models that capture local dependencies among nucleotides in a small window around the splice site. We present evidence that computationally predicted secondary structure of moderate length pre-mRNA subsequences contains information that can…