About
Articles by Jess
Activity
11K followers
Experience & Education
Volunteer Experience
-
Board Member
Forging Youth Resilience
- 1 year 10 months
Children
I served on the Board of Forging Youth Resilience, a nonprofit that empowers young people to build physical and mental strength for life by providing access to a national network of community-based fitness programs and mentorship.
https://forgingyouthresilience.org/
Publications
-
Identifying the Intersections: User Experience + Research Scientist Collaboration in a Generative Machine Learning Interface
Proceeding CHI EA '19 Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
Creative generative machine learning interfaces are stronger when multiple actors bearing different points of view actively contribute to them. User experience (UX) research and design involvement in the creation of machine learning (ML) models help ML research scientists to more effectively identify human needs that ML models will fulfill. The People and AI Research (PAIR) group within Google developed a novel program method in which UXers are embedded into an ML research group for three…
Creative generative machine learning interfaces are stronger when multiple actors bearing different points of view actively contribute to them. User experience (UX) research and design involvement in the creation of machine learning (ML) models help ML research scientists to more effectively identify human needs that ML models will fulfill. The People and AI Research (PAIR) group within Google developed a novel program method in which UXers are embedded into an ML research group for three months to provide a human-centered perspective on the creation of ML models. The first full-time cohort of UXers were embedded in a team of ML research scientists focused on deep generative models to assist in music composition. Here, we discuss the structure and goals of the program, challenges we faced during execution, and insights gained as a result of the process. We offer practical suggestions for how to foster communication between UX and ML research teams and recommended UX design processes for building creative generative machine learning interfaces.
Other authors -
-
The effects of example-based explanations in a machine learning interface
Proceeding IUI '19 Proceedings of the 24th International Conference on Intelligent User Interfaces
The black-box nature of machine learning algorithms can make their predictions difficult to understand and explain to end-users. In this paper, we propose and evaluate two kinds of example-based explanations in the visual domain, normative explanations and comparative explanations (Figure 1), which automatically surface examples from the training set of a deep neural net sketch-recognition algorithm. To investigate their effects, we deployed these explanations to 1150 users on QuickDraw, an…
The black-box nature of machine learning algorithms can make their predictions difficult to understand and explain to end-users. In this paper, we propose and evaluate two kinds of example-based explanations in the visual domain, normative explanations and comparative explanations (Figure 1), which automatically surface examples from the training set of a deep neural net sketch-recognition algorithm. To investigate their effects, we deployed these explanations to 1150 users on QuickDraw, an online platform where users draw images and see whether a recognizer has correctly guessed the intended drawing. When the algorithm failed to recognize the drawing, those who received normative explanations felt they had a better understanding of the system, and perceived the system to have higher capability. However, comparative explanations did not always improve perceptions of the algorithm, possibly because they sometimes exposed limitations of the algorithm and may have led to surprise. These findings suggest that examples can serve as a vehicle for explaining algorithmic behavior, but point to relative advantages and disadvantages of using different kinds of examples, depending on the goal.
Other authors -
-
Is There a Hierarchy of Social Inferences? The Likelihood and Speed of Inferring Intentionality, Mind, and Personality
Journal of Personality and Social Psychology
People interpret behavior by making inferences about agents’ intentionality, mind, and personality. Past studies examined such inferences one at a time; in real life, people make these inferences simultaneously. The present studies therefore examined whether four major inference types (intentionality, desire, belief, and personality), when made simultaneously in response to an observed behavior, may be ordered in a hierarchy of likelihood and speed. To achieve generalizability, the studies…
People interpret behavior by making inferences about agents’ intentionality, mind, and personality. Past studies examined such inferences one at a time; in real life, people make these inferences simultaneously. The present studies therefore examined whether four major inference types (intentionality, desire, belief, and personality), when made simultaneously in response to an observed behavior, may be ordered in a hierarchy of likelihood and speed. To achieve generalizability, the studies included a wide range of stimulus behaviors; presented them verbally and as dynamic videos; and assessed inferences both in a retrieval paradigm (measuring the likelihood and speed of accessing inferences immediately after they were made) and in an on-line processing paradigm (measuring the speed of forming inferences during behavior observation). Five studies provide evidence for a hierarchy of social inferences—from intentionality and desire to belief to personality—that is stable across verbal and visual presentations and that parallels the order found in developmental and comparative research.
Other authors -
Patents
-
Low power framework for controlling image sensor mode in a mobile image capture device
Issued US 10728489
The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. In particular, the present disclosure provides low power frameworks for controlling image sensor mode in a mobile image capture device. On example low power frame work includes a scene analyzer that analyzes a scene depicted by a first image and, based at least in part on such analysis, causes an image sensor control…
The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. In particular, the present disclosure provides low power frameworks for controlling image sensor mode in a mobile image capture device. On example low power frame work includes a scene analyzer that analyzes a scene depicted by a first image and, based at least in part on such analysis, causes an image sensor control signal to be provided to an image sensor to adjust at least one of the frame rate and the resolution of the image sensor.
Other inventorsSee patent -
Systems and methods for selective retention and editing of images captured by mobile image capture device
Issued US 10732809
The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. The mobile image capture device is operable to input an image into at least one neural network and to receive at least one descriptor of the desirability of a scene depicted by the image as an output of the at least one neural network. The mobile image capture device is operable to determine, based at least in part on…
The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. The mobile image capture device is operable to input an image into at least one neural network and to receive at least one descriptor of the desirability of a scene depicted by the image as an output of the at least one neural network. The mobile image capture device is operable to determine, based at least in part on the at least one descriptor of the desirability of the scene of the image, whether to store a second copy of such image and/or one or more contemporaneously captured images in a non-volatile memory of the mobile image capture device or to discard a first copy of such image from a temporary image buffer without storing the second copy of such image in the non-volatile memory.
Other inventorsSee patent -
Systems and methods that leverage deep learning to selectively store images at a mobile image capture device
Issued US 9,836,484
The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. The mobile image capture device is operable to input an image into at least one neural network and to receive at least one descriptor of the desirability of a scene depicted by the image as an output of the at least one neural network. The mobile image capture device is operable to determine, based at least in part on…
The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. The mobile image capture device is operable to input an image into at least one neural network and to receive at least one descriptor of the desirability of a scene depicted by the image as an output of the at least one neural network. The mobile image capture device is operable to determine, based at least in part on the at least one descriptor of the desirability of the scene of the image, whether to store a second copy of such image in a non-volatile memory of the mobile image capture device or to discard a first copy of such image from a temporary image buffer without storing the second copy of such image in the non-volatile memory.
Other inventorsSee patent -
Branded browser frame
Issued US US 2012/0066634 A1
In at least some embodiments, a web browser user interface is designed to enable site branding and functionality. Specifically, websites can provide content that can be utilized in a control layout area near the top of the web browser user interface to reinforce branding through the use of color and/or a site-provided icon, termed a “favicon” that serves dual roles as a branding instrumentality and a site's home button. Further, in at least some embodiments, branding can be reinforced through…
In at least some embodiments, a web browser user interface is designed to enable site branding and functionality. Specifically, websites can provide content that can be utilized in a control layout area near the top of the web browser user interface to reinforce branding through the use of color and/or a site-provided icon, termed a “favicon” that serves dual roles as a branding instrumentality and a site's home button. Further, in at least some embodiments, branding can be reinforced through the use of a site-associated color that is utilized for rendering one or more web browser navigation controls.
Other inventorsSee patent -
Determination and display of relevant websites
Issued US US 2012/0066645 A1
Various embodiments utilize certain events that occur within a Web browser to recognize an imminent intent, on the part of the user, to navigate to a website. Given such events, in combination with a user's past browsing patterns and history, an automated and personalized navigation solution can be provided to expedite navigation.
Other inventorsSee patent -
Browser frame with site focus
Issued US US 2012/0066635 A1
In various embodiments, a web browser user interface includes a subset of selected controls distributed along a single line at the top of the web browser user interface. Layouts of the controls can be in a left-to-right or a right-to-left fashion. Specifically, in a left-to-right layout, selected controls meeting certain criteria can appear to the left of other controls. Similarly, in a right-to-left layout, selected controls meeting certain criteria can appear to the right of other controls…
In various embodiments, a web browser user interface includes a subset of selected controls distributed along a single line at the top of the web browser user interface. Layouts of the controls can be in a left-to-right or a right-to-left fashion. Specifically, in a left-to-right layout, selected controls meeting certain criteria can appear to the left of other controls. Similarly, in a right-to-left layout, selected controls meeting certain criteria can appear to the right of other controls. In at least some embodiments, at least some of the controls that appear distributed along the single line are controls that are related to navigation of some type. Such controls can include those that enable textual input to be provided by user.
Other inventorsSee patent -
Reputation checking obtained files
Issued US US 2012/0066346 A1
A Web browser of a computing device downloads or otherwise obtains a file. File information identifying the file is obtained and is sent to a remote reputation service. Client information identifying aspects of the computing device can also optionally be sent to the remote reputation service. In response to the file information (and optionally client information), a reputation indication for the file is received from the remote reputation service. A user interface for the Web browser to present…
A Web browser of a computing device downloads or otherwise obtains a file. File information identifying the file is obtained and is sent to a remote reputation service. Client information identifying aspects of the computing device can also optionally be sent to the remote reputation service. In response to the file information (and optionally client information), a reputation indication for the file is received from the remote reputation service. A user interface for the Web browser to present at the computing device is determined, based at least in part on the reputation indication, and presented at the computing device.
Other inventorsSee patent -
Web application home button
Issued US US 2011/0307811 A1
Various embodiments provide a mechanism to allow end users to install web applications and websites onto their desktop. In accordance with one or more embodiments, client-side code can be utilized to allow developers associated with a website to define boundaries associated with user interaction, and have those boundaries enforced by a run-time engine. In at least some embodiments, developers can provide, through JavaScript code and/or HTML markup, various configurations for the creation of a…
Various embodiments provide a mechanism to allow end users to install web applications and websites onto their desktop. In accordance with one or more embodiments, client-side code can be utilized to allow developers associated with a website to define boundaries associated with user interaction, and have those boundaries enforced by a run-time engine. In at least some embodiments, developers can provide, through JavaScript code and/or HTML markup, various configurations for the creation of a start menu shortcut, navigation, and so-called jumplist integration.
Other inventorsSee patent
Courses
-
Advance Human-computer Interaction: Tangible Interfaces
-
-
Advanced Human-computer Interaction: Ambient Interfaces
-
-
Applied Structural Equation Modeling
-
-
Complex Adaptive Dynamical Systems
-
-
Data Analysis I-III (factorial analysis of variance, trend analysis, multiple regression, matrix algebra, item analysis, multivariate analysis of variance, factor analysis, profile analysis, logistic regression, and loglinear analysis)
-
Projects
-
Selected public presentations and speaking engagements
Workshop on Responsible Data (June 2024)
CVPR 2024
https://responsibledata.github.io/
Designing (with) AI for Wellbeing (May 2024)
CHI workshop
https://programs.sigchi.org/chi/2024/program/content/150955
10 years finding the role of UX in AI (April 2024)
University of Washington Human-centered Design and Engineering department
https://www.hcde.washington.edu/ux/2024/holbrook
The UX Research Rundown podcast (April…Workshop on Responsible Data (June 2024)
CVPR 2024
https://responsibledata.github.io/
Designing (with) AI for Wellbeing (May 2024)
CHI workshop
https://programs.sigchi.org/chi/2024/program/content/150955
10 years finding the role of UX in AI (April 2024)
University of Washington Human-centered Design and Engineering department
https://www.hcde.washington.edu/ux/2024/holbrook
The UX Research Rundown podcast (April 2024)
https://podcasts.apple.com/gb/podcast/s3-e01-jess-holbrook-dir-of-uxr-for-ai-at-meta/id1651678680?i=1000646890832
Designing Human Centred AI Products (May 2021)
Nomensa
https://www.youtube.com/watch?v=tUcN2cbGVb4
A more human-centered approach to AI (December 2020)
Big Data and AI Conference
https://www.youtube.com/watch?v=uSLhkGefATU
Artificial Intelligence as a Design Material (July 2020)
UX Strat Conference
https://www.youtube.com/watch?v=JMaqs2pwLMs
Human-centered AI: Building Trust, Democracy and Human Rights by Design (June 2018)
https://cyber.fsi.stanford.edu/gdpi/content/building-trust-ai-xprize-and-gdpi
Design Is [Smart] (September 2017)
Design is series at Google
https://www.youtube.com/watch?v=FpgbqgAEPfo -
Helping Majicast research their target markets
-
See projectVolunteer research with Google.org grantee Legbank. Helping them with market research for their upcoming product Majicast that will dramatically improve the way orthopaedic specialists produce prosthetic sockets.
-
Sprint Instructor at Google's International Women's Day Event
-
See projectExample of the impact our Design Sprint training sessions can have.
http://www.biztechafrica.com/article/ramasedi-gives-insight-google-women-techmakers-201/11186/?section=development#.Vv2FAhIrLOb
-
Instructor at Google I/O 2015
-
See projectTaught dozens of developers how to use rapid paper prototyping as a way to communicate their ideas to their teams.
-
Puget Sound SIGCHI UX Careers Panel
-
Participated in a UX Career Panel for the local SIGCHI group to help people entering the UX field prepare their portfolios, prepare for their first interviews, and be successful in their first UX jobs.
Other creatorsSee project -
UX Speaker Series at the University of Washington Human-centered Design and Engineering Department
-
See projectParticipated in the UX Speaker Series at the University of Washington's Human-centered Design and Engineering school.
My talk covered two of my experiences at Microsoft and Amazon putting UX "tools" in the hands of engineering and business teams. I described the tools, what they enable, how they can change conversations and decisions about UX, how they can impact user research focus and value, and why I think giving away your “job” can be a good idea.
Recommendations received
1 person has recommended Jess
Join now to viewOther similar profiles
-
Cathy Pearl
Cathy Pearl
I've been teaching computers how to talk to humans for a long time. <br><br>It started when I was a teenager, creating my first chatbot on my Commodore 64. In the early 2000s, I designed automated phone systems: the first wave of publicly-facing speech recognition technology.<br><br>I've worked at a variety of startups, bringing natural language to avatar and mobile experiences. I wrote the O'Reilly book "Designing Voice User Interfaces" to share my knowledge with other practitioners.<br><br>I went on to Google, where I worked on Google Assistant for five years, before joining Bard (now Gemini) as its first conversation designer. I believe voice technology can be a game-changer for making products more accessible.<br><br>For the last year, I've been leading UX at a stealth startup called Q.ai, and in January 2026, we were acquired by Apple. Stay tuned!<br><br>I was #1 in Voicebot's Leaders in Voice for "Design and Product Pros".<br><br>I've written for Harvard Business Review, Google Design, and UX Matters. You can also find my articles on Medium (cpearl42).<br><br>I have spoken at a variety of events, including Cannes Lions International Festival of Creativity, SXSW, O'Reilly Design, and the Voice Summit.<br><br>See my professional website, https://cathypearl.com, for more.
Explore top content on LinkedIn
Find curated posts and insights for relevant topics all in one place.
View top content