Breadcrumbs Section. Click here to navigate to respective pages.

Design and Development Research

Design and Development Research

DOI link for Design and Development Research

Get Citation

AECT Design & Development Outstanding Book Award for 2008!

Design and Development Research  thoroughly discusses methods and strategies appropriate for conducting design and development research. Rich with examples and explanations, the book describes actual strategies that researchers have used to conduct two major types of design and development research: 1) product and tool research and 2) model research. Common challenges confronted by researchers in the field when planning and conducting a study are explored and procedural explanations are supported by a wide variety of examples taken from current literature. Samples of actual research tools are also presented. Important features in this volume include:

  • concise checklists at the end of each chapter to give a clear summary of the steps involved in the various phases of a project;
  • an examination of the critical types of information and data often gathered in studies, and unique procedures for collecting these data;
  • examples of data collection instruments, as well as the use of technology in data collection; and
  • a discussion of the process of extracting meaning from data and interpreting product and tool and model research findings.

Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

TABLE OF CONTENTS

Chapter | 14  pages, an overview of design and development research, chapter | 19  pages, identifying design and development research problems, chapter | 12  pages, design and development research methodology, chapter | 18  pages, product and tool research: methods and strategies, model research: methods and strategies, chapter | 15  pages, selecting participants and settings, chapter | 28  pages, collecting data in design and development research, chapter | 17  pages, interpreting design and development findings, chapter | 10  pages, the status and future of design and development research.

  • Privacy Policy
  • Terms & Conditions
  • Cookie Policy
  • Taylor & Francis Online
  • Taylor & Francis Group
  • Students/Researchers
  • Librarians/Institutions

Connect with us

Registered in England & Wales No. 3099067 5 Howick Place | London | SW1P 1WG © 2024 Informa UK Limited

  • Corpus ID: 115994236

Design and Development Research: Methods, Strategies, and Issues

  • Rita C. Richey , James D. Klein
  • Published 5 March 2007
  • Education, Environmental Science

376 Citations

Design and development research, development research of a teachers’ educational performance support system: the practices of design, development, and evaluation, building research capacity through an academic community of practice: a design case study, design science method and theory in a construction and engineering context: “a phronetic tale of research”, employing ddr to design and develop a flipped classroom and project based learning module to applying design thinking in design and technology, socio-technical system as factors and influences in form design development, design and development research: a model validation case, the implications of the differences between design research and instructional systems design for educational technology researchers and practitioners, developing a method for the design of sharable pedagogical scenarios, using instructional design to support community engagement in clinical and translational research: a design and development case.

  • Highly Influenced

Related Papers

Showing 1 through 3 of 0 Related Papers

Design and Development Research

  • First Online: 01 January 2013

Cite this chapter

design and development research methods strategies and issues

  • Rita C. Richey 5 &
  • James D. Klein 6  

34k Accesses

29 Citations

This chapter focuses on design and development research, a type of inquiry unique to the instructional design and technology field dedicated to the creation of new knowledge and the validation of existing practice. We first define this kind of research and provide an overview of its two main categories—research on products and tools and research on design and development models. Then, we concentrate on recent design and development research (DDR) by describing 11 studies published in the literature. The five product and tool studies reviewed include research on comprehensive development projects, studies of particular design and development phases, and research on tool development and use. The six model studies reviewed include research leading to new or enhanced ID models, model validation and model use research. Finally, we summarize this new work in terms of the problems it addresses, the settings and participants examined, the research methodologies employed used, and the role evaluation plays in these studies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save.

  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
  • Available as EPUB and PDF

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

design and development research methods strategies and issues

Research methods for design knowledge: clarifying definitions, characteristics, and areas of confusion

design and development research methods strategies and issues

The Many Facets of Design and Research in Instructional Design

design and development research methods strategies and issues

An Examination of the Systemic Reach of Instructional Design Models: a Systematic Review

*Cifuentes, L., Sharp, A., Bulu, S., Benz, M., & Stough, L. M. (2010). Developing a Web 2.0-based system with user-authored content for community use and teacher education. Educational Technology Research and Development, 58 (4), 377–398.

Google Scholar  

Coetzee, J. S., & Smart, A. (2012). Rapid implementation of e-learning using a technology design model. In N. A. Alias & S. Hashim (Eds.), Instructional technology research, design, and development: Lessons from the field (pp. 219–237). Hershey, PA: IGI Global.

Cowell, D. (2001). Needs assessment activities and techniques of instructional designers: A qualitative study (Doctoral dissertation, Wayne State University, 2000). Dissertation Abstracts International A, 61 (910), 3873.

*Crossman, D. C. (2010). Gilbert’s Behavioral Engineering Model: Contemporary support for an established theory. Performance Improvement Quarterly, 23 (1), 31–52.

Definition and Terminology Committee of the Association for Educational Communications & Technology. (2007). Definition. In A. Januszewski & M. Molenda (Eds.), Educational technology: A definition with commentary (pp. 1–14). New York, NY: Routledge.

Dick, W., Carey, L., & Carey, J. O. (2009). The systematic design of instruction (7th ed.). Upper Saddle River, NJ: Merrill.

Driscoll, M. P. (1984). Paradigms for research in instructional systems. Journal of Instructional Development, 7 (4), 2–5.

Article   Google Scholar  

Fischer, K. M., Savenye, W. C., & Sullivan, H. J. (2002). Formative evaluation of computer-based training for a university financial system. Performance Improvement Quarterly, 15 (1), 11–24.

Francom, G., Bybee, D., Wolfersberger, M., & Merrill, M. D. (2009). Biology 100: A task-centered, peer-interactive redesign. TechTrends, 53 (4), 35–42.

Gilbert, T. (1978). Human competence: Engineering worthy performance . New York, NY: McGraw-Hill.

Hart, S. M. (2008). The design decisions of teachers during technology integration . (Unpublished doctoral dissertation). Wayne State University, Detroit, MI.

Hillsman, T. L., & Kuptritz, V. W. (2010). Another look at the relative impact of workplace design on training transfer for supervisory communication skills. Performance Improvement Quarterly, 23 (3), 107–130.

*Hung, W-C., Smith, T. J., Harris, M. S., & Lockard, J. (2010). Development research of a teachers’ educational performance support system: The practices of design, development, and evaluation. Educational Technology Research and Development, 58 (1), 61–80.

Jones, T. S., & Richey, R. C. (2000). Rapid prototyping in action: A developmental study. Educational Technology Research and Development, 48 (2), 63–80.

Klein, J. D. (1997). ETR&D—Development: An analysis of content and survey of future direction. Educational Technology Research and Development, 45 (3), 57–62.

Klein, J. D., Martin, F., Tutty, J., & Su, Y. (2005). Teaching research to instructional design & technology students. Educational Technology, 45 (4), 29–33.

Merrill, M. D. (2002). First principles of instruction. Educational Technology Research and Development, 50(3), 43–59.

Mooij, T. (2002). Designing a digital instructional management system to optimize early education. Educational Technology Research and Development, 50 (4), 11–23.

Nieveen, N., & van den Akker, J. (1999). Exploring the potential of a computer tool for instructional developers. Educational Technology Research and Development, 47 (3), 77–98.

Plass, J. L., & Salisbusry, M. W. (2002). A living-systems design model for web-based knowledge management systems. Educational Technology Research and Development, 50 (1), 35–57.

Reigeluth, C. M., & Frick, T. W. (1999). Formative research: A methodology for creating and improving design theories. In C. M. Reigeluth (Ed.), Instructional design theories and models, volume II: A new paradigm of instructional theory (pp. 633–651). Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.

Reiser, R. A. (2012). What field did you say you were in? Defining and naming our field. In R. A. Reiser & J. V. Dempsey (Eds.), Trends and issues in instructional design and technology (3rd ed., pp. 1–7). Upper Saddle River, NJ: Merrill.

Richey, R. C. (1997). Research on instructional development. Educational Technology Research and Development, 45 (3), 91–100.

*Richey, R. C. (2005). Validating instructional design and development models. In J. M. Spector & D.A. Wiley (Eds.), Innovations in instructional technology: Essays in honor of M. David Merrill (pp. 171–185). Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.

Richey, R. C., & Klein, J. D. (2005). Developmental research methods: Creating knowledge from instructional design and development practice. Journal of Computing in Higher Education, 16 (2), 23–38.

*Richey, R. C., & Klein, J. D. (2007). Design and development research: Methods, strategies and issues . Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.

Richey, R. C., & Klein, J. D. (2008). Research on design and development. In J. M. Spector, M. D. Merrill, J. van Merrienboer, & M. P. Driscoll (Eds.), Handbook of research for educational communications and technology (3rd ed., pp. 748–757). Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.

*Richey, R. C., Klein, J. D., & Nelson, W. (2004). Developmental research: Studies of instructional design and development. In D. Jonassen (Ed.), Handbook of research for educational communications and technology (2nd ed., pp. 1099–1130). Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.

Richey, R. C., Klein, J. D., & Tracey, M. W. (2011). The instructional design knowledge base: Theory, research and practice . New York, NY: Routledge.

Richey, R. C., & Nelson, W. (1996). Developmental research. In D. Jonassen (Ed.), Handbook of research for educational communications and technology (pp. 1213–1245). New York, NY: Simon & Schuster.

Roszkowski, M. J., & Soven, M. (2010). Did you learning something useful today? An analysis of how perceived utility relates to perceived learning and their predictiveness of satisfaction with training. Performance Improvement Quarterly, 23 (2), 71–91.

Roytek, M. A. (2000). Contextual factors affecting the use of rapid ­prototyping within the design and development of instruction (Doctoral dissertation, Wayne State University, 1999). Dissertation Abstracts International A, 61 (01), 76.

Sahrir, M. (2012). Formative evaluation of an Arabic online vocabulary learning game prototype: Lessons from a Malaysian institute of higher learning experience. In N. Alias & S. Hashim (Eds.), Instructional technology research, design and development: Lessons from the field (pp. 357–368). Hershey, PA: IGI Global.

Sullivan, H., Ice, K., & Niedermeyer, F. (2000). Long-term instructional development: A 20-year ID and implementation project. Educational Technology Research and Development, 48 (4), 87–99.

Tessmer, M. (1993). Planning and conducting formative evaluation: Improving the quality of education and training . London: Kogan Page.

Tracey, M. S. (2009). Design and development research: A model validation case. Educational Technology Research and Development, 57 (4), 553–571.

Vallachia, S. W., Marker, A., & Taylor, K. (2010). But what do they really expect? Employer perceptions of the skills of entry-level instructional designers. Performance Improvement Quarterly, 22 (4), 33–51.

*van den Akker, J. (1999). Principles and methods of development research. In J. van den Akker, R. M. Branch, K. Gustafson, N. Nieveen & T. Plomp (Eds.), Design approaches and tools in education and training (pp. 1–14). Dordrecht, The Netherlands: Kluwer Academic Publishers.

Visscher-Voerman, I., & Gustafson, K. L. (2004). Paradigms in the theory and practice of education and training design. Educational Technology Research and Development, 52 (2), 69–89.

Visser, L., Plomp, T., Armiault, R. J., & Kuiper, W. (2002). Motivating students at a distance: The case of an international audience. Educational Technology Research and Development, 50 (2), 94–110.

*Voss, D. R. (2008). The development of a model for non-verbal factors impacting the design of visual information. Unpublished doctoral dissertation, Wayne State University, Detroit, MI.

Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53 (4), 5–23.

Wang, Q., Nieveen, N., & van den Akker, J. (2007). Designing a computer support system for multimedia curriculum development in Shanghai. Educational Technology Research and Development, 55 (3), 275–295.

Download references

Author information

Authors and affiliations.

Wayne State University, Detroit, MI, USA

Rita C. Richey

Florida State University, Tallahassee, FL, USA

James D. Klein

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Rita C. Richey .

Editor information

Editors and affiliations.

, Department of Learning Technologies, C, University of North Texas, North Elm 3940, Denton, 76207-7102, Texas, USA

J. Michael Spector

W. Sunset Blvd. 1812, St. George, 84770, Utah, USA

M. David Merrill

, Centr. Instructiepsychol.&-technologie, K.U. Leuven, Andreas Vesaliusstraat 2, Leuven, 3000, Belgium

Research Drive, Iacocca A109 111, Bethlehem, 18015, Pennsylvania, USA

M. J. Bishop

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Richey, R.C., Klein, J.D. (2014). Design and Development Research. In: Spector, J., Merrill, M., Elen, J., Bishop, M. (eds) Handbook of Research on Educational Communications and Technology. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3185-5_12

Download citation

DOI : https://doi.org/10.1007/978-1-4614-3185-5_12

Published : 22 May 2013

Publisher Name : Springer, New York, NY

Print ISBN : 978-1-4614-3184-8

Online ISBN : 978-1-4614-3185-5

eBook Packages : Humanities, Social Sciences and Law Education (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Publish with us

Policies and ethics

  • Find a journal
  • Track your research

Design and Development Research 1st Edition Methods, Strategies, and Issues

Cover image: Design and Development Research 1st edition 9780805857320

  • Author(s) Rita C. Richey; James D. Klein
  • Publisher Routledge

Print ISBN 9780805857320, 080585732X

Etext isbn 9781136791284, 1136791280.

  • Edition 1st
  • Copyright 2007
  • Available from $ 37.93 USD SKU: 9781136791284R180

The world’s #1 eTextbook reader for students. VitalSource is the leading provider of online textbooks and course materials. More than 15 million users have used our Bookshelf platform over the past year to improve their learning experience and outcomes. With anytime, anywhere access and built-in tools like highlighters, flashcards, and study groups, it’s easy to see why so many students are going digital with Bookshelf.

Over 2.7 million titles available from more than 1,000 publishers

Over 65,000 customer reviews with an average rating of 9.5

Over 5 billion digital pages viewed over the past 12 months

Over 7,000 institutions using Bookshelf across 241 countries

Design and Development Research: Methods, Strategies, and Issues 1st Edition is written by Rita C. Richey; James D. Klein and published by Routledge. The Digital and eTextbook ISBNs for Design and Development Research are 9781136791284, 1136791280 and the print ISBNs are 9780805857320, 080585732X. Save up to 80% versus print by going digital with VitalSource. Additional ISBNs for this eTextbook include 9780805857313, 9781410616920, 9781136791291, 9781306972307, 9781136791246, 9780203826034.

  • For educators

Design and Development Research 1st edition

Methods, strategies, and issues.

Design and Development Research 1st edition 9781136791291 1136791299

Rita C Richey , James D Klein

Out of Stock

Design and Development Research (1st edition)

Some editions change by only 10%

Book Details

Full Title:Design and Development Research: Methods, Strategies, and Issues
Edition:1st edition
ISBN-13:978-1136791291
Format:ebook
Publisher:Routledge (7/16/2014)
Copyright:2007
Dimensions:0 x 0 x 0 inches
Weight:< 1 lb

Standard Shipping Options

  • Standard shipping
  • 2-day shipping
  • 1-day shipping

Return Policy

  • Physical textbooks must be returned within 21 days of ordering
  • eTextbooks must be canceled within 10 days of ordering See policy details

Rent 📙Design and Development Research 1st edition (978-1136791291) today, or search our site for other 📚textbooks by Rita C. Richey. Every textbook comes with a 21-day "Any Reason" guarantee. Published by Routledge.

Publisher Description

AECT Design & Development Outstanding Book Award for 2008!Design and Development Research thoroughly discusses methods and strategies appropriate for conducting design and development research. Rich with examples and explanations, the book describes actual strategies that researchers have used to conduct two major types of design and development research: 1) product and tool research and 2) model research. Common challenges confronted by researchers in the field when planning and conducting a study are explored and procedural explanations are supported by a wide variety of examples taken from current literature. Samples of actual research tools are also presented. Important features in this volume include:concise checklists at the end of each chapter to give a clear summary of the steps involved in the various phases of a project;an examination of the critical types of information and data often gathered in studies, and unique procedures for collecting these data;examples of data collection instruments, as well as the use of technology in data collection; anda discussion of the process of extracting meaning from data and interpreting product and tool and model research findings.Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

Table of Contents

Contents: Preface. An Overview of Design and Development Research. Identifying Design and Development Research Problems. Design and Development Research Methodology. Product and Tool Research--Methods and Strategies. Model Research--Methods and Strategies. Selecting Participants and Settings. Collecting Design and Development Research Data. Interpreting Design and Development Findings. The Status and Future of Design and Development Research.

Overview of Design and Development Research (DDR) For Applied Doctorate Students in the Instructional Design Program

Types of design and development research, 3 stages in design and development research, data collection methods and sources of data in ddr.

  • Qualitative Narrative Inquiry Research
  • Action Research Resource
  • Case Study Design in an Applied Doctorate
  • SAGE Research Methods
  • Research Examples (SAGE) This link opens in a new window
  • Dataset Examples (SAGE) This link opens in a new window
  • IRB Resource Center This link opens in a new window

The purpose of this quick guide is to assist Applied Doctorate students in the Instructional Design Program in determining the best methodology and design for their Applied Doctorate Experience (ADE) dissertation. The guide covers intended target audience, an overview of Design and Development Research (DDR), types of DDR research including product, program, tool research, and model research, 3 stages providing alignment of DDR with NUs Applied Doctoral Record (DDR) deliverables, examples of problem, purpose, and research questions for DDR research, and suggested references. 

Target Audience: Doctoral Students in Instructional Design in the ADE program

This quick reference guide will aid doctoral students in instructional design challenged with deciding on what type of applied research study they want to do for their dissertation.

Overview of Design and Development Research (DDR) Methods

At the core of the instructional design and instructional technology and media field, is the design, development, implementation and evaluation of instructional products, tools, programs, models, and frameworks.  In many ways DDR is like Action Research (Goldkuhl, 2012), however, there are many differences. DDR research allows instructional designers a pathway to test theory, models, and frameworks and to authenticate practice. The focus of DDR is on the use, design, development, implementation, and evaluation of products, tools, programs, and models using instructional design models and frameworks. Richey and Klein (2007) defined DDR as “the systematic study of design, development, and evaluation processes with the aim of establishing an empirical basis for the creation of instructional and non-instructional products and tools and new or enhanced models that govern their development” (p. xv). Often the models and frameworks are validated and/or further developed and enhanced through the DDR. DDR is applied research. An area of DDR research that is particularly applicable to ADE students is the creation, implementation, and evaluation of one or more artifacts, such as products, tools, models, new technologies, and learning objects that will aid in solving a complex problem in practice that can be addressed through human imagination, creativity, engagement, and interaction (Ellis & Levy, 2010). These types of problems are found in K-12 education, higher education, corporations, not-for-profits, healthcare, and the military. 

  • Example Design and Development Research

The field of DDR is constantly evolving and expanding as technology and media are changing at exponential rates.  Richey and Klein (2007) in their seminal work divided DDR into two major categories:

  • Product and Tool Research and
  • Model Research.

Table 1 provides a summary of common designs used in DDR. Most DDR work falls under the qualitative research category of qualitative case study, however, methodologies such as quantitative and mixed method have been used as well as other qualitative designs, including Delphi.

Table 1: Types of DDR Research, Focus, Data Collection Methods, and Artifacts
Type of DDR Research DDR Focus Data Collection Methods Researcher/Designer Artifact Examples
Product, Program, and Tool Development Research Full Life Cycle Design and Development Projects Needs Assessment, Content Analysis, Surveys/Questionnaires, Artifact Development, In-depth Interviews, Observations, Evaluation Methods (Kirkpatrick Level 1-4) Researcher/Designer Artifact Examples
Needs Assessment
Design Document
Story Boards
Program Materials or
Product Prototype or
Tool Prototype
Formative Evaluation: Pilot, Alpha/Beta Test
Evaluation Report
Product, Program, and Tool Development Research One or More Phases of the Life Cycle Needs Assessment, Content Analysis, Surveys/Questionnaires, Artifact Development, In-depth Interviews, Observations, Evaluation Methods (Kirkpatrick Level 1-4) Needs Assessment
Design Document
Story Boards
Program Materials or
Product Prototype or 
Tool Prototype
Formative Evaluation: Pilot, Alpha/Beta Test
Evaluation Report
Product and Tool Development Research Tool Development Needs Assessment, Expert Interviews, Artifact/Tool Development, Expert Validation (NGT), Participant Interviews, Focus Group Interviews, Evaluation Methods (Kirkpatrick Level 1-4) Needs Assessment
Design Document
Story Boards
Tool Prototype
Formative Tool Evaluation: Pilot, Alpha/Beta Test
Formative Tool Evaluation Report
Product and Tool Research Tool Use Participant Interviews, Participant Think Aloud/Talk Aloud Methods, Focus Group Interviews,  Evaluation Methods (Kirkpatrick Level 1-4) Needs Assessment
Tool Use Evaluation Report
Model Research Model Development Expert Interviews, Expert Review, Expert Evaluation - Nominal Group Technique (NGT) and Focus Group Interviews Needs Assessment
Design Document
Story Boards
Model Built
Formative Model 
Expert Evaluation Report
Model Research Model Use Participant Interviews, Participant Think Aloud/Talk Aloud Methods, Evaluation Methods (Kirkpatrick Level 1-4) Needs Assessment
Design Document
Model Use
Participant Evaluation Report
Model Research Model Validation Expert Individual Interviews, Expert Review, Expert Evaluation - Nominal Group Technique (NGT) 
Focus Group Interviews
Needs Assessment
Model Validation Plan
Expert Evaluation Report

Product, Program, and Tool Research

Ellis and Levy (2010) asserted that DDR must go beyond commercial product development by determining a research problem, based on existing research literature and gaps in the literature that researchers assert must be studied to add to the instructional design knowledgebase.

Product and Tool Research can be further divided into:

  • Comprehensive Design and Development Projects covering all phases of the instructional design process,
  • Specific Project Phases (such as those in the ADDIE model: Analysis, Design, Development, Implementation, and Evaluation), and
  • Design, Development, and Use of tools (Richey & Klein, 2007).

Model Research

Instructional designers and instructional technologists have focused on model research since the emergence of the field.

Model research can be broken into three types:

  • Model Development,
  • Model Validation and

Model development can focus on a comprehensive model design or on part of a process. Model validation research uses empirical processes to prove the effectiveness of a model in practice. Finally, model use research addresses usability typically from the perspective of instructional designers and stakeholder experts.

3 Stages in Design and Development Research for the ADE Doctoral Student’s Dissertation

NU doctoral students in the Instructional Design Program can use one of the various types of DDR research to complete their doctoral dissertation using the NU ADE template. There will be three stages in this process and in each stage the student will have one or more deliverables using the NU template and posting in the ADR on NU One.

Stage 1: Design and Development Research aligned with the NU ADE Template Process

  • Identify a research worthy problem which is expressed by researchers in peer reviewed research literature. Ask yourself, what is going wrong? What do researchers say is known about the problem? And what is needed to be known to address the problem?
  • Describe the purpose of your research ensuring that it aligns with your problem statement. In the description state your methodology and design and which DDR type of research you will do. Be sure to include a description of your target population (audience), the size of your sample and the sampling strategy you will use to access your sample. What permissions do you need? Site permission? Other IRB permission?
  • Write your research questions to align with your problem and purpose statements.
  • Complete Section 1 of your Applied Doctoral Experience (ADE) template securing all necessary approvals in the Applied Doctoral Record (ADR).
  • Needs Assessment
  • Measurable Goals and Objectives
  • Sample size and Access to the sample
  • Sampling strategy
  • Content analysis (course, program, product, or tool descriptions)
  • Technology and media analysis/selection
  • Learning management system(s)
  • Asynchronous
  • Synchronous
  • Evaluation Plan
  • Complete Section 2, Proposal Draft, Proposal for AR, and Final Proposal of the ADE securing all necessary approvals in the ADR.
  • Submit Proposal and IRB Application to secure IRB approval.

Stage 2: Design and Development Research aligned with the NU ADE Template Process

After receiving IRB approval of your ADE Proposal, it is time to design, develop, test, validate, and/or evaluate your artifacts. Below are example steps:

  • Review and Finalize Design Document
  • Recruit Expert Participants, if required
  • Recruit Artifact User/Participants, if required
  • Lesson plan or syllabus
  • Instructional strategies and activities
  • Participant materials
  • Trainer materials
  • Storyboards and scripts
  • Other media
  • Create model, tool, product, or program.
  • Validate model, if required
  • Evaluation plan (Kirkpatrick Levels 1, 2, 3, 4)
  • Alpha test, Beta test, Pilots.
  • Rapid Prototyping
  • Participant reaction
  • Trainer/facilitator reaction
  • Were Design Goals met?
  • Were Design Objectives met?
  • Revise artifact(s), Retest, if necessary.

Stage 3: Design and Development Research aligned the NU ADE Template Process

Complete Section 3 of the ADE template presenting the study findings, conclusions, and implications. Next pull all three sections into a dissertation manuscript for approval in the ADR.

While DDR covers a wide variety of approaches, most doctoral students in the ADE program will find case study to be the preferred design. To strengthen trustworthiness of the data, multiple sources of data will typically be used.  Using multiple sources of data is called triangulation in research. Figure 1 shows examples of sources of data for DDR.

The goal is to create, use, and/or validate New Artifacts by collecting and analyzing various sources of data including:

  • Existing artifacts,
  • Expert individual and focus group interviews,
  • Participant/user individual interviews, talk aloud-think aloud interviews, focus group interviews,
  • Research observation and participant observation,
  • Evaluation, Kirkpatrick Levels 1-4, and
  • Needs assessment and design documents.

The new artifacts may be lesson plans, student guides, facilitator/teacher guides, learning objects, tools, models, programs, and/or products.

Figure:  Sources of Data in DDR

Sources of data in DDR graphic.

Ellis, T.J. & Levy, Y. (2010). A guide for novice researchers: Design and development research methods. Proceedings of Informing Science & IT Education Conference (InSITE) 2010, pp. 108-118. http://proceedings.informingscience.org/InSITE2010/InSITE10p107-118Ellis725.pdf

Goldkuhl, G. (2012). From Action Research to Practice Research. Australasian Journal of Information Systems, 17 (2). https://doi.org/10.3127/ajis.v17i2.688

Richey, R. C. & Klein, J. D. (2007). Design and Development Research. Routledge

  • << Previous: Qualitative Descriptive Design
  • Next: Qualitative Narrative Inquiry Research >>
  • Last Updated: Jul 28, 2023 8:05 AM
  • URL: https://resources.nu.edu/c.php?g=1013605

National University

© Copyright 2024 National University. All Rights Reserved.

Privacy Policy | Consumer Information

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Review Article
  • Open access
  • Published: 08 August 2024

Research progress and intellectual structure of design for digital equity (DDE): A bibliometric analysis based on citespace

  • Baoyi Zhang   ORCID: orcid.org/0000-0003-4479-7587 1  

Humanities and Social Sciences Communications volume  11 , Article number:  1019 ( 2024 ) Cite this article

390 Accesses

Metrics details

  • Cultural and media studies
  • Science, technology and society

Digital equity is imperative for realizing the Sustainable Development Goals, particularly SDG9 and SDG10. Recent empirical studies indicate that Design for Digital Equity (DDE) is an effective strategy for achieving digital equity. However, before this review, the overall academic landscape of DDE remained obscure, marked by substantial knowledge gaps. This review employs a rigorous bibliometric methodology to analyze 1705 DDE-related publications, aiming to delineate DDE’s research progress and intellectual structure and identify research opportunities. The retrieval strategy was formulated based on the PICo framework, with the process adhering to the PRISMA systematic review framework to ensure transparency and replicability of the research method. CiteSpace was utilized to visually present the analysis results, including co-occurrences of countries, institutions, authors, keywords, emerging trends, clustering, timeline analyses, and dual-map overlays of publications. The results reveal eight significant DDE clusters closely related to user-centered design, assistive technology, digital health, mobile devices, evidence-based practices, and independent living. A comprehensive intellectual structure of DDE was constructed based on the literature and research findings. The current research interest in DDE lies in evidence-based co-design practices, design issues in digital mental health, acceptance and humanization of digital technologies, digital design for visually impaired students, and intergenerational relationships. Future research opportunities are identified in DDE’s emotional, cultural, and fashion aspects; acceptance of multimodal, tangible, and natural interaction technologies; needs and preferences of marginalized groups in developing countries and among minority populations; and broader interdisciplinary research. This study unveils the multi-dimensional and inclusive nature of methodological, technological, and user issues in DDE research. These insights offer valuable guidance for policy-making, educational strategies, and the development of inclusive digital technologies, charting a clear direction for future research.

Similar content being viewed by others

design and development research methods strategies and issues

Recommendations to advance digital health equity: a systematic review of qualitative studies

design and development research methods strategies and issues

Design, content validity, and inter-observer reliability of the ‘Digitization of Cultural Heritage, Identities, and Education’ (DICHIE) instrument

design and development research methods strategies and issues

Digital competence in adolescents and young adults: a critical analysis of concomitant variables, methodologies and intervention strategies

Introduction.

Digital equity has emerged as a critical factor in achieving the Sustainable Development Goals (SDGs), especially SDG9 (Industry, Innovation, and Infrastructure) and SDG10 (Reduced Inequalities) (United Nations, 2021 ; UNSD 2023 ), amidst the rapid evolution of digital technologies. In our increasingly digitalized society, these technologies amplify and transform existing social inequalities while offering numerous benefits, leading to more significant disparities in access and utilization (Grybauskas et al., 2022 ). This situation highlights the critical need for strategies that promote equitable digital participation, ensuring alignment with the overarching objectives of the SDGs. Digital equity, a multi-faceted issue, involves aspects such as the influence of cultural values on digital access (Yuen et al., 2017 ), the challenges and opportunities of technology in higher education (Willems et al., 2019 ), and the vital role of government policies in shaping digital divides (King & Gonzales, 2023 ), and the impact on healthcare access and delivery (Lawson et al., 2023 ). Equally important are the socioeconomic factors that intersect with digital equity (Singh, 2017 ) and the pressing need for accessible digital technologies for disabled individuals (Park et al., 2019 ). These issues are observed globally, necessitating diverse and inclusive strategies.

Design thinking, in addressing issues of social equality and accessibility, plays an essential role in accessibility (Persson et al., 2015 ; Dragicevic et al., 2023a ); in other words, it serves as a crucial strategy for reducing social inequality. Indeed, design strategies focused on social equality, also known as Equity-Centered Design (Oliveri et al., 2020 ; Bazzano et al., 2023 ), are diverse, including universal design (Mace ( 1985 )), Barrier-free design (Cooper et al., 1991 ), inclusive design (John Clarkson, Coleman ( 2015 )), and Design for All (Bendixen & Benktzon, 2015 ). Stanford d.school has further developed the Equity-Centered Design Framework based on its design thinking model (Stanford d.school, 2016 ) to foster empathy and self-awareness among designers in promoting equality. Equity-centered approaches are also a hot topic in academia, especially in areas like education (Firestone et al., 2023 ) and healthcare (Rodriguez et al., 2023 ). While these design approaches may have distinct features and positions due to their developmental stages, national and cultural contexts, and the issues they address, Equity-Centered Design consistently plays a vital role in achieving the goal of creating accessible environments and products, making them accessible and usable by individuals with various abilities or backgrounds (Persson et al., 2015 ).

Equity-centered design initially encompassed various non-digital products, but with the rapid advancement of digitalization, it has become increasingly critical to ensure that digital technologies are accessible and equitable for all users. This can be referred to as Design for Digital Equity (DDE). However, the current landscape reveals a significant gap in comprehensive research focused on Design for Digital Equity (DDE). This gap highlights the need for more focused research and development in this area, where bibliometrics can play a significant role. Through systematic reviews and visualizations, bibliometric analysis can provide insights into this field’s intellectual structure, informing and guiding future research directions in digital equity and design.

Bibliometrics, a term first coined by Pritchard in 1969 (Broadus, 1987 ), has evolved into an indispensable quantitative tool for analyzing scholarly publications across many research fields. This method, rooted in the statistical analysis of written communication, has significantly enhanced our understanding of academic trends and patterns. Its application spans environmental studies (Wang et al., 2021 ), economics (Qin et al., 2021 ), big data (Ahmad et al., 2020 ), energy (Xiao et al., 2021 ), medical research (Ismail & Saqr, 2022 ) and technology acceptance (Wang et al., 2022 ). By distilling complex publication data into comprehensible trends and patterns, bibliometrics has become a key instrument in shaping our understanding of the academic landscape and guiding future research directions.

In bibliometrics, commonly used tools such as CiteSpace (Chen, 2006 ), VOSviewer (Van Eck, Waltman ( 2010 )), and HistCite (Garfield, 2009 ) are integral for advancing co-citation analysis and data visualization. Among these, CiteSpace, developed by Professor Chen (Chen, 2006 ), is a Java-based tool pivotal in advancing co-citation analysis for data visualization and analysis. Renowned for its integration of burst detection, betweenness centrality, and heterogeneous network analysis, it is essential in identifying research frontiers and tracking trends across various domains. Chen demonstrates the versatility of CiteSpace in various fields, ranging from regenerative medicine to scientific literature, showcasing its proficiency in extracting complex insights from data sets (Chen, 2006 ). Its structured methodology, encompassing time slicing, thresholding, and more, facilitates comprehensive analysis of co-citations and keywords. This enhances not only the analytical capabilities of CiteSpace but also helps researchers comprehend trends within specific domains. (Chen et al. 2012 ; Ping et al. 2017 ). Therefore, CiteSpace is a precious tool in academic research, particularly for disciplines that require in-depth analysis of evolving trends and patterns.

After acknowledging the significance of DDE in the rapidly evolving digital environment, it becomes imperative to explore the academic contours of this field to bridge knowledge gaps, a critical prerequisite for addressing social inequalities within digital technology development. We aim to scrutinize DDE’s research progress and intellectual structure, analyzing a broad spectrum of literature with the aid of bibliometric and CiteSpace methodologies. Accordingly, four research questions (RQs) have been identified to guide this investigation. The detailed research questions are as follows:

RQ1: What are the trends in publications in the DDE field from 1995 to 2023?

RQ2: Who are the main contributors, and what are the collaboration patterns in DDE research?

RQ3: What are the current research hotspots in DDE?

RQ4: What is the intellectual structure and future trajectory of DDE?

The remainder of this paper is structured as follows: The Methods section explains our bibliometric approach and data collection for DDE research. The Results section details our findings on publication trends and collaborative networks, addressing RQ1 and RQ2. The Discussion section delves into RQ3 and RQ4, exploring research hotspots and the intellectual structure of DDE. The Conclusion section summarizes our study’s key insights.

In this article, the systematic review of DDE follows the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines (PRISMA 2023 ), which are evidence-based reporting guidelines for systematic review reports (Moher et al., 2010 ). PRISMA was developed to enhance the quality of systematic reviews and enhance the clarity and transparency of research findings (Liberati et al., 2009 ). To achieve this goal, the research workflow in this study incorporates an online tool based on the R package from PRISMA 2020. This tool enables researchers to rapidly generate flowcharts that adhere to the latest updates in the PRISMA statement, ensuring transparency and reproducibility in the research process. This workflow comprises three major stages: Identification, Screening, and Inclusion, as illustrated in Fig. 1 .

figure 1

PRISMA flowchart for the DDE systematic review.

Additionally, to obtain high-quality data sources, the Web of Science (referred to as WOS), provided by Clarivate Analytics, was chosen. WOS is typically considered the optimal data source for bibliometric research (van Leeuwen, 2006 ). The WOS Core Collection comprises over 21,000 peer-reviewed publications spanning 254 subject categories and 1.9 billion cited references, with the earliest records traceable back to 1900 (Clarivate, 2023 ). To thoroughly explore the research on DDE, this review utilized all databases within the WOS Core Collection as the source for data retrieval.

Search strategy

Developing a rational and effective search strategy is crucial for systematic reviews (Cooper et al., 2018 ), typically necessitating a structured framework to guide the process (Sayers, 2008 ). This approach ensures comprehensive and relevant literature coverage. To comprehensively and accurately assess the current state and development of “Design for Digital Equity,” this paper employs the PICo (participants, phenomena of interest, and context) model as its search strategy, a framework typically used for identifying research questions in systematic reviews (Stern et al., 2014 ). While the PICo framework is predominantly utilized within clinical settings for systematic reviews, its structured approach to formulating research questions and search strategies is equally applicable across many disciplines beyond the clinical environment. This adaptability makes it a suitable choice for exploring the multi-faceted aspects of digital equity in a non-clinical context (Nishikawa-Pacher, 2022 ).

This review, structured around the PICo framework, sets three key concepts (search term groups): Participants (P): any potential digital users; Phenomena of Interest (I): equity-centered design; Context (Co): digital equity. To explore the development and trends of DDE comprehensively, various forms of search terms are included in each PICo element. The determination of search terms is a two-stage process. In the first stage, core terms of critical concepts like equity-centered design, digital equity, and Design for Digital Equity, along with their synonyms, different spellings, and acronyms, are included in the list of candidate search terms. Wildcards (*) are used to expand the search range to ensure the inclusion of all variants and derivatives of critical terms, thus enhancing the thoroughness and depth of the search. However, studies have indicated the challenge of identifying semantically unrelated terms relevant to the research (Chen, 2018 ). To address this issue, the second phase of developing the search strategy involves reading domain-specific literature reviews using these core terms. This literature-based discovery (LBD) approach can identify hidden, previously unknown relationships, finding significant connections between different kinds of literature (Kastrin & Hristovski, 2021 ). The candidate word list is then reviewed, refined, or expanded by domain experts. Finally, a search string (Table 1 ) is constructed with all search terms under each search term group linked by the Boolean OR (this term or that term), and the Boolean links each group AND (this group of terms and that group of terms).

Inclusion criteria

Following the PRISMA process (Fig. 1 ), literature in the identification phase was filtered using automated tools based on publication data attributes such as titles, subjects, and full texts or specific criteria like publication names, publication time ranges, and types of publication sources. Given the necessity for a systematic and extensive exploration of DDE research, this review employed an advanced search using “ALL” instead of “topic” or “Title” in the search string to ensure a broader inclusion of results. No limitations were set on other attributes of the literature. The literature search was conducted on December 5, 2023, resulting in 1747 publications exported in Excel for further screening.

During the literature screening phase, the authors reviewed titles and abstracts, excluding 11 publications unrelated to DDE research. Three papers were inaccessible in the full-text acquisition phase. The remaining 1729 publications were then subjected to full-text review based on the following inclusion and exclusion criteria. Eventually, 1705 papers meeting the criteria were imported into CiteSpace for analysis.

Papers were included in this review if they met the following criteria:

They encompassed all three elements of PICo: stakeholders or target users of DDE, design relevance, and digitalization aspects.

They had transparent research methodologies, whether empirical or review studies employing qualitative, quantitative, or mixed methods.

They were written in English.

Papers were excluded if they:

Focused solely on digital technology, unrelated to design, human, and social factors.

Contained terms with identical acronyms but different meanings, e.g., ICT stands for Inflammation of connective tissue in medicine.

Were unrelated to topics of social equality.

Were in languages other than English.

Data analysis

To comprehensively address Research Question 1: “What are the publication trends in the DDE field from 1995 to 2023?” this study utilized CiteSpace to generate annual trend line graphs for descriptive analysis. This analysis revealed the annual development trends within the DDE research field and identified vital research nodes and significant breakthroughs by analyzing the citation frequency of literature across different years. Utilizing the burst detection feature in CiteSpace, key research papers and themes were further identified, marking periods of significant increases in research activity. For Research Question 2: “Who are the main contributors to DDE research, and what are their collaboration patterns?” nodes for countries, institutions, cited authors, cited publications, and keywords were set up in CiteSpace for network analysis. Our complex network diagrams illustrate the collaboration relationships between different researchers and institutions, where the size of the nodes indicates the number of publications by each entity, and the thickness and color of the lines represent the strength and frequency of collaborations.

Additionally, critical scholars and publications that act as bridges within the DDE research network were identified through centrality analysis. In the keyword analysis, the focus was on co-occurrence, trend development, and clustering. Current research hotspots were revealed using the LSI algorithm in CiteSpace for cluster analysis, demonstrating how these hotspots have evolved over time through timeline techniques. A dual-map overlay analysis was used to reveal citation relationships between different disciplines, showcasing the interdisciplinary nature of DDE research. In the visual displays of CiteSpace, the visual attributes of nodes and links were meticulously designed to express the complex logical relationships within the data intuitively. The size of nodes typically reflects the publication volume or citation frequency of entities such as authors, institutions, countries, or keywords, with larger nodes indicating highly active or influential research focal points. The change in node color often represents the progress of research over time, with gradients from dark to light colors indicating the evolution from historical to current research. Whether solid or dashed, the outline of nodes differentiates mainstream research areas from marginal or emerging fields. The thickness and color of the lines reflect the strength of collaborations or frequency of citations, aiding in the identification of close collaborations or frequent citations. These design elements not only enhance the information hierarchy of the diagrams but also improve the usability and accuracy for users exploring and analyzing the data, effectively supporting researchers in understanding the structure and dynamics of the academic field. The subsequent research results section provides detailed descriptions for each visual element.

The first section of the Results primarily addresses RQ1: “What are the trends in publications in the DDE field from 1995 to 2023?” The subsequent sections collectively address RQ2: “Who are the main contributors, and what are the collaboration patterns in DDE research?”

Analysis of Publication Trends

Figure 2 , extracted from the WOS citation analysis report, delineates the progression of annual scholarly publications within the Design for Digital Equity field. This trend analysis resonates with de Solla Price’s model of scientific growth (Price 1963 ), beginning with a slow and steady phase before transitioning into a period of more rapid expansion. Notably, a pronounced spike in publications was observed following 2020, characterized by the global COVID-19 pandemic. This uptick indicates an acute scholarly response to the pandemic, likely propelled by the heightened need for digital equity solutions as the world adapted to unprecedented reliance on digital technologies for communication, work, and education amidst widespread lockdowns and social distancing measures. The graph presents a clear visualization of this scholarly reaction, with the peak in 2021 marking the zenith of research output, followed by a slight retraction, which may suggest a period of consolidation or a pivot towards new research frontiers in the post-pandemic era.

figure 2

Trends in Scholarly Publications on Design for Digital Equity (1997–2023).

Visual analysis by countries or regions

Table 2 presents an illustrative overview of the diverse global contributions to research on “Design for Digital Equity,” including a breakdown of the number of publications, centrality, and the initial year of engagement for each participating country. The United States stands preeminent with 366 publications, affirming its central role in the domain since the mid-1990s. Despite fewer publications, the United Kingdom boasts the highest centrality, signaling its research as notably influential within the academic network since the late 1990s. Since China entered the DDE research arena in 2011, its publications have had explosive growth, reflecting rapid ascension and integration into the field. Furthermore, the extensive volume of publications from Canada and the notable centrality of Spain underscores their substantial and influential research endeavors. The table also recognizes the contributions from countries such as Germany, Italy, and Australia, each infusing unique strengths and perspectives into the evolution of DDE research.

Figure 3 , crafted within CiteSpace, delineates the collaborative contours of global research in Design for Digital Equity (DDE). Literature data are input with ‘country’ as the node type and annual segmentation for time slicing, employing the ‘Cosine’ algorithm to gauge the strength of links and the ‘g-index’ ( K  = 25) for selection criteria. The visualization employs a color gradient to denote the years of publication, with the proximity of nodes and the thickness of the interconnecting links articulating the intensity and frequency of collaborative efforts among nations. For instance, the close-knit ties between the United States, Germany, and France underscore a robust tripartite research collaboration within the DDE domain. The size of the nodes corresponds directly to the proportion of DDE publications contributed by each country. Larger nodes, such as those representing the USA and Germany, suggest more publications, indicating significant research activity and influence within the field. Purple nodes, such as those representing England and Canada, signal a strong centrality within the network, suggesting these countries contribute significantly and play a pivotal role in disseminating research findings throughout the network. The intertwining links of varying thickness reveal the nuanced interplay of collaboration: dense webs around European countries, for instance, underscore a rich tradition of continental cooperation, while transatlantic links point to ongoing exchanges between North American and European researchers. Moreover, the appearance of vibrant links extending toward Asian countries such as China and South Korea reflects the expanding scope of DDE research to encompass a truly global perspective, integrating diverse methodologies and insights as the research community tackles the universal challenges of digital equity.

figure 3

Collaborative networks between countries and regions in DDE research.

Visual analysis by institutions

Table 3 presents a quantified synopsis of institutional research productivity and centrality within the Design for Digital Equity field. The University of Toronto emerges as the most prolific contributor, with 64 publications and a centrality score of 0.06, indicating a significant impact on the field since 2008. The University System of Georgia and the Georgia Institute of Technology, each with 27 and 25 publications, respectively, registering a centrality of 0.01 since 2006, denoting their sustained scholarly activity over time. The Oslo Metropolitan University, with 23 publications and a centrality of 0.02 since 2016, and the Consiglio Nazionale delle Ricerche, with 17 publications since 2009, highlight the diverse international engagement in DDE research. The table also notes the early contributions of the Pennsylvania Commonwealth System of Higher Education, with 17 publications since 2004, although its centrality remains at 0.01. Institutions such as Laval University, Monash University, and the Polytechnic University of Milan show emergent centrality in the field, with recent increases in scholarly output, as indicated by their respective publication counts of 13, 12, and 12 since 2019, 2020, and 2018. This data evidences a dynamic and growing research domain characterized by historical depth and contemporary expansion.

Figure 4 displays a network map highlighting the collaborative landscape among institutions in the field of DDE. The University of Toronto commands a central node with a substantial size, indicating its leading volume of research output. The University of Alberta and CNR exhibit nodes colored to represent earlier works in the field, establishing their roles as foundational contributors. Inter-institutional links, albeit pleasing, are observable, suggesting research collaborations. Nodes such as the University of London and the Polytechnic University of Milan, while smaller, are nonetheless integral, denoting their active engagement in DDE research. The color coding of nodes corresponds to publication years, with warmer colors indicating more recent research, providing a temporal dimension to the map. This network visualization is an empirical tool to assess the scope and scale of institutional contributions and collaborations in DDE research.

figure 4

Network Map of Institutional Collaboration in DDE.

Analysis by publications

Table 4 delineates the pivotal academic publications contributing to the field, as evidenced by citation count, centrality, and publication year, offering a longitudinal perspective of influence and relevance. ‘Lecture Notes in Computer Science’ leads the discourse with 354 citations and the highest centrality of 0.10 since 2004, indicating its foundational and central role over nearly two decades. This is followed by the ‘Journal of Medical Internet Research,’ with 216 citations since 2013 and centrality of 0.05, evidencing a robust impact in a shorter timeframe. The relationship between citation count and centrality reveals a pattern of influential cores within the field. Publications with higher citation counts generally exhibit greater centrality, suggesting that they are reference points within the academic network and instrumental in shaping the digital equity narrative. The thematic diversity of the publications—from technology-focused to health-oriented publications like ‘Computers in Human Behavior’ and ‘Disability and Rehabilitation’—reflects the interdisciplinary nature of research in digital equity, encompassing a range of issues from technological access to health disparities. ‘CoDesign,’ despite its lower position with 101 citations since 2016 and centrality of 0.01, represents the burgeoning interest in participatory design practices within the field. Its presence underscores the evolving recognition of collaborative design processes as essential to achieving digital equity, particularly in the later years where user-centered design principles are increasingly deemed critical for inclusivity in digital environments.

Visual analysis by authors

Table 5 enumerates the most influential authors in the domain of DDE research, ranked by citation count and centrality within the academic network from the year of their first cited work. The table is led by Braun V., with a citation count of 103 and a centrality of 0.13 since 2015, indicating a strong influence in the recent scholarly conversation on DDE. Close behind, the World Health Organization (WHO), with 97 citations and a centrality of 0.10 since 2012, and Nielsen J., with an impressive centrality of 0.32 and 89 citations since 1999, denote long-standing and significant contributions to the field. The high centrality scores, remarkably Nielsen’s, suggest these authors’ works are central nodes in the network of citations, acting as crucial reference points for subsequent research. Further down the list, authors such as Davis F.D. and Venkatesh V. are notable for their scholarly impact, with citation counts of 74 and 59, respectively, and corresponding centrality measures that reflect their substantial roles in shaping DDE discourse. The table also recognizes the contributions of authoritative entities like the United Nations and the World Health Organization, reflecting digital equity research’s global and policy-oriented dimensions. The presence of ISO in the table, with a citation count of 25 since 2015, underscores the importance of standardization in the digital equity landscape. The diversity in authors and entities—from individual researchers to global organizations—highlights the multi-faceted nature of research in DDE, encompassing technical, social, and policy-related studies.

Figure 5 illustrates the collaborative network between cited authors in the DDE study. The left side of the network map is characterized by authors with cooler-colored nodes, indicating earlier contributions to digital equity research. Among these, Wright Ronald stands out with a significantly large node and a purple outline, highlighting his seminal role and the exceptional citation burst in his work. Cool colors suggest these authors laid the groundwork for subsequent research, with their foundational ideas and theories continuing to be pivotal in the field. Transitioning across the network to the right, a gradual shift to warmer node colors is observed, representing more recent contributions to the field. Here, the nodes increase in size, notably for authors such as Braun V. and the WHO, indicating a high volume of publications and a more contemporary impact on the field. The links between these recent large nodes and the earlier contributors, such as Wright Ronald, illustrate a scholarly lineage and intellectual progression within the research community. The authors with purple outlines on the right side of the map indicate recent citation bursts, signifying that their work has quickly become influential in the academic discourse of digital equity research. These bursts are likely a response to the evolution of digital technologies and the emerging challenges of equality within the digital space.

figure 5

Collaborative networks of globally cited authors in DDE research.

Visual analysis by keywords

The concurrent keywords reflect the research hotspots in the field of DDE. Table 6 presents the top 30 keywords with the highest frequency and centrality, while Fig. 6 shows the co-occurrence network of these keywords. Within the purview of Fig. 6 , the visualization elucidates the developmental trajectory of pivotal terms in the digital equity research domain. The nodes corresponding to ‘universal design,’ ‘assistive technology,’ and ‘user-centered design’ are characterized by lighter centers within their larger structures, signifying an established presence and a maturation over time within scholarly research. The robust, blue-hued link connecting ‘universal design’ and ‘assistive technology’ underscores these foundational concepts’ strong and historical interrelation. The nodes encircled by purple outlines, such as ‘universal design,’ ‘inclusive design,’ and ‘participatory design,’ denote a high degree of centrality. This indicates their role as critical junctions within the research network, reflecting a widespread citation across diverse studies and underscoring their integral position within the thematic constellation of the field. Of particular note are the nodes with red cores, such as ‘design for all,’ ‘digital health,’ ‘visual impairment,’ ‘mobile phone,’ and ‘digital divide.’ These nodes signal emergent focal points of research, indicating recent academic interest and citation frequency surges. Such bursts are emblematic of the field’s dynamic nature, pointing to evolving hotspots of scholarly investigation. For instance, the red core of ‘digital health’ suggests an intensifying dialogue around integrating digital technology in health-related contexts, a pertinent issue in modern discourse.

figure 6

Keyword co-occurrence networks in the DDE domain.

Building upon the highlighted red-core nodes denoting keyword bursts in Figs. 6 , 7 , “Top 17 Keywords with the Strongest Citation Bursts in DDE,” offers a quantified analysis of such emergent trends. This figure tabulates the keywords that have experienced the most significant surges in academic citations within the field of DDE from 1997 to 2023. Keywords such as ‘design for all’ and ‘universal design’ anchor the list, showcasing their foundational bursts starting from 1997, with ‘design for all’ maintaining a high citation strength of 20.66 until 2015 and ‘universal design’ demonstrating enduring relevance through 2016. This signifies the long-standing and evolving discourse surrounding these concepts. In contrast, terms like ‘mobile phone,’ ‘digital health,’ and ‘participation’ represent the newest fronts in DDE research, with citation bursts emerging as late as 2020 and 2021, reflecting the rapid ascent of these topics in the recent scholarly landscape. The strength of these bursts, particularly the 7.07 for ‘mobile phone,’ suggests a burgeoning field of study responsive to technological advancements and societal shifts. The bar graph component of the figure visually represents the duration of each burst, with red bars marking the start and end years. The length and position of these bars corroborate the temporal analysis, mapping the lifecycle of each keyword’s impact.

figure 7

Top 17 Keywords with the Strongest Citation Bursts in DDE.

The authors have conducted a keyword clustering analysis on the data presented in Fig. 6 , aiming to discern the interrelationships between keywords and delineate structured knowledge domains within the field of DDE. Utilizing the Latent Semantic Indexing (LSI) algorithm to derive the labeling of clusters, they have effectively crystallized seven distinct clusters in DDE research, as depicted in Fig. 8 . The cluster represented in red, labeled ‘#0 universal design,’ signifies a group of closely related concepts that have been pivotal in discussions on making design accessible to all users. This cluster’s central placement within the figure suggests its foundational role in DDE. Adjacent to this, in a lighter shade of orange, is the ‘#1 user-centered design’ cluster, indicating a slightly different but related set of terms emphasizing the importance of designing with the end-user’s needs and experiences in mind. The ‘#2 assistive technology’ cluster, shown in yellow, groups terms around technologies designed to aid individuals with disabilities, signifying its specialized yet crucial role in promoting digital equity. Notably, the #3 digital health cluster in green and the #4 mobile phone cluster in turquoise highlight the intersection of digital technology with health and mobile communication, illustrating the field’s expansion into these dynamic research areas. The ‘#6 participatory design’ cluster in purple and ‘#7 independent living’ cluster in pink emphasize collaboration in design processes and the empowerment of individuals to live independently, respectively.

figure 8

Keyword clustering analysis map for DDE research.

In addition, the timeline function in CiteSpace was used to present the seven clusters in Fig. 8 and the core keywords they contain (the threshold for Label was set to 6) annually, as shown in Fig. 9 . The timeline graph delves deeper into the clusters’ developmental stages and interconnections of keywords. In the #0 universal design cluster, the term ‘universal design’ dates back to 1997, alongside ‘assistive technology,’ ‘user participation,’ and ‘PWDs,’ which together marked the inception phase of DDE research within the universal design cluster, where the focus was on creating accessible environments and products for the broadest possible audience. With the advancement of digital technologies, terms like ‘artificial intelligence’ in 2015, ‘digital accessibility’ in 2018, and the more recent ‘students with disabilities’ have emerged as new topics within this cluster. Along with #0 universal design, the #6 participatory design cluster has a similarly lengthy history, with terms like ‘computer access’ and ‘design process’ highlighting the significance of digital design within this cluster. Moreover, within this timeline network, many terms are attributed to specific populations, such as ‘PWDs,’ ‘children,’ ‘aging users,’ ‘adults,’ ‘students,’ ‘blind people,’ ‘stroke patients,’ ‘family caregivers,’ ‘persons with mild cognitive impairments,’ ‘active aging,’ and ‘students with disabilities,’ revealing the user groups that DDE research needs to pay special attention to, mainly the recent focus on ‘mild cognitive impairments’ and ‘students with disabilities,’ which reflect emerging issues. Then, the particularly dense links in the graph hint at the correlations between keywords; for instance, ‘children’ and ‘affective computing’ within the #6 participatory design cluster are strongly related, and the latest terms ‘education’ and ‘autism spectrum disorder occupational therapy’ are strongly related, revealing specific issues within the important topic of education in DDE research. Other nodes with dense links include ‘digital divide,’ ‘user acceptance,’ ‘social participation,’ ‘interventions,’ ‘social inclusion,’ and ‘design for independence,’ reflecting the issues that have received scholarly attention in social sciences. Finally, on the digital technology front, ‘smart home’ emerged in 2006, followed by the terms ‘digital divide’ and ‘user interface’ in the same year. The emergence of ‘VR’ in 2014, ‘AR’ in 2016, and ‘wearable computing’ in 2017 also explain the digital technology focal points worth attention in DDE research.

figure 9

Timeline plot of 8 clusters of DDE keywords.

Dual-map overlays analysis of publications clusters

The double map overlay functionality of CiteSpace has been utilized to present a panoramic visualization of the knowledge base in DDE research (Fig. 10 ). This technique maps the citation dynamics between clusters of cited and cited publications, revealing the field’s interdisciplinary nature and scholarly communication. The left side of the figure depicts clusters of citing publications, showcasing newer disciplinary domains within DDE research. In contrast, the right side represents clusters of cited publications, reflecting the research foundations of DDE studies. Different colored dots within each cluster indicate the distribution of publications in that cluster. Notably, the arcs spanning the visualization illustrate the citation relationships between publications, with the thickness of the arcs corresponding to the citation volume. These citation trajectories from citing to cited clusters demonstrate the knowledge transfer and intellectual lineage of current DDE research within and across disciplinary boundaries. Notably, the Z-score algorithm converged on those arcs with stronger associations, yielding thicker arcs in green and blue. This indicates that the foundation of DDE research stems from two main disciplinary areas, namely ‘5.

figure 10

The left side represents citing publication clusters and the right side represents cited publication clusters.

Health, nursing, medicine’ and ‘7. psychology, education, and social on the right side of the figure. Publications from ‘2. MEDICINE, MEDICAL, CLINICAL’ and ‘10. ECONOMICS, ECONOMIC POLITICAL,’ and ‘6. On the left side, PSYCHOLOGY, EDUCATION, and health cite these two disciplinary areas extensively. In other words, the knowledge frontier of DDE research is concentrated in medicine and psychology, and their knowledge bases are also in the domains of health and psychology. However, there is a bidirectional cross-disciplinary citation relationship between the two areas—additionally, the red arcs from the ‘1. MATHEMATICS, SYSTEMS, MATHEMATICAL’ publications cluster showcase another facet of the knowledge frontier in DDE research, as they cite multiple clusters on the right side, forming a divergent structure, which confirms that some of the frontiers of MATHEMATICS in DDE research are based on a broader range of disciplines. The different network structures macroscopically reveal the overall developmental pattern of DDE research.

Hotspots and emerging trends

To answer RQ3, based on the research findings, the literature was re-engaged to reveal the research hotspots and emerging trends of DDE. These hotspots and trends are primarily concentrated in the following areas:

Embracing co-design and practical implementation in inclusive and universal design research

Research in inclusive and universal design increasingly emphasizes co-design with stakeholders, reflecting significant growth in publication (Table 4 on Co-design). In the digital context, transitioning from theory to practice in equity-centered design calls for enhanced adaptability and feasibility of traditional design theories. This shift requires a pragmatic and progressive approach, aligning with recent research (Zhang et al., 2023 ). Furthermore, the evidence-based practices in DDE (Cluster #6) are integral to this dimension, guiding the pragmatic application of design theories.

Focusing on digital mental health and urban-rural inequalities

In DDE, critical issues like the digital divide and mental health are central concerns. The focus on digital and mobile health, highlighted in Fig. 9 , shows a shift towards using technology to improve user engagement and address health challenges. As highlighted by Cosco (Cosco et al., 2021 ), mental health has emerged as a crucial focus in DDE, underscoring the need for designs that support psychological well-being. Additionally, ageism (Mannheim et al., 2023 ) and stereotypes (Nicosia et al., 2022 ) influence technology design in DDE, pointing to societal challenges that need addressing for more inclusive digital solutions. Patten’s (Patten et al., 2022 ) focus on smoking cessation in rural communities indicates a growing emphasis on reducing health disparities, ensuring that digital health advancements are inclusive and far-reaching. These trends in DDE highlight the importance of a holistic approach that considers technological, societal, and health-related factors.

Integration of empathetic, contextualized, and non-visual digital technologies

In the realm of DDE, the technology dimension showcases a range of emerging trends and research hotspots characterized by advancements in immersive technologies, assistive devices, and interactive systems. Technologies like VR (Bortkiewicz et al., 2023 ) and AR (Creed et al., 2023 ) are revolutionizing user experiences, offering enhanced empathy and engagement while raising new challenges. The growth in mobile phone usage (Cluster #4) and the development of 3D-printed individualized assistive devices (IADs) (Lamontagne et al., 2023 ) reflect an increasing emphasis on personalization and catering to diverse user needs. Tangible interfaces (Aguiar et al., 2023 ) and haptic recognition systems (Lu et al., 2023 ) make digital interactions more intuitive. The integration of cognitive assistive technology (Roberts et al., 2023 ) and brain-computer interfaces (BCI) (Padfield et al., 2023 ) is opening new avenues for user interaction, particularly for those with cognitive or physical limitations. The exploration of Social Assistive Robots (SAR) (Kaplan et al., 2024 ) and the application of IoT (Almukadi, 2023 ) illustrate a move towards socially aware and interconnected digital ecosystems, while voice recognition technologies (Berner & Alves, 2023 ) are enhancing accessibility. Edge computing (Walczak et al., 2023 ) represents a shift towards decentralized and user-oriented solutions.

For intergenerational relationships, students with disabilities and the visually impaired

The concurrent digitization trends and rapid global aging closely resemble the growth curve of DDE publications, as shown in Fig. 2 . The concept of active aging, championed by WHO (World Health Organization 2002 ), exerts a substantial impact. This effect is evident across multiple indicators, including a significant number of DDE papers published in the journal GERONTOLOGIST (109 articles), the prominent node of “elderly people” in keyword co-occurrence, and the notable mention of “elderly people” in keyword analysis (strength=3.62). Moreover, in 2011, China, the country with the largest elderly population globally, contributed 73 articles related to DDE (Table 2 ), further emphasizing the growing demand for future DDE research focusing on the elderly. Within DDE studies on the elderly, intergenerational relationships (Li & Cao, 2023 ) represent an emerging area of research. Additionally, two other emerging trends are centered on the educational and visually impaired populations. The term ‘students with disabilities’ in Fig. 9 illustrates this trend. This is reflected in the focus on inclusive digital education (Lazou & Tsinakos, 2023 ) and the digital health needs of the visually impaired (Yeong et al., 2021 ), highlighting the expanding scope of user-centric DDE research.

The intellectual structure of DDE

Previous studies have dissected DDE through various disciplinary lenses, often yielding isolated empirical findings. However, a comprehensive synthesis that contemplates the intricate interplay among DDE constructs has yet to be conspicuously absent. To fill this gap and answer RQ4, an intellectual structure that encapsulates the entirety of DDE was developed, amalgamating user demographics, design strategies, interdisciplinary approaches, and the overarching societal implications. This holistic structure, depicted in Fig. 11 , The DDE structure elucidates the multi-faceted approach required to achieve digital equity, integrating diverse user needs with tailored design strategies and bridging technological innovation with interdisciplinary methodologies. Its core function is to guide the creation of inclusive digital environments that are accessible, engaging, and responsive to the varied demands of a broad user spectrum.

figure 11

Design for Digital Equity (DDE) intellectual structure.

At the core of discussions surrounding digital equity lies the extensively examined and articulated issue of the digital divide, a well-documented challenge that scholars have explored (Gallegos-Rejas et al., 2023 ). This is illustrated in the concentric circles of the red core within the keyword contribution analysis, as depicted in Fig. 6 . It reflects the persistent digital access and literacy gaps that disproportionately affect marginalized groups. This divide extends beyond mere connectivity to encompass the nuances of social engagement (Almukadi, 2023 ), where the ability to participate meaningfully in digital spaces becomes a marker of societal inclusion. As noted by (Bochicchio et al., 2023 ; Jetha et al., 2023 ), employment is a domain where digital inequities manifest, creating barriers to employment inclusion. Similarly, feelings of loneliness, social isolation (Chung et al., 2023 ), and deficits in social skills (Estival et al., 2023 ) are exacerbated in the digital realm, where interactions often require different competencies. These social dimensions of DDE underscore the need for a more empathetic and user-informed approach to technology design, one that can cater to the nuanced needs of diverse populations, including medication reminders and telehealth solutions (Gallegos-Rejas et al., 2023 ) while minimizing cognitive load (Gomez-Hernandez et al., 2023 ) and advancing digital health equity (Ha et al., 2023 ).

The critical element of the DDE intellectual structure is the design strategy, as evidenced by the two categories #0 generic design and #6 participatory design, which contain the most prominent nodes in the keyword clustering in Part IV of this paper. Digital transformation through design thinking (Oliveira et al., 2024 ), user-centered design (Stawarz et al., 2023 ), and the co-design of 3D printed assistive technologies (Aflatoony et al., 2023 ; Benz et al., 2023 ; Ghorayeb et al., 2023 ) reflect the trend towards personalized and participatory design processes. Empathy emerges as a recurrent theme, both in contextualizing user experiences (Bortkiewicz et al., 2023 ) and in visualizing personal narratives (Gui et al., 2023 ), reinforcing the need for emotional durability (Huang et al., 2023 ) and accessible design (Jonsson et al., 2023 ). These approaches are not merely theoretical but are grounded in the pragmatics of participatory design (Kinnula et al., 2023 ), the living labs approach (Layton et al., 2023 ), and virtual collaborative design workshops (Peters et al., 2023 ), all of which facilitate the co-creation of solutions that resonate with the lived experiences of users.

One of the significant distinctions between DDE and traditional fairness-centered design lies in technical specifications. Supporting these strategies are fundamental theories and standards such as the Web Content Accessibility Guidelines (WCAG) (Jonsson et al., 2023 ), the Technology Acceptance Model (TAM) (Alvarez-Melgarejo et al., 2023 ), and socio-technical systems (STS) (Govers & van Amelsvoort, 2023 ), which provide the ethical and methodological framework for DDE initiatives. Additionally, digital ethnography (Joshi et al., 2023 ) and the Person-Environment-Tool (PET) framework (Jarl, Lundqvist 2020 ) offer valuable perspectives to analyze and design for the intricate interplay of human, technological, and environmental interactions.

Another noteworthy discovery highlighted by the previously mentioned findings is the rich interdisciplinary approach within the field of DDE. This interdisciplinary nature, exemplified by the integration of diverse knowledge domains, is evident in publications analysis of DDE (Table 4 ) and is visually demonstrated through the overlay of disciplinary citation networks (Fig. 10 ). Strategies such as gamification (Aguiar et al., 2023 ), music therapy (Chen & Norgaard, 2023 ), and multimodal communication strategies (Given et al., 2023 ) underline the synergistic potential of integrating diverse knowledge domains to foster more inclusive digital environments. Cognitive Behavioral Therapy (Kayser et al., 2023 ), multimedia advocacy (Watts et al., 2023 ), arts-based methods (Miller & Zelenko, 2022 ), storytelling (Ostrowski et al., 2021 ), and reminiscence therapy (Unbehaun et al., 2021 ) are not merely adjuncts but integral components that enhance the relevance and efficacy of DDE interventions.

Equally important, the relationship between the target users of DDE and digital technologies needs to be focused on as a design strategy. This includes attitudes, needs, challenges, risks, and capacity indicators. Positive outlooks envision digital transformation as a new norm post-pandemic for individuals with disabilities (Aydemir-Döke et al., 2023 ), while others display varied sentiments (Bally et al., 2023 ) or even hostile attitudes, as seen in the challenges of visually impaired with online shopping (Cohen et al., 2023 ). These attitudes interplay with ‘Needs’ that span essential areas, from service to recreational, highlighting the importance of ‘Capacity Indicators’ like digital literacy and digital thinking (Govers & van Amelsvoort, 2023 ) to bridge these gaps. The ‘Challenges and Risks’ associated with DDE, such as the adverse impacts of apps in medical contexts (Babbage et al., 2023 ) and ergonomic issues due to immersive technologies (Creed et al., 2023 ), present barriers that need to be mitigated to foster a conducive environment for digital engagement. Despite a generally positive attitude toward digital transformation, the low usage rates (Dale et al., 2023 ), usability concerns (Davoody et al., 2023 ), cultural differences in thinking, and the need for a humanizing digital transformation (Dragicevic et al., 2023b ) underscore the complexity of achieving digital equity. The widespread resistance and abandonment of rehabilitative technologies (Mitchell et al., 2023 ) further emphasize the need for DDE strategies that are culturally sensitive and user-friendly.

Going deeper, the arrows signify dynamic interrelationships among various components within the DDE intellectual structure. “Needs” drive the design and application of “Digital Technologies,” which in turn inspire “Innovative” solutions and approaches. Feedback from these innovations influences “Attitudes,” which, along with “Needs,” can pose “Challenges and Risks,” thereby shaping the “Capacity Indicators” that gauge proficiency in navigating the digital landscape. This cyclical interplay ensures that the DDE framework is not static but an evolving guide responsive to the changing landscape of digital equity.

future research direction

In the process of identifying research gaps and future directions, innovative research opportunities were determined from the results of temporal attributes in the visual, intellectual graph:

Emotional, cultural, and aesthetic factors in human-centered design: Universal Design (UD) and Design for All (DFA) will remain central themes in DDE. However, affective computing and user preferences must be explored (Alves et al., 2020 ). Beyond functional needs, experiential demands such as aesthetics, self-expression, and creativity, often overlooked in accessibility guidelines, are gaining recognition (Recupero et al., 2021 ). The concept of inclusive fashion (Oliveira & Okimoto, 2022 ) underscores the need to address multi-faceted user requirements, including fashion needs, cultural sensitivity, and diversity.

Digital technology adoption and improving digital literacy: The adoption of multimodal and multisensory interactions is gaining increased attention, with a growing focus on voice, tangible, and natural interaction technologies, alongside research into technology acceptance, aligning with the findings (Li et al., 2023 ). Exploring these interactive methods is crucial for enhancing user engagement and experience. However, there is a notable gap in research on the acceptance of many cutting-edge digital technologies. Additionally, investigating how design strategies can enhance digital literacy represents a valuable study area.

Expanding the Geographic and Cultural Scope: Literature indicates that the situation of DDE in developing countries (Abbas et al., 2014 ; Nahar et al., 2015 ) warrants in-depth exploration. Current literature and the distribution of research institutions show a significant gap in DDE research in these regions, especially in rural areas (as seen in Tables 2 and 3 and Figs. 3 and 4 ). Most research and literature is concentrated in developed countries, with insufficient focus on developing nations. Conversely, within developed countries, research on DDE concerning minority groups (Pham et al., 2022 ) and affluent Indigenous populations (Henson et al., 2023 ) is almost nonexistent. This situation reveals a critical research gap: even in economically advanced nations, the needs and preferences of marginalized groups are often overlooked. These groups may face unique challenges and needs, which should be explored or understood in mainstream research.

Multi-disciplinary Research in Digital Equity Design: While publication analysis (Table 4 ) and knowledge domain flow (Fig. 10 ) reveal the interdisciplinary nature of DDE, the current body of research predominantly focuses on computer science, medical and health sciences, sociology, and design. This review underscores the necessity of expanding research efforts across a broader spectrum of disciplines to address the diverse needs inherent in DDE adequately. For instance, the fusion of art, psychology, and computer technology could lead to research topics such as “Digital Equity Design Guidelines for Remote Art Therapy.” Similarly, the amalgamation of education, computer science, design, and management studies might explore subjects like “Integrating XR in Inclusive Educational Service Design: Technological Acceptance among Special Needs Students.” These potential research areas not only extend the scope of DDE but also emphasize the importance of a holistic and multi-faceted approach to developing inclusive and accessible digital solutions.

Practical implication

This study conducted an in-depth bibliometric and visualization analysis of the Digital Equity Design (DDE) field, revealing key findings on publication trends, significant contributors and collaboration patterns, key clusters, research hotspots, and intellectual structures. These insights directly affect policy-making, interdisciplinary collaboration, design optimization, and educational resource allocation. Analysis of publication trends provides policymakers with data to support digital inclusivity policies, particularly in education and health services, ensuring fair access to new technologies for all social groups, especially marginalized ones. The analysis of significant contributors and collaboration patterns highlights the role of interdisciplinary cooperation in developing innovative solutions, which is crucial for organizations and businesses designing products for specific groups, such as the disabled and elderly, in promoting active aging policies. Identifying key clusters and research hotspots guides the focus of future technological developments, enhancing the social adaptability and market competitiveness of designs. The construction of intellectual structures showcases the critical dimensions of user experience within DDE and the internal logic between various elements, providing a foundation for promoting deeper user involvement and more precise responses to needs in design research and practice, particularly in developing solutions and assessing their effectiveness to ensure that design outcomes truly reflect and meet end-user expectations and actual use scenarios.

Limitations

Nevertheless, this systematic review is subject to certain limitations. Firstly, the data sourced exclusively from the WOS is a constraint, as specific functionalities like dual-map overlays are uniquely tailored for WOS bibliometric data. Future studies could expand the scope by exploring DDE research in databases such as Scopus, Google Scholar, and grey literature. Additionally, while a comprehensive search string for DDE was employed, the results were influenced by the search timing and the subscription range of different research institutions to the database. Moreover, the possibility of relevant terms existing beyond the search string cannot be discounted. Secondly, despite adhering to the PRISMA guidelines for literature acquisition and screening, subjectivity may have influenced the authors during the inclusion and exclusion process, particularly while reviewing abstracts and full texts to select publications. Furthermore, the reliance solely on CiteSpace as the bibliometric tool introduces another limitation. The research findings are contingent on the features and algorithms of the current version of CiteSpace (6.2.r6 advanced). Future research could incorporate additional or newer versions of bibliometric tools to provide a more comprehensive analysis.

This systematic review aims to delineate the academic landscape of DDE by exploring its known and unknown aspects, including research progress, intellectual structure, research hotspots and trends, and future research recommendations. Before this review, these facets could have been clearer. To address these questions, a structured retrieval strategy set by PICo and a PRISMA process yielded 1705 publications, which were analyzed using CiteSpace for publication trends, geographic distribution of research collaborations, core publications, keyword co-occurrence, emergence, clustering, timelines, and dual-map overlays of publication disciplines. These visual presentations propose a DDE intellectual structure, although the literature data is focused on the WOS database. This framework could serve as a guide for future research to address these crucial issues. The DDE intellectual structure integrates research literature, particularly eight thematic clusters. It not only displays the overall intellectual structure of DDE on a macro level but also reveals the intrinsic logic between various elements. Most notably, as pointed out at the beginning of this review, digital equity, as a critical factor in achieving sustainable development goals, requires human-centered design thinking. An in-depth discussion of the research findings reveals that the development of DDE is characterized by a multi-dimensional approach, encompassing a wide range of societal, technological, and user-specific issues. Furthermore, emerging trends indicate that the future trajectory of DDE will be more diverse and inclusive, targeting a broad spectrum of user needs and societal challenges. Another significant aspect of this review is the proposition of four specific directions for future research, guiding researchers dedicated to related disciplines.

Data availability

The datasets generated or analyzed during the current study are available in the Dataverse repository: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/S5XXFB .

Abbas A, Hussain M, Iqbal M, Arshad S, Rasool S, Shafiq M, Ali W, Yaqub N (2014) Barriers and reforms for promoting ICTs in rural areas of Pakistan. In: Marcus A (ed), pp 391–399

Aflatoony L, Lee SJ, Sanford J (2023) Collective making: Co-designing 3D printed assistive technologies with occupational therapists, designers, and end-users. Assist Technol 35:153–162. https://doi.org/10.1080/10400435.2021.1983070

Article   PubMed   Google Scholar  

Aguiar LR, Rodríguez FJ, Aguilar JR, Plascencia VN, Mendoza LM, Valdez JR, Pech JR, am Leon, Ortiz LE (2023) Implementing gamification for blind and autistic people with tangible interfaces, extended reality, and universal design for learning: two case studies. Appl. Sci.-Basel 13. https://doi.org/10.3390/app13053159

Ahmad I, Ahmed G, Shah SAA, Ahmed E (2020) A decade of big data literature: analysis of trends in light of bibliometrics. J Supercomput 76:3555–3571. https://doi.org/10.1007/s11227-018-2714-x

Article   Google Scholar  

Almukadi W (2023) Smart scarf: An IOT-based solution for emotion recognition. Eng Technol Appl Sci Res 13:10870–10874. https://doi.org/10.48084/etasr.5952

Alvarez-Melgarejo M, Pedraza-Avella AC, Torres-Barreto ML (2023) Acceptance assessment of the software MOTIVATIC WEB by university educators. Int J Learn Technol 18:344–363. https://doi.org/10.1504/IJLT.2023.134585

Alves T, Natálio J, Henriques-Calado J, Gama S (2020) Incorporating personality in user interface design: A review. Personality and Individual Differences 155. https://doi.org/10.1016/j.paid.2019.109709

Aydemir-Döke D, Owenz M, Spencer B (2023) Being a disabled woman in a global pandemic: A focus group study in the United States and policy recommendations. Disability & Society. https://doi.org/10.1080/09687599.2023.2225207

Babbage, Drown J, van Solkema M, Armstrong J, Levack W, Kayes N (2023) Inpatient trial of a tablet app for communicating brain injury rehabilitation goals. Disabil. Rehabil.-Assist. Technol. https://doi.org/10.1080/17483107.2023.2167009

Bally EL, Cheng DM, van Grieken A, Sanz MF, Zanutto O, Carroll A, Darley A, Roozenbeek B, Dippel DW, Raat H (2023) Patients’ Perspectives Regarding Digital Health Technology to Support Self-management and Improve Integrated Stroke Care: Qualitative Interview Study. J Med Internet Res 25. https://doi.org/10.2196/42556

Bazzano AN, Noel L-A, Patel T, Dominique CC, Haywood C, Moore S, Mantsios A, Davis PA (2023) Improving the engagement of underrepresented people in health research through equity-centered design thinking: qualitative study and process evaluation for the development of the grounding health research in design toolkit. JMIR Form Res 7:e43101. https://doi.org/10.2196/43101

Article   PubMed   PubMed Central   Google Scholar  

Bendixen K, Benktzon M (2015) Design for all in Scandinavia – A strong concept. Appl Erg 46:248–257. https://doi.org/10.1016/j.apergo.2013.03.004

Benz C, Scott-Jeffs W, Revitt J, Brabon C, Fermanis C, Hawkes M, Keane C, Dyke R, Cooper S, Locantro M, Welsh M, Norman R, Hendrie D, Robinson S (2023) Co-designing a telepractice journey map with disability customers and clinicians: Partnering with users to understand challenges from their perspective. Health Expect. https://doi.org/10.1111/hex.13919

Berner K, Alves (2023) A scoping review of the literature using speech recognition technologies by individuals with disabilities in multiple contexts. Disabil Rehabil -Assist Technol 18:1139–1145. https://doi.org/10.1080/17483107.2021.1986583

Bochicchio V, Lopez A, Hase A, Albrecht J, Costa B, Deville A, Hensbergen R, Sirfouq J, Mezzalira S (2023) The psychological empowerment of adaptive competencies in individuals with Intellectual Disability: Literature-based rationale and guidelines for best training practices. Life Span Disabil 26:129–157. https://doi.org/10.57643/lsadj.2023.26.1_06

Bortkiewicz A, Józwiak Z, Laska-Lesniewicz A (2023) Ageing and its consequences - the use of virtual reality (vr) as a tool to visualize the problems of elderly. Med Pr 74:159–170. https://doi.org/10.13075/mp.5893.01406

Broadus RN (1987) Toward a definition of “bibliometrics. Scientometrics 12:373–379. https://doi.org/10.1007/BF02016680

Chen C (2006) CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature. J Am Soc Inf Sci 57:359–377. https://doi.org/10.1002/asi.20317

Chen C (2018) Eugene Garfield’s scholarly impact: a scientometric review. Scientometrics 114:489–516. https://doi.org/10.1007/s11192-017-2594-5

Chen C, Hu Z, Liu S, Tseng H (2012) Emerging trends in regenerative medicine: a scientometric analysis in CiteSpace. Expert Opin Biol Ther 12:593–608. https://doi.org/10.1517/14712598.2012.674507

Article   CAS   PubMed   Google Scholar  

Chen YA, Norgaard M (2023) Important findings of a technology-assisted in-home music-based intervention for individuals with stroke: a small feasibility study. Disabil. Rehabil.-Assist. Technol. https://doi.org/10.1080/17483107.2023.2274397

Chung JE, Gendron T, Winship J, Wood RE, Mansion N, Parsons P, Demiris G (2023) Smart Speaker and ICT Use in Relationship With Social Connectedness During the Pandemic: Loneliness and Social Isolation Found in Older Adults in Low-Income Housing. Gerontologist. https://doi.org/10.1093/geront/gnad145

Clarivate (2023) Web of Science Core Collection - Clarivate. https://clarivate.com/products/scientific-and-academic-research/research-discovery-and-workflow-solutions/webofscience-platform/web-of-science-core-collection/ . Accessed December 14, 2023

Cohen AH, Fresneda JE, Anderson RE (2023) How inaccessible retail websites affect blind and low vision consumers: their perceptions and responses. J Serv Theory Pract 33:329–351. https://doi.org/10.1108/JSTP-08-2021-0167

Cooper C, Booth A, Varley-Campbell J, Britten N, Garside R (2018) Defining the process to literature searching in systematic reviews: a literature review of guidance and supporting studies. BMC Med Res Methodol 18:85. https://doi.org/10.1186/s12874-018-0545-3

Cooper BA, Cohen U, Hasselkus BR (1991) Barrier-free design: a review and critique of the occupational therapy perspective. Am J Occup Ther 45:344–350. https://doi.org/10.5014/ajot.45.4.344

Cosco TD, Fortuna K, Wister A, Riadi I, Wagner K, Sixsmith A (2021) COVID-19, Social Isolation, and Mental Health Among Older Adults: A Digital Catch-22. J Med Internet Res 23. https://doi.org/10.2196/21864

Creed C, Al-Kalbani M, Theil A, Sarcar S, Williams I (2023) Inclusive AR/VR: accessibility barriers for immersive technologies. Univ Access Inf Soc. https://doi.org/10.1007/s10209-023-00969-0

Dale J, Nanton V, Day T, Apenteng P, Bernstein CJ, Smith GG, Strong P, Procter R (2023) Uptake and use of care companion, a web-based information resource for supporting informal carers of older people: mixed methods study. JMIR Aging 6. https://doi.org/10.2196/41185

Davoody N, Eghdam A, Koch S, Hägglund M (2023) Evaluation of an electronic care and rehabilitation planning tool with stroke survivors with Aphasia: Usability study. JMIR Human Factors 10. https://doi.org/10.2196/43861

Dragicevic N, Vladova G, Ullrich A (2023a) Design thinking capabilities in the digital world: A bibliometric analysis of emerging trends. Front Educ 7. https://doi.org/10.3389/feduc.2022.1012478

Dragicevic N, Hernaus T, Lee RW (2023b) Service innovation in Hong Kong organizations: Enablers and challenges to design thinking practices. Creat Innov Manag 32:198–214. https://doi.org/10.1111/caim.12555

Estival S, Demulier V, Renaud J, Martin JC (2023) Training work-related social skills in adults with Autism Spectrum Disorder using a tablet-based intervention. Human-Comput Interact. https://doi.org/10.1080/07370024.2023.2242344

Firestone AR, Cruz RA, Massey D (2023) Developing an equity-centered practice: teacher study groups in the preservice context. J Teach Educ 74:343–358. https://doi.org/10.1177/00224871231180536

Gallegos-Rejas VM, Thomas EE, Kelly JT, Smith AC (2023) A multi-stakeholder approach is needed to reduce the digital divide and encourage equitable access to telehealth. J Telemed Telecare 29:73–78. https://doi.org/10.1177/1357633X221107995

Garfield E (2009) From the science of science to Scientometrics visualizing the history of science with HistCite software. J Informetr 3:173–179. https://doi.org/10.1016/j.joi.2009.03.009

Ghorayeb A, Comber R, Gooberman-Hill R (2023) Development of a smart home interface with older adults: multi-method co-design study. JMIR Aging 6. https://doi.org/10.2196/44439

Given F, Allan M, Mccarthy S, Hemsley B (2023) Digital health autonomy for people with communication or swallowing disability and the sustainable development goal 10 of reducing inequalities and goal 3 of good health and well-being. Int J Speech-Lang Pathol 25:72–76. https://doi.org/10.1080/17549507.2022.2092212

Gomez-Hernandez M, Ferre X, Moral C, Villalba-Mora E (2023) Design guidelines of mobile apps for older adults: systematic review and thematic analysis. JMIR Mhealth and Uhealth 11. https://doi.org/10.2196/43186

Govers M, van Amelsvoort P (2023) A theoretical essay on socio-technical systems design thinking in the era of digital transformation. Gio-Gr -Interakt -Organ -Z Fuer Angew Org Psychol 54:27–40. https://doi.org/10.1007/s11612-023-00675-8

Grybauskas A, Stefanini A, Ghobakhloo M (2022) Social sustainability in the age of digitalization: A systematic literature Review on the social implications of industry 4.0. Technol Soc 70:101997. https://doi.org/10.1016/j.techsoc.2022.101997

Gui F, Yang JY, Wu QL, Liu Y, Zhou J, An N (2023) Enhancing caregiver empowerment through the story mosaic system: human-centered design approach for visualizing older adult life stories. JMIR Aging 6. https://doi.org/10.2196/50037

Ha S, Ho SH, Bae YH, Lee M, Kim JH, Lee J (2023) Digital health equity and tailored health care service for people with disability: user-centered design and usability study. J Med Internet Res 25. https://doi.org/10.2196/50029

Henson C, Chapman F, Cert G, Shepherd G, Carlson B, Rambaldini B, Gwynne K (2023) How older indigenous women living in high-income countries use digital health technology: systematic review. J Med Internet Res 25. https://doi.org/10.2196/41984

Huang XY, Kettley S, Lycouris S, Yao Y (2023) Autobiographical design for emotional durability through digital transformable fashion and textiles. Sustainability 15. https://doi.org/10.3390/su15054451

Ismail II, Saqr M (2022) A quantitative synthesis of eight decades of global multiple sclerosis research using bibliometrics. Front Neurol 13:845539. https://doi.org/10.3389/fneur.2022.845539

Jarl G, Lundqvist LO (2020) An alternative perspective on assistive technology: The person-environment-tool (PET) model. Assist Technol 32:47–53. https://doi.org/10.1080/10400435.2018.1467514

Jetha A, Bonaccio S, Shamaee A, Banks CG, Bültmann U, Smith PM, Tompa E, Tucker LB, Norman C, Gignac MA (2023) Divided in a digital economy: Understanding disability employment inequities stemming from the application of advanced workplace technologies. SSM-Qual Res Health 3. https://doi.org/10.1016/j.ssmqr.2023.100293

John Clarkson P, Coleman R (2015) History of inclusive design in the UK. Appl Erg 46(Pt B):235–247. https://doi.org/10.1016/j.apergo.2013.03.002

Jonsson M, Johansson S, Hussain D, Gulliksen J, Gustavsson C (2023) Development and evaluation of ehealth services regarding accessibility: scoping literature review. J Med Internet Res 25. https://doi.org/10.2196/45118

Joshi D, Panagiotou A, Bisht M, Udalagama U, Schindler A (2023) Digital Ethnography? Our experiences in the use of sensemaker for understanding gendered climate vulnerabilities amongst marginalized Agrarian communities. Sustainability 15. https://doi.org/10.3390/su15097196

Kaplan A, Barkan-Slater S, Zlotnik Y, Levy-Tzedek S (2024) Robotic technology for Parkinson’s disease: Needs, attitudes, and concerns of individuals with Parkinson’s disease and their family members. A focus group study. Int J Human-Comput Stud 181. https://doi.org/10.1016/j.ijhcs.2023.103148

Kastrin A, Hristovski D (2021) Scientometric analysis and knowledge mapping of literature-based discovery (1986–2020). Scientometrics 126:1415–1451. https://doi.org/10.1007/s11192-020-03811-z

Article   CAS   Google Scholar  

Kayser J, Wang X, Wu ZK, Dimoji A, Xiang XL (2023) Layperson-facilitated internet-delivered cognitive behavioral therapy for homebound older adults with depression: protocol for a randomized controlled trial. JMIR Res Protocols 12. https://doi.org/10.2196/44210

King J, Gonzales AL (2023) The influence of digital divide frames on legislative passage and partisan sponsorship: A content analysis of digital equity legislation in the US from 1990 to 2020. Telecommun Policy 47:102573. https://doi.org/10.1016/j.telpol.2023.102573

Kinnula M, Iivari N, Kuure L, Molin-Juustila T (2023) Educational Participatory Design in the Crossroads of Histories and Practices - Aiming for digital transformation in language pedagogy. Comput Support Coop Work- J Collab Comput Work Pract. https://doi.org/10.1007/s10606-023-09473-8

Lamontagne ME, Pellichero A, Tostain V, Routhier F, Flamand V, Campeau-Lecours A, Gherardini F, Thébaud M, Coignard P, Allègre W (2023) The REHAB-LAB model for individualized assistive device co-creation and production. Assist Technol. https://doi.org/10.1080/10400435.2023.2229880

Lawson McLean A, Lawson McLean AC (2023) Exploring the digital divide: Implications for teleoncology implementation. Patient Educ Couns 115:107939. https://doi.org/10.1016/j.pec.2023.107939

Layton N, Harper K, Martinez K, Berrick N, Naseri C (2023) Co-creating an assistive technology peer-support community: learnings from AT Chat. Disabil Rehabil -Assist Technol 18:603–609. https://doi.org/10.1080/17483107.2021.1897694

Lazou C, Tsinakos A (2023) Critical Immersive-triggered literacy as a key component for inclusive digital education. Educ Sci 13. https://doi.org/10.3390/educsci13070696

Li G, Li D, Tang T (2023) Bibliometric review of design for digital inclusion. Sustainability 15. https://doi.org/10.3390/su151410962

Li C, Cao M (2023) Designing for intergenerational communication among older adults: A systematic inquiry in old residential communities of China’s Yangtze River Delta. Systems 11. https://doi.org/10.3390/systems11110528

Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 6:e1000100. https://doi.org/10.1371/journal.pmed.1000100

Lu JY, Liu Y, Lv TX, Meng L (2023) An emotional-aware mobile terminal accessibility-assisted recommendation system for the elderly based on haptic recognition. International J Hum–Comput Interact. https://doi.org/10.1080/10447318.2023.2266793

Mace R (1985) Universal design: barrier-free environments for everyone. Design West 33:147–152

Google Scholar  

Mannheim I, Wouters EJ, Köttl H, van Boekel LC, Brankaert R, van Zaalen Y (2023) Ageism in the discourse and practice of designing digital technology for older persons: a scoping review. Gerontologist 63:1188–1200. https://doi.org/10.1093/geront/gnac144

Miller E, Zelenko O (2022) The Caregiving Journey: Arts-based methods as tools for participatory co-design of health technologies. Social Sci-Basel 11. https://doi.org/10.3390/socsci11090396

Mitchell J, Shirota C, Clanchy K (2023) Factors that influence the adoption of rehabilitation technologies: a multi-disciplinary qualitative exploration. J NeuroEng Rehabil 20. https://doi.org/10.1186/s12984-023-01194-9

Moher D, Liberati A, Tetzlaff J, Altman DG (2010) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg 8:336–341. https://doi.org/10.1016/j.ijsu.2010.02.007

Nahar L, Jaafar A, Ahamed E, Kaish A (2015) Design of a Braille learning application for visually impaired students in Bangladesh. Assist Technol 27:172–182. https://doi.org/10.1080/10400435.2015.1011758

Nicosia J, Aschenbrenner AJ, Adams SL, Tahan M, Stout SH, Wilks H, Balls-Berry JE, Morris JC, Hassenstab J (2022) Bridging the technological divide: stigmas and challenges with technology in digital brain health studies of older adults. Front Digit Health 4. https://doi.org/10.3389/fdgth.2022.880055

Nishikawa-Pacher A (2022) Research questions with PICO: A universal mnemonic. Publications 10:21. https://doi.org/10.3390/publications10030021

Oliveira M, Zancul E, Salerno MS (2024) Capability building for digital transformation through design thinking. Technol Forecast Soc Change 198. https://doi.org/10.1016/j.techfore.2023.122947

de Oliveira RD, Okimoto M (2022) Fashion-related assistive technologies for visually impaired people: a systematic review. Dobras:183–205

Oliveri ME, Nastal J, Slomp D (2020) Reflections on Equity‐Centered Design. ETS Research Report Series 2020:1–11. https://doi.org/10.1002/ets2.12307

Ostrowski AK, Harrington CN, Breazeal C, Park HW (2021). Personal narratives in technology design: the value of sharing older adults’ stories in the design of social robots. Front Robot AI 8. https://doi.org/10.3389/frobt.2021.716581

Padfield N, Anastasi AA, Camilleri T, Fabri S, Bugeja M, Camilleri K (2023). BCI-controlled wheelchairs: end-users’ perceptions, needs, and expectations, an interview-based study. Disabil. Rehabil.-Assist. Technol. https://doi.org/10.1080/17483107.2023.2211602

Park K, So H-J, Cha H (2019) Digital equity and accessible MOOCs: Accessibility evaluations of mobile MOOCs for learners with visual impairments. AJET 35:48–63. https://doi.org/10.14742/ajet.5521

Patten C, Brockman T, Kelpin S, Sinicrope P, Boehmer K, St Sauver J, Lampman M, Sharma P, Reinicke N, Huang M, McCoy R, Allen S, Pritchett J, Esterov D, Kamath C, Decker P, Petersen C, Cheville A (2022) Interventions for Increasing Digital Equity and Access (IDEA) among rural patients who smoke: Study protocol for a pragmatic randomized pilot trial. Contemp Clin Trials 119. https://doi.org/10.1016/j.cct.2022.106838

Persson H, Åhman H, Yngling AA, Gulliksen J (2015) Universal design, inclusive design, accessible design, design for all: different concepts—one goal? On the concept of accessibility—historical, methodological and philosophical aspects. Univ Access Inf Soc 14:505–526. https://doi.org/10.1007/s10209-014-0358-z

Peters D, Sadek M, Ahmadpour N (2023) Collaborative workshops at scale: a method for non-facilitated virtual collaborative design workshops. Int J Hum–Comput Interact. https://doi.org/10.1080/10447318.2023.2247589

Pham Q, El-Dassouki N, Lohani R, Jebanesan A, Young K (2022) The future of virtual care for older ethnic adults beyond the COVID-19 pandemic. J Med Internet Res 24. https://doi.org/10.2196/29876

Ping Q, He J, Chen C (2017) How many ways to use CiteSpace? A study of user interactive events over 14 months. Assoc Info Sci Tech 68:1234–1256. https://doi.org/10.1002/asi.23770

Price DDS (1963) Science since Babylon. Philos Sci 30:93–94

PRISMA (2023) Transparent reporting of systematic reviews and meta-analyses. http://www.prisma-statement.org/ . Accessed December 14, 2023

Qin Y, Wang X, Xu Z, Škare M (2021) The impact of poverty cycles on economic research: evidence from econometric analysis. Econ Res -Ekonomska Istraživanja 34:152–171. https://doi.org/10.1080/1331677X.2020.1780144

Recupero A, Marti P, Guercio S (2021) Enabling inner creativity to surface: the design of an inclusive handweaving loom to promote self-reliance, autonomy, and well-being. Behav Inf Technol 40:497–505. https://doi.org/10.1080/0144929X.2021.1909654

Roberts E, Fan GL, Chen XW (2023) In-lab development of a mobile interface for cognitive assistive technology to support instrumental activities of daily living in dementia homecare. J Aging Environ 37:127–141. https://doi.org/10.1080/26892618.2021.2001710

Rodriguez NM, Burleson G, Linnes JC, Sienko KH (2023) Thinking beyond the device: an overview of human- and equity-centered approaches for health technology design. Annu Rev Biomed Eng 25:257–280. https://doi.org/10.1146/annurev-bioeng-081922-024834

Article   CAS   PubMed   PubMed Central   Google Scholar  

Sayers A (2008) Tips and tricks in performing a systematic review–Chapter 4. Br J Gen Pr 58:136. https://doi.org/10.3399/bjgp08X277168

Singh S (2017) Bridging the gender digital divide in developing countries. J Child Media 11:245–247. https://doi.org/10.1080/17482798.2017.1305604

Stanford d.school (2016) Equity-Centered Design Framework. https://dschool.stanford.edu/resources/equity-centered-design-framework . Accessed December 14, 2023

Stawarz K, Liang IJ, Alexander L, Carlin A, Wijekoon A, Western MJ (2023) Exploring the potential of technology to promote exercise snacking for older adults who are prefrail in the home setting: user-centered design study. JMIR Aging 6. https://doi.org/10.2196/41810

Stern C, Jordan Z, McArthur A (2014) Developing the review question and inclusion criteria. Am J Nurs 114:53–56. https://doi.org/10.1097/01.NAJ.0000445689.67800.86

Unbehaun D, Taugerbeck S, Aal K, Vaziri DD, Lehmann J, Tolmie P, Wieching R, Wulf V (2021) Notes of memories: Fostering social interaction, activity and reminiscence through an interactive music exergame developed for people with dementia and their caregivers. Hum-Comput Interact 36:439–472. https://doi.org/10.1080/07370024.2020.1746910

United Nations (2021) International Day of Older Persons: Digital equity for all ages. ITU/UN tech agency

UNSD UNS (2023) — SDG Indicators. https://unstats.un.org/sdgs/report/2022/ . Accessed December 13, 2023

Van Eck NJ, Waltman L (2010) Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics 84:523–538. https://doi.org/10.1007/s11192-009-0146-3

van Leeuwen T (2006) The application of bibliometric analyses in the evaluation of social science research. Who benefits from it, and why it is still feasible. Scientometrics 66:133–154. https://doi.org/10.1007/s11192-006-0010-7

Walczak R, Koszewski K, Olszewski R, Ejsmont K, Kálmán A (2023) Acceptance of IoT Edge-computing-based sensors in smart cities for universal design purposes. Energies 16. https://doi.org/10.3390/en16031024

Wang Z, Zhou Z, Xu W, Yang D, Xu Y, Yang L, Ren J, Li Y, Huang Y (2021) Research status and development trends in the field of marine environment corrosion: a new perspective. Environ Sci Pollut Res Int 28:54403–54428. https://doi.org/10.1007/s11356-021-15974-0

Wang J, Li X, Wang P, Liu Q, Deng Z, Wang J (2022) Research trend of the unified theory of acceptance and use of technology theory: a bibliometric analysis. Sustainability 14:10. https://doi.org/10.3390/su14010010

Watts P, Kwiatkowska G, Minnion A (2023) Using multimedia technology to enhance self-advocacy of people with intellectual disabilities: Introducing a theoretical framework for ‘Multimedia Advocacy. J Appl Res Intellect Disabil 36:739–749. https://doi.org/10.1111/jar.13107

Willems J, Farley H, Campbell C (2019) The increasing significance of digital equity in higher education. AJET 35:1–8. https://doi.org/10.14742/ajet.5996

World Health Organization (2002) Active aging: A policy framework. WHO, Geneva, Switzerland

Xiao Y, Wu H, Wang G, Mei H (2021) Mapping the Worldwide Trends on Energy Poverty Research: A Bibliometric Analysis (1999–2019). Int J Environ Res Public Health 18. https://doi.org/10.3390/ijerph18041764

Yeong JL, Thomas P, Buller J, Moosajee M (2021) A newly developed web-based resource on genetic eye disorders for users with visual impairment (Gene Vis): Usability Study. J Med Internet Res 23. https://doi.org/10.2196/19151

Yuen AHK, Park JH, Chen L, Cheng M (2017) Digital equity in cultural context: exploring the influence of Confucian heritage culture on Hong Kong families. Educ Tech Res Dev 65:481–501. https://doi.org/10.1007/s11423-017-9515-4

Zhang BY, Ma MY, Wang ZS (2023) Promoting active aging through assistive product design innovation: a preference-based integrated design framework. Front Public Health 11. https://doi.org/10.3389/fpubh.2023.1203830

Download references

Acknowledgements

This research was funded by the Humanities and Social Sciences Youth Foundation, Ministry of Education of the People’s Republic of China (21YJC760101).

Author information

Authors and affiliations.

Xiamen University of Technology, Xiamen, China

Baoyi Zhang

You can also search for this author in PubMed   Google Scholar

Contributions

The author was responsible for all aspects of the work, including the conception, research, analysis, manuscript drafting, critical revision, and final approval of the version to be published. The author ensures the accuracy and integrity of the entire study.

Corresponding author

Correspondence to Baoyi Zhang .

Ethics declarations

Competing interests.

The author declares no competing interests.

Ethical approval

Ethical approval was not required as the study did not involve human participants.

Informed consent

Informed consent was not required as this study did not involve human participants.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .

Reprints and permissions

About this article

Cite this article.

Zhang, B. Research progress and intellectual structure of design for digital equity (DDE): A bibliometric analysis based on citespace. Humanit Soc Sci Commun 11 , 1019 (2024). https://doi.org/10.1057/s41599-024-03552-x

Download citation

Received : 27 December 2023

Accepted : 01 August 2024

Published : 08 August 2024

DOI : https://doi.org/10.1057/s41599-024-03552-x

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

design and development research methods strategies and issues

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

sustainability-logo

Article Menu

design and development research methods strategies and issues

  • Subscribe SciFeed
  • Recommended Articles
  • Google Scholar
  • on Google Scholar
  • Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

Diagnostic evaluation of the contribution of complementary training subjects in the self-perception of competencies in ethics, social responsibility, and sustainability in engineering students.

design and development research methods strategies and issues

1. Introduction

2. theoretical framework, 3. review of related research, 4. materials and methods, 4.1. study population, 4.2. instrument, 4.3. data analysis technique, 5.1. descriptive statistics, 5.2. analysis of competencies in ers vs. courses taken, 5.3. relationship of ers competencies with sociodemographic variables, 6. discussion, 7. conclusions, 8. future work, author contributions, institutional review board statement, informed consent statement, data availability statement, conflicts of interest.

  • Abad-Segura, E.; González-Zamar, M.D.; Infante-Moro, J.C.; García, G.R. Sustainable management of digital transformation in higher education: Global research trends. Sustainability 2020 , 12 , 2107. [ Google Scholar ] [ CrossRef ]
  • Candanedo, G.U. Tendencias globales en Educación. Prospectiva, visión y desafíos. Rev. Anu. 2019 , 44 , 177–199. [ Google Scholar ]
  • Børsen, T.; Serreau, Y.; Reifschneider, K.; Baier, A.; Pinkelman, R.; Smetanina, T.; Zandvoort, H. Initiatives, experiences and best practices for teaching social and ecological responsibility in ethics education for science and engineering students. Eur. J. Eng. Educ. 2021 , 46 , 186–209. [ Google Scholar ] [ CrossRef ]
  • Grimson, J. Re-engineering the curriculum for the 21st century. Eur. J. Eng. Educ. 2002 , 27 , 31–37. [ Google Scholar ] [ CrossRef ]
  • Davidson, C.I.; Hendrickson, C.T.; Matthews, H.S.; Bridges, M.W.; Allen, D.T.; Murphy, C.F.; Allenby, B.R.; Crittenden, J.C.; Austin, S. Preparing future engineers for challenges of the 21st century: Sustainable engineering. J. Clean. Prod. 2010 , 18 , 698–701. [ Google Scholar ] [ CrossRef ]
  • UNESCO. Preparing Learners for the Challenges of the 21st Century ; UNESCO: Paris, France, 2014. [ Google Scholar ]
  • Lozano, R.; Carpenter, A. Developing Sustainability Competences through Pedagogical Approaches ; Springer: New York, NY, USA, 2021. [ Google Scholar ]
  • Domínguez, V.B.; Lizarraga, L.M.P. Construction and validation of an instrument to evaluate the characteristics of university social responsibility in university students. Rev. Int. Educ. Justicia Soc. 2019 , 8 , 79–96. [ Google Scholar ] [ CrossRef ]
  • Vallaeys, F. Las diez falacias de la Responsabilidad Social Universitaria. Rev. Digit. Investig. Docencia Univ. 2018 , 12 , 34–58. [ Google Scholar ] [ CrossRef ]
  • Reig-Aleixandre, N.; Ramos, J.M.G.; De la Calle Maldonado, C. Formación en la responsabilidad social del profesional en el ámbito universitario. Rev. Complut. Educ. 2022 , 33 , 517–528. [ Google Scholar ] [ CrossRef ]
  • Boatwright, J.R.; Slate, J.R. Development of an Instrument to Assess Work Ethics. JITE-J. Ind. Teach. Educ. 2002 , 39 , 4. Available online: http://scholar.lib.vt.edu/ejournals/JITE/v39n4/boatwright.html (accessed on 18 April 2024).
  • Martin, D.A. The Ethics of Engineering ; RTE Brainstorm: Dublin, Ireland, 2019; Volume 9, p. 48. [ Google Scholar ] [ CrossRef ]
  • Serna, E.; Serna, A. Realidad de Una Disciplina ; Editorial IAI: Medellín, Colombia, 2018; pp. 106–139. [ Google Scholar ]
  • Davis, M. Thinking Like an Engineer. In Ethics, Politics, and Whistleblowing in Engineering ; CRC Press: Boca Raton, FL, USA, 2018; pp. 79–82. [ Google Scholar ] [ CrossRef ]
  • Hirsch, A. Construccción de una escala de actitudes sobre ética profesional. Rev. Electrónica Investig. Educ. 2005 , 7 , 1–15. [ Google Scholar ]
  • Alexandre, N.R. Formación de la Responsabilidad Social en la Universidad y Práctica Profesional: Un Estudio con Egresados ; Universidad Complutense de Madrid: Madrid, Spain, 2020. [ Google Scholar ]
  • Jones, A.; Parker, B. Ethical considerations in engineering practice. Eng. Ethics J. 2016 , 10 , 45–60. [ Google Scholar ]
  • Smith, C.; Doe, J. Integrating ethics and sustainability in engineering education. J. Eng. Educ. 2018 , 25 , 112–125. [ Google Scholar ]
  • Brown, D.; Green, E. The role of engineering programs in promoting social responsibility. Eng. Soc. J. 2017 , 5 , 78–89. [ Google Scholar ]
  • Lozano, R. Incorporation and institutionalization of SD into universities: Breaking through barriers to change. J. Clean. Prod. 2006 , 14 , 787–796. [ Google Scholar ] [ CrossRef ]
  • García, A.; López, M.; Martínez, P. Integrating sustainability competencies in engineering education. J. Clean. Prod. 2019 , 215 , 345–358. [ Google Scholar ]
  • Smith, R.; Johnson, T. Enhancing sustainability skills in engineering curricula. Int. J. Eng. Educ. 2017 , 33 , 712–725. [ Google Scholar ]
  • Brown, S.; Lee, E. Sustainability integration in engineering programs: A case study. Sustain. Sci. 2018 , 10 , 189–202. [ Google Scholar ]
  • Demssie, Y.N.; Wesselink, R.; Biemans, H.J.A.; Mulder, M. Think outside the European box: Identifying sustainability competencies for a base of the pyramid context. J. Clean. Prod. 2019 , 221 , 828–838. [ Google Scholar ] [ CrossRef ]
  • Albareda-Tiana, S.; Goded, P.A.; Muñoz-Rodríguez, J.M.; Valderrama-Hernández, R.; Ruiz-Morales, J. Assessing competences in sustainability in teaching degrees and post-degrees: A proposal of a tool. Ensen. Cienc. 2019 , 37 , 11–29. [ Google Scholar ] [ CrossRef ]
  • Chiang, M.; Chen, P. Education for sustainable development in the business programme to develop international Chinese college students’ sustainability in Thailand. J. Clean. Prod. 2022 , 374 , 134045. [ Google Scholar ] [ CrossRef ]
  • Michel, A.L.P. La Enseñanza de la Ética Profesional a Ingenieros: Un Caso de Estudio. INNOVUS 2020 , 20 , 125–146. Available online: https://www.ipn.mx/innovacion/numeros-anteriores/innovacion-educativa-84.html (accessed on 18 April 2024).
  • Mendoza, D.J.E.; Ramírez, E.L.; Soto, Y.M. Procesos y Contextos en Los Proyectos de Intervención Educativa , 1st ed.; Comunicación Científica: Ciudad de México, Mexico, 2020; pp. 96–118. [ Google Scholar ]
  • Alcazar, A.; Castillo, M.; Cogley, G.; Lakhani, R.; Batista, L. Perspectiva de la ética en los alumnos de Ingeniería Logística y Cadena de Suministro de la Universidad Tecnológica de Panamá. Rev. Iniciación Científica 2024 , 10 , 53–57. [ Google Scholar ] [ CrossRef ]
  • Pegalajar-Palomino, M.C.; Martínez-Valdivia, E.; Burgos-García, A. Analysis of social responsibility in university education students. Form. Univ. 2021 , 14 , 95–104. [ Google Scholar ] [ CrossRef ]
  • de Jesús, C.F.N. Perception of engineering students regarding sustainable development. In An Analysis from the Economic, Social and Environmental Dimensions in a Developing Country ; Universidad de Córdoba: Córdoba, Spain, 2024. [ Google Scholar ]
  • Obrecht, M.; Feodorova, Z.; Rosi, M. Assessment of environmental sustainability integration into higher education for future experts and leaders. J. Environ. Manag. 2022 , 316 , 115223. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • da Silva Junior, A.; de Oliveira Martins-Silva, P.; de Araújo Vasconcelos, K.C.; da Silva, V.C.; de Brito, S.L.M.S.; Monteiro, J.M.R. Sustainability and corporate social responsibility in the opinion of undergraduate students in management programs: Between the concrete and the abstract. J. Clean. Prod. 2019 , 207 , 600–617. [ Google Scholar ] [ CrossRef ]
  • LFonseca, M.; Portela, A.R.; Duarte, B.; Queirós, J.; Paiva, L. Mapping higher education for sustainable development in Portugal. Manag. Mark. 2018 , 13 , 1064–1075. [ Google Scholar ] [ CrossRef ]
  • LaPatin, M.; Roy, A.; Poleacovschi, C.; Padgett-Walsh, K.; Feinstein, S.; Rutherford, C.; Nguyen, L.; Faust, K.M. Measuring ethical development of engineering students across universities and class years. Int. J. Ethics Educ. 2023 , 8 , 49–65. [ Google Scholar ] [ CrossRef ]
  • Sánchez-Carracedo, F.; Sureda, B.; Moreno-Pino, F.M.; Romero-Portillo, D. Education for Sustainable Development in Spanish engineering degrees. Case study. J. Clean. Prod. 2021 , 294 , 126322. [ Google Scholar ] [ CrossRef ]
  • Finelli, C.J.; Holsapple, M.A.; Ra, E.; Bielby, R.M.; Burt, B.A.; Carpenter, D.D.; Harding, T.S.; Sutkus, J.A. An Assessment of Engineering Students’ Curricular and Co-Curricular Experiences and Their Ethical Development. J. Eng. Educ. 2012 , 101 , 469–494. [ Google Scholar ] [ CrossRef ]
  • Donald, D.C.; Trevor, S.H.; Janel, A.S.; Cynthia, J.F. Assessing the Ethical Development of Civil Engineering Undergraduates in Support of the ASCE. J. Prof. Issues Eng. Educ. Pract. 2014 , 140 , A4014001. [ Google Scholar ] [ CrossRef ]
  • Li, A. An empirical analysis on social responsibility education of college students in four universities in Shandong Province during COVID-19 Response. In Procedia Computer Science ; Elsevier B.V.: Amsterdam, The Netherlands, 2022; pp. 221–228. [ Google Scholar ] [ CrossRef ]
  • Galvão, A.; Mendes, L.; Marques, C.; Mascarenhas, C. Factors influencing students’ corporate social responsibility orientation in higher education. J. Clean. Prod. 2019 , 215 , 290–304. [ Google Scholar ] [ CrossRef ]
  • Warshawski, S. First-year nursing students’ perceptions of health activism and social. Nurse Educ. Today 2024 , 132 , 106019. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Miñano, R. Formación En Competencias de Sostenibilidad, Responsabilidad Social y Ética Profesional: Estudio de Casos en Ingeniería Industrial e Ingeniería Informática. Ph.D. Thesis, ETSII, Universiti Putra Malaysia, Seri Kembangan, Malaysia, 2019. Available online: https://oa.upm.es/55789/1/RAFAEL_MINANO_RUBIO.pdf (accessed on 18 April 2024).
  • Setó-Pamies, D.; Papaoikonomou, E. A Multi-level Perspective for the Integration of Ethics, Corporate Social Responsibility and Sustainability (ECSRS) in Management Education. J. Bus. Ethics 2016 , 136 , 523–538. [ Google Scholar ] [ CrossRef ]
  • Kolb, M.; Fröhlich, L.; Schmidpeter, R. Implementing sustainability as the new normal: Responsible management education—From a private business school’s perspective. Int. J. Manag. Educ. 2017 , 15 , 280–292. [ Google Scholar ] [ CrossRef ]
  • Pérez-Foguet, A.; Lazzarini, B. Continuing professional education in engineering faculties: Transversal integration of sustainable human development in basic engineering sciences courses. J. Clean. Prod. 2019 , 218 , 772–781. [ Google Scholar ] [ CrossRef ]
  • Jordan, R.; Agi, K.; Arora, S.; Christodoulou, C.G.; Schamiloglu, E.; Koechner, D.; Schuler, A.; Howe, K.; Bidram, A.; Martinez-Ramon, M.; et al. Peace engineering in practice: A case study at the University of New Mexico. Technol. Forecast. Soc. Chang. 2021 , 173 , 121113. [ Google Scholar ] [ CrossRef ]
  • Pugh, G.; Lozano-Rodríguez, A. El desarrollo de competencias genéricas en la educación técnica de nivel superior: Un estudio de caso. Calid. Educ. 2019 , 50 , 143–170. [ Google Scholar ] [ CrossRef ]
  • Pizzutilo, F.; Venezia, E. On the maturity of social responsibility and sustainability integration in higher education institutions: Descriptive criteria and conceptual framework. Int. J. Manag. Educ. 2021 , 19 , 100515. [ Google Scholar ] [ CrossRef ]
  • Harris, C.E.; Pritchard, M.S.; James, R.W.; Englehardt, E.E.; Rabins, M.J. Concepts and Cases Engineering Ethics , 6th ed.; Cengage: Boston, MA, USA, 2019; p. 306. [ Google Scholar ]
  • Ariza, S.M.B.; Guerrero, M.I.M. El Desarrollo Sostenible y la Responsabilidad Social Empresarial ; Universidad Católica de Colombia: Bogotá, Colombia, 2020. [ Google Scholar ]
  • Garay, P.J.P.; Oliver, Z.J.M.; Contreras, C.V.; Flores, D.S.A.; Baca, R.L.S. Social Responsibility in University Students According to Gender and Age. Health Educ. Health Promot. 2021 , 9 , 513–519. [ Google Scholar ]
  • Kirk, B.A.; Schutte, N.S.; Hine, D.W. Development and preliminary validation of an emotional self-efficacy scale. Personal. Individ. Differ. 2008 , 45 , 432–436. [ Google Scholar ] [ CrossRef ]
  • Bernardi, R.A.; Nash, J. The importance and efficacy of controlling for social desirability response bias. Ethics Behav. 2023 , 33 , 413–429. [ Google Scholar ] [ CrossRef ]
  • Stedham, Y.; Yamamura, J.H.; Beekun, R.I. Gender differences in business ethics: Justice and relativist perspectives. Bus. Ethics A Eur. Rev. 2007 , 16 , 163–174. [ Google Scholar ] [ CrossRef ]
Sociodemographic VariablesFirst SemesterLast SemestersTotal
n%n%n%
GenderFemale3413.71810.75212.4
Male21084.315189.336186.4
Other52.00051.2
Age15–25 years20983.98650.929570.6
26–35 years3313.36437.99723.2
36 years and above72.81911.3266.2
Stratum16425.73218.99623.0
211044.28349.119346.2
36927.75432.012329.4
462.40061.4
Experts Total
n%
Higher education levelMaster’s degree1361.9
Doctor’s degree838.1
Age26–35 years14.8
36–45 years628.6
46–55 years838.1
56 years and above628.6
Experience in education1–5 years14.8
5–10 years314.3
Over 10 years1781.0
Experience in the productive sector Yes1466.7
No733.3
Years in the productive sector1–5 years14.8
5–10 years14.8
Over 10 years1257.1
TOTAL21100
Reliability Statistics
Cronbach’s AlphaCronbach’s Alpha Based on Standardized ItemsN of Elements
0.9300.93430
CompetencyDimensionsIndicatorItem
Social
Responsibility
[ ]
AwarenessI am aware that I am in the world to contribute responsibly to its transformationR1
I understand that being part of this world entails a responsibility towards the members of a group or organization for the benefit of societyR2
CommitmentI am familiar with and care about local issues and their connection to national and global factorsR3
CitizenshipAs a student, I feel that I have the skills to contribute to social, political, and economic changes in my communityR4
As a student, I would like to contribute to public policies that improve the quality of life for (ethnic, racial, sexual) minority groups and other vulnerable groups (children, women…)R5
Social justiceI believe that my educational process provides me with the necessary tools to follow up on public or private programs and initiatives aimed at social transformationR6
I believe that, through my profession, I can contribute to reducing poverty and inequality in my countryR7
Ethics
[ ]
ResponsibilityIn my daily actions, it is important to fulfill my commitments on timeE1
In my daily actions, I am willing to take responsibility for any mistakesE2
Act with moral principles and professional valuesI am willing to spend time updating my knowledge about my careerE3
There are ethical decisions that are so important in my career that I cannot leave them to the sole discretion of othersE4
In my daily actions, maintaining confidentiality is crucialE5
Doing the right things in my daily life brings me inner peaceE6
I communicate my values through my daily actionsE7
Professional and personal ethicsTo avoid mistakes in my profession, I must be aware of the limits of my knowledge and skillsE8
Working with passion is part of my personal fulfillmentE9
Ethical aspects are crucial to my career and future professionE10
I must assess the consequences before making important decisionsE11
It is good to aspire but not have excessive ambitionE12
To perform well in my career, developing technical skills alone is not enoughE13
HonestyTo be a good professional, I cannot ignore the problems of the society I live inE14
I take the risk of making mistakes to improve my career performanceE15
Sustainability
[ ] (S1, S6, S7, S8)
[ ] (S2 to S5)
SystemicI analyze individually or in groups situations related to sustainability and their impact on society, the environment, and the economy, both locally and globallyS1
Discipline and regulationsI am aware of the importance of sustainability in society. I learn and then I impact my communityS6
AnticipatoryI use resources sustainably in the prevention of negative impacts on the environment and social and economic systemsS7
I anticipate and understand the impact of environmental changes on social and economic systemsS3
StrategicI am aware of the potential of the human and natural resources in my environment for sustainable developmentS8
I actively participate in groups or communities committed to sustainabilityS2
Action competence for interventionsI am coherent in my actions, respecting and appreciating (biological, social, cultural) diversity and committing myself to improving sustainabilityS4
I create and provide critical and creative solutions to technology and engineering issues, always considering sustainabilityS5
CompetenciesSocial ResponsibilityEthicsSustainability
Social responsibility1
Ethics0.566 **1
Sustainability0.719 **0.484 **1
GroupGenderAgeStratum
ModeFirst semester212
Last semesters212
All212
GroupSocial ResponsibilityEthicsSustainability
First semester4.028 (0.656)4.496 (0.453)3.798 (0.689)
Last semester4.101 (0.589)4.577 (0.447)3.921 (0.646)
Levene Testt-Test for Equality of Means
FSig.tGlSig
(Bilateral)
Mean
Differences
Standard Error Differences95% Difference
Confidence Interval
Social responsibility0.9190.338−1.1674160.244−0.073320.06281−0.196790.05014
Ethics1.2770.259−1.8084160.071−0.081270.04494−0.169610.00706
Sustainability0.1280.721−1.8394160.067−0.123170.06698−0.254830.00849
Statistical TestsSocial ResponsibilityEthicsSustainability
Mann–Whitney U test20,073.50018,501.00019,304.500
Wilcoxon W test51,198.50049,626.00050,429.500
Z test−0.800−2.101−1.435
Bilateral asymptotic sig.0.4240.0360.151
ANOVAGenderAgeStratum
FSig.FSig.FSig.
Social responsibility0.4380.64611.0520.0001.7050.165
Ethics0.3370.7147.4040.0000.2270.877
Sustainability0.8050.4489.2370.0000.7420.527
Social Responsibility
AgeNSubset
12
15–25 years2953.9603
26–35 years974.2180
36 years and above264.53574.5357
Sig. 0.0910.221
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

Yepes, S.M.; Montes, W.F.; Herrera, A. Diagnostic Evaluation of the Contribution of Complementary Training Subjects in the Self-Perception of Competencies in Ethics, Social Responsibility, and Sustainability in Engineering Students. Sustainability 2024 , 16 , 7069. https://doi.org/10.3390/su16167069

Yepes SM, Montes WF, Herrera A. Diagnostic Evaluation of the Contribution of Complementary Training Subjects in the Self-Perception of Competencies in Ethics, Social Responsibility, and Sustainability in Engineering Students. Sustainability . 2024; 16(16):7069. https://doi.org/10.3390/su16167069

Yepes, Sara María, Willer Ferney Montes, and Andres Herrera. 2024. "Diagnostic Evaluation of the Contribution of Complementary Training Subjects in the Self-Perception of Competencies in Ethics, Social Responsibility, and Sustainability in Engineering Students" Sustainability 16, no. 16: 7069. https://doi.org/10.3390/su16167069

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

design and development research methods strategies and issues

Sorry, there was a problem.

Kindle app logo image

Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required .

Read instantly on your browser with Kindle for Web.

Using your mobile phone camera - scan the code below and download the Kindle app.

QR code to download the Kindle App

Image Unavailable

design_and_development_research-methods,_strategies,_and_issues

  • To view this video download Flash Player

Follow the author

James D. Klein

design_and_development_research-methods,_strategies,_and_issues Paperback

  • Language English
  • ISBN-10 080585732X
  • ISBN-13 978-0805857320
  • See all details

Product details

  • ASIN ‏ : ‎ B0071I36AK
  • Language ‏ : ‎ English
  • ISBN-10 ‏ : ‎ 080585732X
  • ISBN-13 ‏ : ‎ 978-0805857320

About the author

James d. klein.

Discover more of the author’s books, see similar authors, read author blogs and more

Customer reviews

  • 5 star 4 star 3 star 2 star 1 star 5 star 64% 20% 0% 0% 16% 64%
  • 5 star 4 star 3 star 2 star 1 star 4 star 64% 20% 0% 0% 16% 20%
  • 5 star 4 star 3 star 2 star 1 star 3 star 64% 20% 0% 0% 16% 0%
  • 5 star 4 star 3 star 2 star 1 star 2 star 64% 20% 0% 0% 16% 0%
  • 5 star 4 star 3 star 2 star 1 star 1 star 64% 20% 0% 0% 16% 16%

Customer Reviews, including Product Star Ratings help customers to learn more about the product and decide whether it is the right product for them.

To calculate the overall star rating and percentage breakdown by star, we don’t use a simple average. Instead, our system considers things like how recent a review is and if the reviewer bought the item on Amazon. It also analyzed reviews to verify trustworthiness.

  • Sort reviews by Top reviews Most recent Top reviews

Top reviews from the United States

There was a problem filtering reviews right now. please try again later..

design and development research methods strategies and issues

  • About Amazon
  • Investor Relations
  • Amazon Devices
  • Amazon Science
  • Sell products on Amazon
  • Sell on Amazon Business
  • Sell apps on Amazon
  • Become an Affiliate
  • Advertise Your Products
  • Self-Publish with Us
  • Host an Amazon Hub
  • › See More Make Money with Us
  • Amazon Business Card
  • Shop with Points
  • Reload Your Balance
  • Amazon Currency Converter
  • Amazon and COVID-19
  • Your Account
  • Your Orders
  • Shipping Rates & Policies
  • Returns & Replacements
  • Manage Your Content and Devices
 
 
 
   
  • Conditions of Use
  • Privacy Notice
  • Consumer Health Data Privacy Disclosure
  • Your Ads Privacy Choices

design and development research methods strategies and issues

This paper is in the following e-collection/theme issue:

Published on 19.8.2024 in Vol 26 (2024)

Digital Serious Games to Promote Behavior Change in Children With Chronic Diseases: Scoping Review and Development of a Self-Management Learning Framework

Authors of this article:

Author Orcid Image

  • Made Ary Sarasmita 1, 2 * , MClinPharm, PhD   ; 
  • Ya-Han Lee 1, 3 , MSc   ; 
  • Fan-Ying Chan 1 , MSc   ; 
  • Hsiang-Yin Chen 1, 3 * , PharmD  

1 Department of Clinical Pharmacy, School of Pharmacy, Taipei Medical University, Taipei, Taiwan

2 Program Study of Pharmacy, Faculty of Mathematics and Science, Udayana University, Badung, Indonesia

3 Department of Pharmacy, Wan Fang Hospital, Taipei, Taiwan

*these authors contributed equally

Corresponding Author:

Hsiang-Yin Chen, PharmD

Department of Clinical Pharmacy

School of Pharmacy

Taipei Medical University

Health and Science Building, 7th Fl.

250 Wuxing Street

Taipei, 110

Phone: 886 02 2736 1661 ext 6175

Fax:886 02 2736 1661

Email: [email protected]

Background: Digital serious games (SGs) have rapidly become a promising strategy for entertainment-based health education; however, developing SGs for children with chronic diseases remains a challenge.

Objective: In this study, we attempted to provide an updated scope of understanding of the development and evaluation of SG educational tools and develop a framework for SG education development to promote self-management activities and behavior change in children with chronic diseases.

Methods: This study consists of a knowledge base and an analytical base. This study followed the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. To build the knowledge base, 5 stages of research were developed, including refining the review question (stage 1), searching for studies (stage 2), selecting relevant studies (stage 3), charting the information (stage 4), and collating the results (stage 5). Eligible studies that developed SG prototypes and evaluated SG education for children with chronic diseases were searched for in PubMed, Embase, Google Scholar, and peer-reviewed journals. In the analytical base, the context-mechanism-output approach and game taxonomy were used to analyze relevant behavioral theories and essential game elements. Game taxonomy included social features, presentation, narrative and identity, rewards and punishment, and manipulation and control. A total of 2 researchers selected the domains for the included behavioral theories and game elements. The intended SG framework was finalized by assembling SG fragments. Those SG fragments were appropriately reintegrated to visualize a new SG framework.

Results: This scoping review summarized data from 16 randomized controlled trials that evaluated SG education for children with chronic diseases and 14 studies on SG frameworks. It showed that self-determination theory was the most commonly used behavioral theory (9/30, 30%). Game elements included feedback, visual and audio designs, characters, narratives, rewards, challenges, competitions, goals, levels, rules, and tasks. In total, 3 phases of a digital SG framework are proposed in this review: requirements (phase 1), design and development (phase 2), and evaluation (phase 3). A total of 6 steps are described: exploring SG requirements (step 1), identifying target users (step 2), designing an SG prototype (step 3), building the SG prototype (step 4), evaluating the SG prototype (step 5), and marketing and monitoring the use of the SG prototype (step 6). Safety recommendations to use digital SG-based education for children in the post–COVID-19 era were also made.

Conclusions: This review summarizes the fundamental behavioral theories and game elements of the available literature to establish a new theory-driven step-by-step framework. It can support game designers, clinicians, and educators in designing, developing, and evaluating digital, SG-based educational tools to increase self-management activities and promote behavior change in children with chronic diseases.

Introduction

Serious game (SG) educational tools that provide constructive learning with imperative goals for behavior change [ 1 ] are increasingly being applied with children with chronic diseases. Training children to self-care for their chronic diseases is highly challenging due to insufficient cognition [ 2 ], low attendance [ 3 ], complicated treatments [ 4 ], and nonadherence to treatments [ 5 ]. A properly designed SG educational tool can allow children with chronic diseases to enjoy learning how to overcome real-life challenges [ 6 ]. A fully fledged game design provides a safe and controlled environment to experience and practice self-management skills [ 7 ]. Holtz et al [ 8 ] reported that SG education had positive impacts on self-efficacy, adherence, and knowledge, which drove improvements in behavior and health outcomes over time. Directing the design and application of SGs as an educational intervention to positively support children with chronic diseases could help improve therapeutic outcomes [ 9 ].

Behavioral sciences offer insights into how to design effective SG educational tools for children with chronic diseases to achieve the dual goals of internal enjoyment and confidence while promoting their self-care abilities. To understand changes in children’s behaviors, basic principles and theories of learning, behavior, and mindset should be identified. The most commonly used theories explaining behavior change include social cognitive theory [ 10 ], self-determination theory (SDT) [ 11 ], and the mindset theory [ 12 ]. Social cognitive theory defines how behavior change can be achieved depending on personal factors, including cognition, capability, self-control, experiences, and expectations, and environmental factors, including emulation, reinforcement, and observation [ 10 ]. SDT addresses motivation and influences children to put themselves in situations in which they are exposed to SG education [ 13 ]. A growth mindset enhances greater resilience and positivity than a fixed mindset when dealing with challenges and failures [ 12 ]. Children with chronic diseases require continuous, specific self-management tasks to achieve levels of their mindset and cognitive development [ 12 ]. Incorporating behavioral theories and instructional learning into game mechanics, including practice tasks and challenges, can facilitate the changing process of a growth mindset and enhance motivation [ 14 ].

SG educational tools require a sophisticated design to avoid several potential negative consequences for children. The World Health Organization has articulated increased screen media use as a major concern due to the risk of addictive behaviors [ 15 ]. Higher gaming behavior is associated with higher levels of social, health, and behavioral problems in children and adolescents [ 16 , 17 ]. Playing SG interventions can promote behavior changes; however, uncontrolled excessive gaming may lead to gaming disorders [ 18 ] when games are used above the level of a child’s age and mindset [ 19 ]. It has also been reported that a large proportion of electronic games may have violent content such as fighting, hitting, destroying, and killing [ 19 ], which increases the risk of aggressive behaviors in children. Inappropriate visual designs and game elements may distract from the educational purposes [ 18 ].

An SG framework that promotes positive behavior change in children is specifically needed because children’s capabilities to respond to emotions and act when encountering difficulties differ from those of adults. Frameworks have been established for developing SG prototypes for adults [ 20 , 21 ]; however, only limited attention has been paid to creating a well-established theoretical SG framework for children. Children are more vulnerable to influences of digital games during their cognitive, social, and emotional development stages [ 2 ]. A stepwise SG framework is warranted to guide researchers in designing and evaluating SG educational tools for children with chronic diseases to maximize advantages and avoid unintended effects. This requires pivotal attention by researchers to creatively develop and design appropriate SG educational tools for children that balance the cornerstones of learning and playing.

The study purpose was to offer an updated scoping review of SG education focused on delivering self-management activities and promoting behavior change for children with chronic diseases. It provided a scope of understanding of the development and evaluation of SG educational tools and developed a systematic methodological SG-based framework for children with chronic diseases. The intended SG framework was designed according to the methodology of scoping reviews Levac et al [ 22 ] and the context-mechanism-output (CMO) approach [ 23 ]. The specific aims were to create two bases: (1) to build a knowledge base that covers all the resources required to design and develop an SG framework and (2) to construct an analytical base by integrating behavioral theories and game elements from the knowledge base to design and visualize the intended SG framework through the CMO approach. The findings of this review can benefit researchers developing and evaluating SG-based learning educational tools for children with chronic diseases.

Study Design

Figure 1 [ 24 - 26 ] describes the process of developing an SG framework for children with chronic diseases using knowledge and analytical bases. This study followed the guidelines of the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) [ 27 ]. For the knowledge base, relevant studies on developing an SG framework and evaluation of SG educational tools for children with chronic diseases were searched and collated throughout 5 stages to cover all the SG resources required. The analytical base used the CMO approach and game taxonomy to build a theory-based foundation for the proposed SG framework. Relevant behavioral theories and essential game elements from relevant studies were appropriately divided into fragments, compared, and assembled to create a visualization of the proposed SG framework. Discussions were conducted throughout the study to resolve any discrepancies among researchers.

design and development research methods strategies and issues

Knowledge Base

There were five stages for building the knowledge base: (1) refining the initial question, (2) identifying relevant studies, (3) selecting relevant studies, (4) charting the information, and (5) collating the results [ 22 ].

Refining the Review Question (Stage 1)

SGs are digital games that blend concepts of learning and performing attitudes and are enjoyable to play, with challenging goals [ 28 ]. On the basis of the literature, we began exploring the idea of how to develop an SG framework to improve self-management and promote behavior changes in children with chronic diseases. To develop an SG framework, a scientific foundation should be built supported by documented relevant evidence.

Identifying Relevant Studies (Stage 2)

Databases and search strategy.

Relevant studies that had developed and published established SG frameworks and SG prototypes for children with chronic diseases were searched for using electronic databases, including PubMed, Embase, and Google Scholar. A hand searching method was also used to obtain additional relevant articles in peer-reviewed journals that focused on game research and were indexed in Web of Science, such as Games for Health Journal and JMIR Serious Games . We searched for articles using keywords obtained from Medical Subject Heading terms, such as “computer game,” “video game,” and “children,” with no restriction on publication year (1980-2024). The panel in Multimedia Appendix 1 shows keyword term variations, and detailed search strategies are described in Table S1 in Multimedia Appendix 1 . Reference lists of articles found through the electronic database searching were hand searched to obtain additional relevant information.

Inclusion Criteria

The inclusion criteria were (1) studies involving children aged 5 to 14 years, (2) studies that developed an SG framework for children with chronic diseases, and (3) studies that applied and evaluated the use of SG education for children with chronic diseases. Relevant articles were classified into two groups: (1) studies that focused on developing an SG framework and (2) studies that focused on evaluating SG educational tools for children with chronic diseases. Review or original articles explaining learning theories, behavioral theories, game theories, and game elements or presenting a general or specific SG model or framework that focused on behavior changes in children were included in the “SG framework studies” group. Randomized controlled trials (RCTs) that implemented and evaluated SG-based educational tools for children with chronic diseases were included in the “SG education studies/RCTs” group.

SG-based education is described as the use of SG prototypes or interventions, which are also known as computer games, for educational health and promotion of treatments, health education, patient adherence, therapeutic and side effect monitoring, and patient engagement. In this study, any changes in health-related outcomes in an RCT were descriptively reported. Clinical outcomes referred to any reduction in symptoms of chronic diseases and risks of complications, emergency visits, and hospitalizations. Humanistic outcomes were considered to be any condition that affected physical and social functions [ 29 ], including changes in attitudes and behaviors, adherence to treatment and medication, knowledge, quality of life, and patient satisfaction.

Selecting Relevant Studies (Stage 3)

The collected articles were initially imported into reference manager software (EndNote version 20; Clarivate Analysis). After removing duplicates, 2 researchers (MAS and YHL) independently assessed the articles using the inclusion criteria by examining titles and abstracts. Abstracts that met the inclusion criteria were retained for full-text review.

Charting the Information (Stage 4)

Characteristics of SG education for children with chronic diseases that were evaluated in RCTs were charted into a table, including authors’ information, conditions, target ages, interventions, comparators, sample sizes, study duration, length of the study, and health-related outcomes. Data were summarized by 2 authors (MAS and YHL). Disagreements were resolved through discussion involving a third reviewer (HYC).

Collating the Results (Stage 5)

The components of SGs were collated from the included studies using the CMO approach [ 23 ]. According to the CMO approach, “context” consists of any fundamental principles that enhance the efficacy of SG education to induce behavior changes, including behavioral theories, learning theories, and game theories. “Mechanism” refers to rules of how a game works, the dynamics through which children interact in response to the game, and the game’s appearance. It includes game elements to actively engage and motivate target users to perform self-management activities and positive behaviors. “Output” is related to any outcomes, study output, or study prototype.

Analytical Base

Identifying sg components.

Components of SG educational tools comprise behavioral theories, learning theories, game theories (context), and game taxonomy (mechanism). Behavioral theories and game elements were identified after collating all the included studies. Details of the identified SG components based on the CMO approach are presented in Tables S2 and S3 in Multimedia Appendix 1 . The most often used behavioral theories were selected for inclusion in the analysis (n=9), as shown in Table S4 in Multimedia Appendix 1 . Detailed categories of the game taxonomy are shown in Table S5 in Multimedia Appendix 1 . Table S4 in Multimedia Appendix 1 presents SDT domains, consisting of the psychological needs of autonomy, competence, and relatedness to boost motivation. The autonomy domain refers to how users make decisions and boost the sense of control, such as adjusting choices, levels, and difficulties [ 11 ]. The sense of control evokes autonomy and fuels users’ willingness to continue playing. Competence refers to achieving targeted goals of successful actions, such as challenges, learning tasks, competitions, and rewards [ 11 ]. Relatedness expresses how children interact and how their interactions affect others within the game, such as avatars, feedback, and emotions [ 11 ]. Game taxonomy was applied to identify game elements in all studies, including social features, presentation, narrative, identity, rewards and punishments, and manipulation and control [ 30 ]. A total of 3 domains of SDT and 5 categories of game taxonomy intersected based on similar characteristics. Those elements were reintegrated to build new, appropriate game elements for children with chronic diseases. These SG components are reviewed and discussed throughout the analysis.

Assembling SG Fragments and Visualizing an SG Framework

SG fragments describe the strategies or systematic procedures for designing, developing, and evaluating SG educational tools for children with chronic diseases. After identifying SG components through SDT and game taxonomy, 2 researchers (MAS and YHL) individually analyzed SG framework studies (n=14) based on their step-by-step procedural techniques (fragments). The collected fragments were appropriately assembled into 5 steps following the method by Khaleghi et al [ 24 ]: objective definitions (step 1); users’ needs and game element identification (step 2); game concept generation, game mechanics selection, and prototyping (step 3); implementation (step 4); and monitoring (step 5). Fragments of SG development were appropriately reintegrated to build a new SG framework.

Fragments for building up a new SG framework were established and consisted of 3 main phases (requirements, design and development, and evaluation). Each main phase was redesigned to formulate 2 procedural steps and generate output materials. A proposed SG framework was visualized by one researcher (MAS) and then carefully reviewed by 2 other authors (YHL and HYC). Following the method by Carvalho et al [ 25 ], a game structure was designed to supplement the SG framework to explain the actions, tools, and achieved goals of learning and gaming (Figure S1 in Multimedia Appendix 1 ). The process of assembling the SG fragments and then visualizing the SG framework and game structure were discussed among the 3 researchers throughout the study.

We retrieved 1947 articles from PubMed (n=451, 23.16%), Embase (n=131, 6.73%), Google Search (n=512, 26.3%), Google Scholar (n=130, 6.68%), JMIR Serious Games (n=272, 13.97%), and Games for Health Journal (n=451, 23.16%). After removing duplicates, 738 full-text articles were reviewed. In total, 30 articles were included in the scoping review, consisting of 16 (53%) RCTs that evaluated SG educational tools for children with chronic diseases and 14 (47%) studies on SG frameworks ( Figure 2 ).

design and development research methods strategies and issues

Charting the Information

Table 1 describes the included 16 RCTs that evaluated the use of SG educational tools for children with chronic diseases. SG educational tools that blended the concepts of learning and gaming were developed for children with asthma (7/16, 44%) [ 31 - 37 ], obesity and risk of diabetes or only diabetes (4/16, 25%) [ 38 - 41 ], cancer (2/16, 13%) [ 42 , 43 ], cystic fibrosis (1/16, 6%) [ 44 ], cerebral palsy (1/15, 6%) [ 45 ], and HIV or AIDS (1/15, 6%) [ 46 ]. The number of study participants ranged from 10 to 375; however, 60% (9/15) of the studies had <100 participants, as shown in Table 1 . SG educational tools were delivered to children whose ages ranged from 3 to 17 years, with an average duration of play of approximately 40 minutes.

A total of 47% (7/15) of the studies reported improvements in clinical outcomes, including improved energy expenditure, heart rate, and blood pressure [ 31 ], or reduced symptoms, such as dyspnea and fatigue [ 31 - 33 , 44 ], as well as fewer hospitalizations [ 32 ] and unscheduled physician visits [ 38 ]. Regarding humanistic outcomes, 87% (13/15) of the RCTs evaluated behavioral outcomes. In total, 47% (7/15) of the studies presented improvements in knowledge, and 40% (6/15) reported improvements in behaviors, including asthma self-management [ 32 , 33 ], healthy dietary habits [ 39 ], communication with parents [ 38 ], disease-related risk communication [ 46 ], and lower medication use [ 34 ]. A total of 100% (15/15) of the studies evaluated users’ acceptance and satisfaction, resulting in 100% (15/15) of the RCTs showing positive acceptance toward SG educational tools and consideration of SG educational tools as enjoyable strategies for learning and practicing self-management tasks. None of the 15 RCTs evaluated economic outcomes.

Study, yearConditionAge of users (y)InterventionControlSample size, NHealth outcomes
Rubin et al [ ], 1986Asthma7-12Asthma CommandNonasthma computer game65Lower asthma-related acute visits, improved asthma knowledge, and improved asthma management–related behaviors
Bartholomew et al [ ], 2000Asthma7-17Watch, Discover, Think, and ActUsual care133Fewer symptoms and hospitalizations, increased asthma knowledge, improved correct decision-making in the game scenario (62%) and engagement in the game (84%), and children felt satisfied (97%)
Yawn et al [ ], 2000Asthma3-12Air AcademyUsual health education87Improved asthma knowledge, and children and teachers felt satisfied
Huss et al [ ], 2003Asthma7-12Wee Willie WheezieWritten asthma education101Children felt that the game could have been more esthetic.
Shames et al [ ], 2004Asthma5-12Bronkie’s Asthma AdventureUsual care and video game119Increased asthma knowledge, and children had a high interest in the program.
McPherson et al [ ], 2005Asthma7-14The Asthma FilesAsthma booklet101Lower oral steroid use, improved asthma knowledge, improved internal locus of control, high interest in the program (35/37, 95%), children felt that the game helped them gain asthma knowledge (32/37, 87%), and fewer school absences
Gomes et al [ ], 2015Asthma5-9Reflex Ridge from The Kinect Adventures ProgramTreadmill session36Lower level of FeNO , improved asthma control and exercise capacity, higher energy expenditure, higher motivation, and high endurance with the game
Salonini et al [ ], 2015Cystic fibrosis8-17The Kinect Adventures ProgramStationary cycle training30Less frequent dyspnea and fatigue and high enjoyment of the game
Kato et al [ ], 2008Cancer13-29RemissionNoncancer computer game375Improved adherence to the use of cancer medications, increased self-efficacy, and greater knowledge
Hamari et al [ ], 2019Cancer3-16Nintendo WiiFitUsual care36High acceptability and participation (77%), but the game was not followed as recommended.
Brown et al [ ], 1997Diabetes8-16Packy and MarlonVideo games with no health education content59Improved self-efficacy, better self-care behavior, increased diabetes-related communication with parents, and fewer unscheduled visits to the physician
Baranowski et al [ ], 2011Obesity and risk of diabetes10-12Escape from Diab and NanoswarmKnowledge-based internet game133Increased habit of eating healthy foods and high enjoyment of the game (80%-90%)
Baranowski et al [ ], 2019Obesity and risk of diabetes10-12Escape from Diab and NanoswarmKnowledge-based internet game200Increased expectations for gameplay
Weiland et al [ ], 2022Obesity and risk of diabetes9-12Kids Obesity Prevention or family interventionChild intervention23Increased knowledge gain in children and parents, maintenance of knowledge in parents, and high acceptance of the game
Winskell et al [ ], 2018HIV or AIDS11-14TumainiUsual care60Improved sexual health–related knowledge, greater self-efficacy, and improved intention for risk avoidance strategies and sexual risk communication
Pin and Butler [ ], 2019Cerebral palsy6-14Interactive gameUsual care18High enjoyment of the game

a FeNO: fractional exhaled nitric oxide.

Collating SG Components

Table 2 describes essential components of the SG-based education for developing the proposed SG framework based on the CMO approach (N=30). For context, several studies applied behavioral theories (23/30, 77%) and game theories (22/30, 73%). Regarding mechanisms , several aspects were concerned with embedding social features or feedback (28/30, 93%); presentation or esthetics (30/30, 100%); personalization, including narratives (24/30, 80%), characters (23/30, 77%), and rewards and punishments (26/30, 87%); and manipulation and control, including game genre or rules (23/30, 77%), game goals (28/30, 93%), and challenges (27/30, 90%). Regarding output, 27% (8/30) of the studies generated specific SG frameworks for children with chronic illnesses, including children with diabetes [ 39 , 40 , 47 , 48 ], children with cystic fibrosis [ 49 ], and children who needed physical rehabilitation [ 24 , 50 , 51 ]. The most commonly used behavioral theory in the studies was SDT (9/30, 30%). Relevant studies that used SDT as the behavioral theory foundation are identified in Table S6 in Multimedia Appendix 1 . Game elements from all the included studies (N=30) are described in Table S7 in Multimedia Appendix 1 .


SG framework studies (n=14), n (%)Randomized clinical trials (n=16), n (%)Total studies, n (%)

Behavioral theories12 (86)11 (69)23 (77)

Game theories13 (93)9 (56)22 (73)

Social (feedback)13 (93)15 (94)28 (97)

Presentation (esthetic)14 (100)15 (94)29 (100)



Narrative (story and narrative)13 (93)11 (69)24 (83)


Identity (characters and avatars)12 (86)11 (69)23 (79)

Rewards and punishments13 (93)13 (81)26 (90)



Game genre and rules10 (71)13 (81)23 (79)


Game goals14 (100)15 (94)29 (97)


Challenges12 (86)15 (94)27 (93)



Behavioral outcomes14 (88)14 (47)


Learning outcomes12 (75)12 (40)


Clinical outcomes11 (69)11 (38)



A specific framework for children8 (57)8 (28)


General framework6 (43)6 (21)

a Not applicable.

Table 3 summarizes the intersection of the 3 domains of SDT and 5 categories of game taxonomy (n=9). On the basis of our findings, game elements that should be inserted in a proposed SG framework for children with chronic diseases include feedback, such as tailored messages and links to social media (social); visual designs, such as images, videos, animations, and cartoons, and audio designs, such as music and sounds (presentation); avatars, characters, and emotions (identity); storyline (narrative); rewards and progress bar (rewards and punishments); and challenges, choices, competitions, goals, rules, levels, and tasks (manipulation and control). Details of the intersection of SDT and game taxonomy (n=9) are described in Table S8 in Multimedia Appendix 1 .

Self-determination theory of the proposed SD frameworkGame taxonomy

Social featuresPresentationNarrative and identityRewards and punishmentsManipulation and control
CompetenceEducative materials [ , ]: learning content and learning instructionsRewards [ , , , , - ]: points, progress bar, badges, and stars; punishments: NR Challenges [ , , , , - ]: competitions [ , , , , , , ], levels [ , , , , , , ], tasks [ , , , ], game rules [ , , , ], and goals [ , , , , ]
AutonomyPresentation: visual design [ , , , , - ]: images, videos, animations, cartoons, and attractive layout; audio design [ , , , - ]: music and soundsChoices [ , , , , , ] and difficulty adjustment [ , , , , ]
RelatednessFeedback [ , , , , - ]: tailored messages [ , , ] and social media [ , ]Narrative [ , , , , , ]: storyline; identity [ , , , , - ]: avatars, characters, and emotionsMotivation [ ]

b NR: not reported.

Assembling SG Fragments and Visualizing the Framework

Table 4 presents the determination of SG fragments from the included studies (14/30, 47%) and then assembles those SG fragments into a proposed SG framework. Each existing study offered different procedural steps for developing an SG prototype, yet the game elements and behavioral theories complemented each other. Only 50% (7/14) of the studies created SG prototypes [ 24 , 25 , 40 , 47 , 49 , 52 , 53 ]. Of the 14 SG framework studies, 3 (21%) specifically targeted self-management activities [ 21 , 41 , 47 ]. On the basis of these findings, we reintegrated those fragments into 3 main phases with 6 step-by-step procedural techniques.

In phase 1 (requirements), there are 2 important steps, including exploring the idea and SG requirements (step 1) using literature reviews and identifying target users’ needs (step 2) using iterative discussions or interviews. The outputs of phase 1 are relevant theories, game taxonomy, and children’s needs and preferences. In phase 2 (design and development), 2 steps should be considered by designers, including designing the game elements and educative materials (step 3) and building an SG prototype (step 4) using appropriate software programs and hardware equipment. The output of phase 2 is the SG prototype with a game structure. The final phase is phase 3 (evaluation), which is concerned with evaluating the SG prototype using a clinical trial design (step 5) and marketing the SG and monitoring its use (step 6) throughout clinic-based practice. Outputs of phase 3 are health outcome results and the final SG prototype with recommendations for its use.

Study, yearStep 1 (objective definition)Step 2Step 3Step 4 (implementation)Step 5 (monitoring)


Users’ needsGame element identificationGame mechanicPrototyping

AlMarshedi et al [ ], 2016+ NR ++NRNRNR
Baranowski et al [ ], 2011+++++++
Carvalho et al [ ], 2015+++++++
Beristain-Colorado et al [ ], 2021+NR++NRNRNR
Dörrenbächer et al [ ], 2014+++++++
Epstein et al [ ], 2021++++NRNRNR
Hansen [ ], 2017+++++++
Jaccard et al [ ], 2021+NR++NRNRNR
Khaleghi et al [ ], 2021+++++NRNR
Mummah et al [ ], 2016+NR++NRNRNR
Starks [ ], 2014++++NRNRNR
Thompson et al [ ], 2010+++++++
Verschueren et al [ ], 2019+++++++
Wattanasoontorn et al [ ], 2013+NR++NRNRNR

a Present or reported.

The Proposed SG Framework

On the basis of our knowledge base and analytical base, we propose a new SG-based framework that integrates the principles of SDT and game elements into self-management practices, titled Self-Management Interactive Learning and Entertainment for children with chronic diseases, as presented in Figure 3 . It consists of 3 main phases, starting from the requirements of SG educational tools (phase 1), design and development (phase 2), and evaluation of the SG educational tools (phase 3). In total, 2 procedural steps are included in each phase, resulting in 6 procedural steps. Each step has input materials as the foundation to support the actions and process and to produce output materials. Output materials in the first phase (phase 1) can be used as the input for the next phase (phase 2), and so forth. Each phase has critical points, revisions, and adjustments that should be considered by any game designer, researcher, or health care provider who would like to create an SG educational tool. Each game should be suitable for target users and their conditions; for example, an SG educational tool for children with asthma should have specific learning materials (asthma action plans and asthma medications), target goals (improved quality of life), and tasks and challenges (asthma self-management activities, breathing technique, and proper asthma medication use) that might differ from those of other diseases. Figure S1 in Multimedia Appendix 1 shows the gaming and learning structure of an SG prototype that blends SDT domains and game elements. The mechanism of how players achieve the target goal by accomplishing challenges should be set in clear game rules. Children will make their first choice by selecting an avatar or character, directly engaging with the game. Learning materials will help children understand their disease management, yet the game instructions will help them simultaneously observe challenges and tasks. After completing the tasks, their performance should be rewarded through points or a performance meter.

design and development research methods strategies and issues

Exploring SG Requirements (Step 1)

A robust theoretical SG-based foundation should be established using literature reviews that gather principles of learning theories, behavioral theories, and game theories. This step is aimed at exploring SG requirements by searching for evidence related to game-based behavior change programs for children using electronic databases, for example, behavioral and game theories. If such evidence is not available, it is recommended to consult established game developers and collect perspectives from target audiences regarding obstacles in their daily lives [ 21 ]. According to Bramer et al [ 56 ], critical points include how to determine a clear and focused research question, how to choose databases and interfaces to begin, how to use an appropriate search technique, and how to document and translate collected documents. After determining relevant SG literature, game elements and behavioral theories should be translated and adopted for use by children with chronic diseases. Relevant articles can be used as inputs to conduct iterative discussions to identify users’ needs.

Identifying Target Users (Step 2)

Step 2 began through iterative discussions with a multidisciplinary, collaborative team. The iterative approach refers to the iterative process of refining, creating, and revising a project until agreement is achieved, and it is commonly used for agile software development [ 57 ]. The aim of this step is to collect perspectives on identifying users’ profiles and needs, their daily difficulties and barriers related to their chronic conditions, and target outcomes [ 7 ]. In this step, critical points emphasize what the players’ backgrounds are, what age groups are considered, to which chronic conditions would the SG educational tool be applied, how many users would be involved in the game, and what outcomes need to be achieved [ 53 ]. A multidisciplinary team consisting of pediatricians, child psychologists, child educators, game prototype designers, and multimedia experts [ 54 ] needs to identify resilient attitudes and consistent stimuli that suit children’s characteristics. Designers should carefully identify users’ cultures, beliefs, mindset, and literacy to concisely adopt those preferences into the game’s elements [ 24 ]. Directly involving children through focus group discussions or in-depth interviews will help the team gamify self-management tasks based on their needs and level of understanding, including medication adherence, physical exercise, and maintenance of healthy dietary habits.

Designing the SG Prototype (Step 3)

A key driver for successful SG education is consolidating a balance between self-management tasks (serious) and game elements (entertainment) [ 6 , 58 ]. This step aims to design the mechanism and user interface of the game itself by consolidating the most appropriate behavioral theories, learning materials, and game elements. Designers begin to create a prototype after establishing selected relevant theories, game elements, and users’ needs and outcomes (input). First, designers should elucidate selected, well-established behavioral and learning theories into educational materials and game taxonomy into appropriate game elements for children. Game designers should consider several critical points, including what topics are inserted into the learning materials, which game elements are best suited to achieve the desired outcomes, and how interacting with the game can lead to targeted behaviors [ 49 ]. The educational materials should contain disease information, including its pathophysiology, signs and symptoms, treatments and medications, self-management, side effects, the importance of adherence, and daily practices.

It is recommended to insert game elements that offer enjoyment to stimulate children to play, at the same time directly motivating them to learn [ 51 ]. Cartoon characters, genres, and stories represent personalization for children [ 52 ]. To grow children’s mindset, challenges should be designed with competitive levels and rewards provided when a mission is accomplished [ 12 ]. A role model with a positive attitude should be inserted into the SG design to encourage children to become masters of practicing self-management activities. Adding these elements facilitates children responding when confronted with conflicts [ 50 ] and enhances their sense of resilience. It is important to design an SG prototype that mimics real-world circumstances by setting precise goals and instructing players to perform targeted skills over time [ 25 ]. It is also suggested to embed the features of feedback, a progress bar, or trend alerts to evaluate their performance after completing the challenges.

Building the SG Prototype (Step 4)

Step 4 aims to develop an actual prototype based on the selected behavioral theories and game elements. It requires extensive discussions with researchers, multimedia experts, and the game industry to integrate the technology into a game console. A graphic user interface should be built to present the set of game rules. Designers may consider facilitating level adjustments if children fail to win to maintain the developed mindset. Critical points are how the prototype can be built for efficient learning and playing, how to perform such tasks, and how to rapidly respond regarding those performances. Esthetics is an essential aspect to be considered. Game visuals can be appropriately created using 2D or 3D formats [ 55 ]. Music and animation can be added to enhance excitement and enjoyment. To effectively promote self-management tasks, virtual reality SGs should be equipped with body movement tools that specifically target childhood chronic diseases that involve physical disabilities [ 50 ]. Moreover, privacy should be protected because SG prototypes can be used in multiplayer settings, and the accessibility to enter measured data should be restricted [ 13 ].

Evaluating the SG Prototype (Step 5)

Step 5 focuses on evaluating the efficacy of the SG educational tools and unexpected effects after implementation. This step allows researchers to gather feedback from experts and children for further improvements [ 20 , 59 ]. A pilot test, followed by a clinical trial, is recommended, which quantitatively analyzes how the prototype achieves the intended outcomes and qualitatively explores users’ experiences. An RCT study design is preferred due to its high quality. The ability to perform a task at an expected level and with minimal adverse events may be set as the intended outcome. It should be carefully determined how long participants will be engaged in the game, how many sessions a child needs to reach the goals, and how long it takes to complete a session. A short duration is associated with unfamiliarity with the tasks, whereas a long duration leads to boredom [ 60 ].

Moreover, health outcomes, including clinical, humanistic, and economic outcomes, should be periodically evaluated [ 61 ]. Clinical outcomes may include symptom improvement and reduction of morbidity, whereas humanistic outcomes may include knowledge and attitudes, behavior changes, and an improved mindset. As no economic outcomes were available in the studies in this review, researchers are encouraged to evaluate economic outcomes when using the prototype. Possible unexpected impacts of SG interventions on aggressive behaviors should also be evaluated, especially for SG interventions that encompass violent elements [ 62 , 63 ]. Continued discussions with clinicians are still relevant to ensure that the game world setting can be applied to the real world.

Marketing and Monitoring Use of the Prototype (Step 6)

Disseminating and promoting a well-evaluated SG educational tool can enhance access to a broader population that may benefit the most and promptly inform the game industry to invest in such interventions. Commercialization of an SG educational tool for children remains a challenge due to the need for high-end technologies, animated multimedia design, artists, illustrators, and other consoles. Gameplay is rapidly changing due to advances in technology, and it should be developed in line with current modalities to minimize the obsolescence of software and hardware [ 39 ]. To ensure market readiness, business experts should be consulted and involved throughout the process. It is recommended for researchers to accelerate partnerships with the gaming industry for sustainable SG maintenance.

Specific practice skills can be designed in a modest simulation. For example, children with type 1 diabetes should be able to use insulin regularly, exercise, maintain a healthy diet, and be aware of the signs of hypoglycemia. Modest instruction will help clinicians in applying SG education for children with chronic diseases in the real world. It is important to underline that an excellent performance in the game world is not directly associated with mastery in the real world. Practicing self-management skills, such as physical activities and medication use, should regularly be guided by health care professionals. It may be relevant to consult with policy makers and health care associations regarding the establishment of policies and recommendations for appropriate uses of SG educational tools in clinical practice. Postmarketing feedback should continually be collected to improve the SG’s quality.

Principal Findings

This scoping review proposed a digital framework to design SG educational tools for children with chronic diseases. The SG framework consists of 3 main strategies to guide the planning, design and development, and implementation of SG educational tools to allow children to practice self-management skills for their chronic condition. Major considerations of how each step is conceptualized, including a theory-driven foundation, contents of health education, joyful reinforcement, and use of technology, were discussed. The game elements and game structure should engage children’s attention and support them in performing gamified self-management tasks, changing their mindset, and increasing their self-care abilities.

Comparison With Prior Work and Considerations for Using the Proposed Framework

Implementation of SG educational tools for children with chronic diseases has been demonstrated in several previous works [ 8 , 9 , 58 ], specifically concerning health education [ 55 , 64 ], physical activities [ 65 , 66 ], and self-management [ 9 , 67 , 68 ]; however, none of them offer a theory-driven framework for behavior change. It has been suggested that researchers articulate a scientific framework for the design of SG educational tools [ 65 ]. Although behavioral and self-management interventions can be delivered to children from 5 to 18 years of age [ 67 , 68 ], the health educational content is not applicable to the entire age range. Educational materials for children should be supplemented with communication skills, whereas activities for adolescents should focus on self-monitoring and problem-solving [ 69 ]. Multidisciplinary teamwork from conception to marketing is strongly emphasized [ 64 ], which was accommodated in this framework throughout the proposed phases.

As game-based interventions are continually growing, researchers are considering developing SG educational tools for children, but questions about how to get started have been raised. Developing an SG educational tool is expensive; therefore, several aspects should be carefully considered before initiating development of SG educational tools, including securing funding and building a collaborative team [ 69 ]. Developing SG educational tools for children with chronic diseases differs from entertainment-only video games due to their unique components of behavioral theories and learning materials to boost self-management practices and promote positive behavior changes. For example, children with asthma may need knowledge about preventing asthma triggers and adhering to medication, whereas children with cystic fibrosis may need more physical rehabilitation activities than children with other chronic respiratory diseases. Some of them may need specific, scheduled physical activities, whereas others may need the efforts of encouragement or psychological support and companionship. That is why the game design should be able to address those needs.

Establishing a solid team, which involves experienced game developers or game companies, should be noted. Once members are chosen, clear ground responsibilities and expectations regarding the prototype design should be established. The health care professional team can develop appropriate health learning contents and discuss those materials with the game developer team to analyze and resolve potential problems before programming and prototyping. As there is no reimbursement for SG use as a medical treatment [ 69 ], acquiring available funding and resources should be prioritized.

Challenges and Pitfalls of SG Design and Development

Developing appropriate SG educational tools for the specific needs of children with chronic diseases remains a challenge due to the huge investment from ideas to implementation. As the market for SG-based interventions expands across health conditions, there is a trend for SG education to be included as a supportive intervention rather than merely as pure entertainment [ 23 ].

On the basis of our heterogeneous results, the procedure through which SG educational tools deliver content might not be the only key contributor to achieve the targeted goals because the intervention should be focused not only on the learning materials but also on the intertwined mechanism of game elements and the elements of behavioral theory. In the context of game-based learning, self-management practices will be correctly performed if users are enjoying themselves, which means having the propensity to engage, blend, and learn. From this perspective, we raised several considerations on the potential of game elements to enhance intrinsic motivation, including how much autonomy (videos, animations or cartoons, choices, and difficulty adjustments of the challenges) must be given to children during play, how can relatedness (narrative or storyline, avatars, characters, and tailored messages) between children and the game be built into SG educational tools, and how can a child’s level of competence be defined to challenge them.

Several critical points in each step were pointed out for game designers to avoid failure. First, there can be failure to define suitable educative materials and targeted behaviors for children with specific difficulties. Second, one can fail to generate a dynamic between players and the game while, at the same time, players have to obtain new learning from the SG educational tools. Game levels were revealed to engage players with a positive learning effect; however, this should be in line with the player’s skills and cognitive development. A high-challenge game with low-skill, fixed-mindset users may induce frustration; meanwhile, a low-challenge game for users with high skills and a growth mindset may generate feelings of triviality [ 6 ]. Given rapid trends in digital technology, SG prototypes should be continually adjusted to prevent them from becoming hackneyed by the time the evaluation trial is finished.

Safety Concerns for Children in the Post–COVID-19 Era

Safety aspects of SG educational tools should be of general concern because these tools are considered a persuasive technology for changing human behaviors. Game-based interventions appear to be most effective in users aged <18 years [ 23 ]; nevertheless, children and adolescents vary in their ability to master a mission. Children may feel engaged with customizable avatars, but some of these may contain violent characters [ 19 ]. Game designers should ensure that the SG intervention is not dangerous or does not increase risks to children, such as by promoting sedentary or aggressive behaviors [ 47 ] or increasing the risk of physical injuries due to practicing skills. Several harmful risks are associated with sleep disorders and internet gaming disorders, such as anxiety, unsuccessful attempts at control, and jeopardizing environments [ 19 , 70 ].

The American Academy of Pediatrics has stated concerns about the influence of digital media on the health and cognitive development of children at the ages of 0 to 5 years, and it has proposed limiting screen use to 1 hour per day for children aged 2 to 5 years [ 71 ]. It is also recommended to avoid screen time 1 to 2 hours before bedtime for children and adolescents. In 2020, the American Academy of Ophthalmology recommended the 20-20-20 rule, described as a 20-second break every 20 minutes by looking 20 feet away to prevent and relieve digital eyestrain [ 72 ].

The COVID-19 pandemic intensified gaming behaviors among children, especially during school closures, and this garnered the concern of policy makers and health care professionals [ 15 ]. Sedentary time in children with chronic diseases might have increased [ 73 ] as parents were not well prepared for it due to their attention being focused on social and economic burdens caused by the pandemic. Several SG educational tools were developed during the pandemic to stimulate in-home physical rehabilitation [ 74 , 75 ] and improve anxiety and mood disorders in adolescents [ 76 ], and those positive behavioral outcomes should be maintained. Even though the pandemic situation has improved, some parents are continuing to work remotely while simultaneously caring for children, leading to obstacles to maintaining children’s learning, especially in households of a low socioeconomic status [ 77 ].

Educational, game-based interventions for the post–COVID-19 era should be integrated with appropriate recommendations for their use. Individualized family media use plans are strongly recommended; hence, parental control is central when exposing children to digital media [ 70 ]. It is considered important for parents to accompany their children during screen use to foster an effective learning process by understanding the game structure, supporting children in controlling playing times, and monitoring their activities. Instead of giving punishment as a disciplinary matter, by playing together, parents can understand more about SG educational tools and how they can facilitate parent-child interactions. As parents become familiar with their children’s games, they will be able to encourage their children to achieve the intended outcomes and avoid addictive behaviors [ 78 ].

Limitations

This scoping review has a few limitations. This framework was developed based on a review of the most relevant SG educational tools in several RCTs and SG framework studies instead of a direct participatory approach involving health care professionals and children. When comparing the effects of SG educational tools, most RCTs (9/16, 56%) only captured improvements in humanistic outcomes, such as knowledge [ 57 ] and enjoyment. Studies on improving clinical outcomes were limited, and none provided economic outcome evaluations. This is in line with the findings of a previous review that presented a lack of clinical evidence of the implementation of SG educational tools in children with neurodevelopmental disorders [ 79 ]. Several studies (5/16, 31%) evaluated changes in knowledge over a relatively short duration on beneficial effects on behaviors. Exploration is still needed as to which game elements can have higher effects on self-management and behavior changes. Moreover, issues of maintenance of intended behaviors after exposure to SG interventions should be carefully addressed. With the limitations of the available literature, this framework should be tested in further studies.

Implications of the Study and Further Research

This framework provides a theory-driven step-by-step approach to help health educators, clinicians, game developers, and policy makers more efficiently develop SG educational tools for children with chronic diseases. Understanding how to integrate the power of SG educational tools offers significant promise for promoting health behavior changes. Only 4% of the top-rated health apps apply the concepts of gamification [ 80 ], indicating that the opportunity to develop high-quality SG educational tools for children with chronic diseases is still wide open. Further research should explore the needs for culture-specific SG educational tools and investigate the mediators of behavior change.

Conclusions

A framework of SG-based educational tools promoting self-management activities and behavior changes in children with chronic diseases was developed by incorporating behavioral principles and mechanisms of SGs. It expedites the translation of fundamental behavioral theories and game elements into a scaled-up industrial level in which digital-based game interventions are being created to enhance children’s participation and motivation. The effectiveness of SG educational tools in achieving targeted behaviors depends on key designs and elements of how they address problems and mindsets of children with difficulties. Underpinning appropriate behavioral theories, learning materials, game elements, esthetics, and technology should be considered in all phases of research. The design, development, and evaluation of SG educational tools for children with chronic diseases need to be broadly explored with the support of a well-validated game-based framework and the deployment of advanced technologies.

Acknowledgments

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Authors' Contributions

MAS contributed to the conceptualization, methodology, software, validation, formal analysis, writing—original draft, and visualization. YHL contributed to formal analysis and writing—review and editing. FYC contributed to visualization and writing—review and editing. HYC contributed to conceptualization, methodology, formal analysis, resources, writing—review and editing, supervision, project administration, and funding acquisition. All authors contributed to data interpretation and manuscript preparation. All authors read and approved the final manuscript.

Conflicts of Interest

None declared.

Supplementary tables and figures.

Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) Checklist.

  • Ferrante G, Licari A, Marseglia GL, La Grutta S. Digital health interventions in children with asthma. Clin Exp Allergy. Feb 2021;51(2):212-220. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Dall'Oglio I, Gasperini G, Carlin C, Biagioli V, Gawronski O, Spitaletta G, et al. Self-care in pediatric patients with chronic conditions: a systematic review of theoretical models. Int J Environ Res Public Health. Mar 28, 2021;18(7):3513. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Crimarco A, Mayfield C, Mitchell N, Beets MW, Yin Z, Moore JB. Determinants of attendance at a physical activity focused afterschool program in elementary school children. Int J Exerc Sci. May 1, 2018;11(5):137-151. [ FREE Full text ] [ Medline ]
  • Hilliard ME, Hahn A, Ridge AK, Eakin MN, Riekert KA. User preferences and design recommendations for an mHealth app to promote cystic fibrosis self-management. JMIR Mhealth Uhealth. Oct 24, 2014;2(4):e44. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Sarasmita MA, Larasanty LP, Kuo LN, Cheng KJ, Chen HY. A computer-based interactive narrative and a serious game for children with asthma: development and content validity analysis. J Med Internet Res. Sep 13, 2021;23(9):e28796. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Drummond D, Hadchouel A, Tesnière A. Serious games for health: three steps forwards. Adv Simul (Lond). Feb 4, 2017;2(1):3. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Fitzgerald M, Ratcliffe G. Serious games, gamification, and serious mental illness: a scoping review. Psychiatr Serv. Feb 01, 2020;71(2):170-183. [ CrossRef ] [ Medline ]
  • Holtz BE, Murray K, Park T. Serious games for children with chronic diseases: a systematic review. Games Health J. Oct 2018;7(5):291-301. [ CrossRef ] [ Medline ]
  • Charlier N, Zupancic N, Fieuws S, Denhaerynck K, Zaman B, Moons P. Serious games for improving knowledge and self-management in young people with chronic conditions: a systematic review and meta-analysis. J Am Med Inform Assoc. Jan 2016;23(1):230-239. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Bandura A. Health promotion by social cognitive means. Health Educ Behav. Apr 2004;31(2):143-164. [ CrossRef ] [ Medline ]
  • Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. Jan 2000;55(1):68-78. [ CrossRef ] [ Medline ]
  • Dweck CS, Yeager DS. Mindsets: a view from two eras. Perspect Psychol Sci. May 01, 2019;14(3):481-496. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Thompson D. Incorporating behavioral techniques into a serious videogame for children. Games Health J. Apr 2017;6(2):75-86. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Graafland M, Dankbaar M, Mert A, Lagro J, De Wit-Zuurendonk L, Schuit S, et al. How to systematically assess serious games applied to health care. JMIR Serious Games. Nov 11, 2014;2(2):e11. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Dong H, Yang F, Lu X, Hao W. Internet addiction and related psychological factors among children and adolescents in China during the coronavirus disease 2019 (COVID-19) epidemic. Front Psychiatry. Sep 2, 2020;11:00751. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Li X, Vanderloo LM, Keown-Stoneman CD, Cost KT, Charach A, Maguire JL, et al. Screen use and mental health symptoms in Canadian children and youth during the COVID-19 pandemic. JAMA Netw Open. Dec 01, 2021;4(12):e2140875. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Werling AM, Walitza S, Grünblatt E, Drechsler R. Media use before, during and after COVID-19 lockdown according to parents in a clinically referred sample in child and adolescent psychiatry: results of an online survey in Switzerland. Compr Psychiatry. Aug 2021;109:152260. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Zhu S, Zhuang Y, Lee P, Li JC, Wong PW. Leisure and problem gaming behaviors among children and adolescents during school closures caused by COVID-19 in Hong Kong: quantitative cross-sectional survey study. JMIR Serious Games. May 07, 2021;9(2):e26808. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Elsayed W. Covid-19 pandemic and its impact on increasing the risks of children's addiction to electronic games from a social work perspective. Heliyon. Dec 2021;7(12):e08503. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Mummah SA, Robinson TN, King AC, Gardner CD, Sutton S. IDEAS (Integrate, Design, Assess, and Share): a framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. J Med Internet Res. Dec 16, 2016;18(12):e317. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • AlMarshedi A, Wills G, Ranchhod A. Gamifying self-management of chronic illnesses: a mixed-methods study. JMIR Serious Games. Sep 09, 2016;4(2):e14. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. Sep 20, 2010;5:69. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Epstein DS, Zemski A, Enticott J, Barton C. Tabletop board game elements and gamification interventions for health behavior change: realist review and proposal of a game design framework. JMIR Serious Games. Mar 31, 2021;9(1):e23302. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Khaleghi A, Aghaei Z, Mahdavi MA. A gamification framework for cognitive assessment and cognitive training: qualitative study. JMIR Serious Games. May 18, 2021;9(2):e21900. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Carvalho MB, Bellotti F, Berta R, De Gloria A, Sedano CI, Hauge JB, et al. An activity theory-based model for serious games analysis and conceptual design. Comput Educ. Sep 2015;87:166-181. [ FREE Full text ] [ CrossRef ]
  • Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. Feb 2005;8(1):19-32. [ CrossRef ]
  • Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. Oct 02, 2018;169(7):467-473. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Thomas TH, Sivakumar V, Babichenko D, Grieve VL, Klem ML. Mapping behavioral health serious game interventions for adults with chronic illness: scoping review. JMIR Serious Games. Jul 30, 2020;8(3):e18687. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Gunter MJ. The role of the ECHO model in outcomes research and clinical practice improvement. Am J Manag Care. Apr 1999;5(4 Suppl):S217-S224. [ FREE Full text ] [ Medline ]
  • King D, Delfabbro P, Griffiths M. Video game structural characteristics: a new psychological taxonomy. Int J Ment Health Addict. Apr 7, 2009;8(1):90-106. [ CrossRef ]
  • Gomes EL, Carvalho CR, Peixoto-Souza FS, Teixeira-Carvalho EF, Mendonça JF, Stirbulov R, et al. Active video game exercise training improves the clinical control of asthma in children: randomized controlled trial. PLoS One. Aug 24, 2015;10(8):e0135433. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Bartholomew LK, Gold RS, Parcel GS, Czyzewski DI, Sockrider MM, Fernandez M, et al. Watch, discover, think, and act: evaluation of computer-assisted instruction to improve asthma self-management in inner-city children. Patient Educ Couns. Feb 2000;39(2-3):269-280. [ CrossRef ] [ Medline ]
  • Rubin DH, Leventhal JM, Sadock RT, Letovsky E, Schottland P, Clemente I, et al. Educational intervention by computer in childhood asthma: a randomized clinical trial testing the use of a new teaching intervention in childhood asthma. Pediatrics. Jan 1986;77(1):1-10. [ Medline ]
  • Huss K, Winkelstein M, Nanda J, Naumann P, Sloand E, Huss R. Computer game for inner-city children does not improve asthma outcomes. J Pediatr Health Care. Mar 2003;17(2):72-78. [ CrossRef ]
  • McPherson AC, Glazebrook C, Forster D, James C, Smyth A. A randomized, controlled trial of an interactive educational computer package for children with asthma. Pediatrics. Apr 01, 2006;117(4):1046-1054. [ CrossRef ] [ Medline ]
  • Shames RS, Sharek P, Mayer M, Robinson TN, Hoyte EG, Gonzalez-Hensley F, et al. Effectiveness of a multicomponent self-management program in at-risk, school-aged children with asthma. Ann Allergy Asthma Immunol. Jun 2004;92(6):611-618. [ CrossRef ]
  • Yawn BP, Algatt-Bergstrom PJ, Yawn RA, Wollan P, Greco M, Gleason M, et al. An in-school CD-ROM asthma education program. J Sch Health. Apr 09, 2000;70(4):153-159. [ CrossRef ] [ Medline ]
  • Brown SJ, Lieberman DA, Germeny BA, Fan YC, Wilson DM, Pasta DJ. Educational video game for juvenile diabetes: results of a controlled trial. Med Inform (Lond). Jul 12, 1997;22(1):77-89. [ CrossRef ] [ Medline ]
  • Baranowski T, Baranowski J, Chen TA, Buday R, Beltran A, Dadabhoy H, et al. Videogames that encourage healthy behavior did not alter fasting insulin or other diabetes risks in children: randomized clinical trial. Games Health J. Aug 2019;8(4):257-264. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Baranowski T, Baranowski J, Thompson D, Buday R, Jago R, Griffith MJ, et al. Video game play, child diet, and physical activity behavior change a randomized clinical trial. Am J Prev Med. Jan 2011;40(1):33-38. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Weiland A, Reiband N, Schäffeler N, Zurstiege G, Giel KE, Zipfel S, et al. A serious game for the prevention of obesity in school children-impact of parent's involvement: a randomized controlled trial. Life (Basel). May 24, 2022;12(6):779. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Hamari L, Järvelä LS, Lähteenmäki PM, Arola M, Axelin A, Vahlberg T, et al. The effect of an active video game intervention on physical activity, motor performance, and fatigue in children with cancer: a randomized controlled trial. BMC Res Notes. Nov 29, 2019;12(1):784. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Kato PM, Cole SW, Bradlyn AS, Pollock BH. A video game improves behavioral outcomes in adolescents and young adults with cancer: a randomized trial. Pediatrics. Aug 2008;122(2):e305-e317. [ CrossRef ] [ Medline ]
  • Salonini E, Gambazza S, Meneghelli I, Tridello G, Sanguanini M, Cazzarolli C, et al. Active video game playing in children and adolescents with cystic fibrosis: exercise or just fun? Respir Care. Aug 21, 2015;60(8):1172-1179. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Pin TW, Butler PB. The effect of interactive computer play on balance and functional abilities in children with moderate cerebral palsy: a pilot randomized study. Clin Rehabil. Apr 2019;33(4):704-710. [ CrossRef ] [ Medline ]
  • Winskell K, Sabben G, Akelo V, Ondeng'e K, Obong'o C, Stephenson R, et al. A smartphone game-based intervention (Tumaini) to prevent HIV among young Africans: pilot randomized controlled trial. JMIR Mhealth Uhealth. Aug 01, 2018;6(8):e10482. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Thompson D, Baranowski T, Buday R, Baranowski J, Thompson V, Jago R, et al. Serious video games for health how behavioral science guided the development of a serious video game. Simul Gaming. Aug 01, 2010;41(4):587-606. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Baranowski T, Baranowski J, Thompson D, Buday R. Behavioral science in video games for children's diet and physical activity change: key research needs. J Diabetes Sci Technol. Mar 01, 2011;5(2):229-233. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Hansen OG. What gamification design do users want in a self-management application for chronic diseases? - The case of cystic fibrosis. Norwegian University of Science and Technology. 2017. URL: https://ntnuopen.ntnu.no/ntnu-xmlui/handle/11250/2458481 [accessed 2022-04-17]
  • Beristain-Colorado MD, Ambros-Antemate JF, Vargas-Treviño M, Gutiérrez-Gutiérrez J, Moreno-Rodriguez A, Hernández-Cruz PA, et al. Standardizing the development of serious games for physical rehabilitation: conceptual framework proposal. JMIR Serious Games. Jun 24, 2021;9(2):e25854. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Dörrenbächer S, Müller PM, Tröger J, Kray J. Dissociable effects of game elements on motivation and cognition in a task-switching training in middle childhood. Front Psychol. 2014;5:1275. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Starks K. Cognitive behavioral game design: a unified model for designing serious games. Front Psychol. 2014;5:28. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Verschueren S, Buffel C, Vander Stichele G. Developing theory-driven, evidence-based serious games for health: framework based on research community insights. JMIR Serious Games. May 02, 2019;7(2):e11565. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Jaccard D, Suppan L, Sanchez E, Huguenin A, Laurent M. The co.LAB generic framework for collaborative design of serious games: development study. JMIR Serious Games. Jul 02, 2021;9(3):e28674. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Wattanasoontorn V, Boada I, García R, Sbert M. Serious games for health. Entertain Comput. Dec 2013;4(4):231-247. [ FREE Full text ] [ CrossRef ]
  • Bramer WM, de Jonge GB, Rethlefsen ML, Mast F, Kleijnen J. A systematic approach to searching: an efficient and complete method to develop literature searches. J Med Libr Assoc. Oct 04, 2018;106(4):531-541. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Viudes-Carbonell SJ, Gallego-Durán FJ, Llorens-Largo F, Molina-Carmona R. Towards an iterative design for serious games. Sustainability. Mar 17, 2021;13(6):3290. [ CrossRef ]
  • Drummond D, Monnier D, Tesnière A, Hadchouel A. A systematic review of serious games in asthma education. Pediatr Allergy Immunol. May 27, 2017;28(3):257-265. [ CrossRef ] [ Medline ]
  • Caserman P, Hoffmann K, Müller P, Schaub M, Straßburg K, Wiemeyer J, et al. Quality criteria for serious games: serious part, game part, and balance. JMIR Serious Games. Jul 24, 2020;8(3):e19037. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Buday R, Baranowski T, Thompson D. Fun and games and boredom. Games Health J. Aug 2012;1(4):257-261. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Kozma CM, Reeder CE, Schulz RM. Economic, clinical, and humanistic outcomes: a planning model for pharmacoeconomic research. Clin Ther. 1993;15(6):1121-32; discussion 1120. [ Medline ]
  • DeSmet A, Van Ryckeghem D, Compernolle S, Baranowski T, Thompson D, Crombez G, et al. A meta-analysis of serious digital games for healthy lifestyle promotion. Prev Med. Dec 2014;69:95-107. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Espinosa-Curiel IE, Pozas-Bogarin EE, Martínez-Miranda J, Pérez-Espinosa H. Relationship between children's enjoyment, user experience satisfaction, and learning in a serious video game for nutrition education: empirical pilot study. JMIR Serious Games. Sep 17, 2020;8(3):e21813. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Sharifzadeh N, Kharrazi H, Nazari E, Tabesh H, Edalati Khodabandeh M, Heidari S, et al. Health education serious games targeting health care providers, patients, and public health users: scoping review. JMIR Serious Games. Mar 05, 2020;8(1):e13459. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Tabak M, Dekker-van Weering M, van Dijk H, Vollenbroek-Hutten M. Promoting daily physical activity by means of mobile gaming: a review of the state of the art. Games Health J. Dec 2015;4(6):460-469. [ CrossRef ] [ Medline ]
  • Bossen D, Broekema A, Visser B, Brons A, Timmerman A, van Etten-Jamaludin F, et al. Effectiveness of serious games to increase physical activity in children with a chronic disease: systematic review with meta-analysis. J Med Internet Res. Apr 01, 2020;22(4):e14549. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Sattoe JN, Bal MI, Roelofs PD, Bal R, Miedema HS, van Staa A. Self-management interventions for young people with chronic conditions: a systematic overview. Patient Educ Couns. Jun 2015;98(6):704-715. [ CrossRef ] [ Medline ]
  • Brigden A, Parslow RM, Linney C, Higson-Sweeney N, Read R, Loades M, et al. How are behavioural interventions delivered to children (5-11 years old): a systematic mapping review. BMJ Paediatr Open. 2019;3(1):e000543. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Baranowski T, Blumberg F, Buday R, DeSmet A, Fiellin LE, Green CS, et al. Games for health for children-current status and needed research. Games Health J. Feb 2016;5(1):1-12. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Han TS, Cho H, Sung D, Park MH. A systematic review of the impact of COVID-19 on the game addiction of children and adolescents. Front Psychiatry. Aug 18, 2022;13:976601. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Council on Communications and Media. Media and young minds. Pediatrics. Nov 2016;138(5):e20162591. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Boyd K. Computers, digital devices, and eye strain. American Academy of Ophthalmology. URL: https://www.aao.org/eye-health/tips-prevention/computer-usage [accessed 2022-04-18]
  • Duan L, Shao X, Wang Y, Huang Y, Miao J, Yang X, et al. An investigation of mental health status of children and adolescents in China during the outbreak of COVID-19. J Affect Disord. Oct 01, 2020;275:112-118. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • da Silva TD, da Silva PL, Valenzuela EJ, Dias ED, Simcsik AO, de Carvalho MG, et al. Serious game platform as a possibility for home-based telerehabilitation for individuals with cerebral palsy during COVID-19 quarantine - a cross-sectional pilot study. Front Psychol. Feb 2, 2021;12:622678. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Demers M, Martinie O, Winstein C, Robert MT. Active video games and low-cost virtual reality: an ideal therapeutic modality for children with physical disabilities during a global pandemic. Front Neurol. Dec 14, 2020;11:601898. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Dietvorst E, Aukes MA, Legerstee JS, Vreeker A, Hrehovcsik MM, Keijsers L, et al. A smartphone serious game for adolescents (Grow It! App): development, feasibility, and acceptance study. JMIR Form Res. Mar 03, 2022;6(3):e29832. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Oflu A, Bükülmez A, Elmas EG, Tahta E, Çeleğen M. Comparison of screen time and digital gaming habits of Turkish children before and during the coronavirus disease 2019 pandemic. Turk Arch Pediatr. Jan 2021;56(1):22-26. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Király O, Potenza MN, Stein DJ, King DL, Hodgins DC, Saunders JB, et al. Preventing problematic internet use during the COVID-19 pandemic: consensus guidance. Compr Psychiatry. Jul 2020;100:152180. [ FREE Full text ] [ CrossRef ] [ Medline ]
  • Kokol P, Vošner HB, Završnik J, Vermeulen J, Shohieb S, Peinemann F. Serious game-based intervention for children with developmental disabilities. Curr Pediatr Rev. Apr 09, 2020;16(1):26-32. [ CrossRef ] [ Medline ]
  • Edwards EA, Lumsden J, Rivas C, Steed L, Edwards LA, Thiyagarajan A, et al. Gamification for health promotion: systematic review of behaviour change techniques in smartphone apps. BMJ Open. Oct 04, 2016;6(10):e012447. [ FREE Full text ] [ CrossRef ] [ Medline ]

Abbreviations

context-mechanism-output
Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews
randomized controlled trial
self-determination theory
serious game

Edited by S Ma; submitted 06.06.23; peer-reviewed by R Gorantla, K Spruyt, T Baranowski; comments to author 20.12.23; revised version received 13.04.24; accepted 25.06.24; published 19.08.24.

©Made Ary Sarasmita, Ya-Han Lee, Fan-Ying Chan, Hsiang-Yin Chen. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 19.08.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.

COMMENTS

  1. Design and Development Research

    Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

  2. Design and Development Research : Methods, Strategies, and Issues

    Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

  3. Design and Development Research: Methods, Strategies, and Issues

    Request PDF | On Jul 16, 2014, Rita C. Richey and others published Design and Development Research: Methods, Strategies, and Issues | Find, read and cite all the research you need on ResearchGate

  4. Design and Development Research: Methods, Strategies, and Issues

    Design and development research: a model validation case. M. Tracey. Computer Science, Education. 2009. This is a report of one case of a design and development research study that aimed to validate an overlay instructional design model incorporating the theory of multiple intelligences into….

  5. Design and Development Research: Methods, Strategies, and Issues

    Design and Development Research thoroughly discusses methods and strategies appropriate for conducting design and development research. Rich with examples and explanations, the book describes actual strategies that researchers have used to conduct two major types of design and development research: 1) product and tool research and 2) model ...

  6. Design and Development Research : Methods, Strategies, and Issues

    Design and Development Research: Methods, Strategies, and Issues Rita C. Richey , James D. Klein Limited preview - 2014 Rita Richey , James D. Klein No preview available - 2007

  7. Design and Development Research

    Design and development research is an umbrella term for a wide range of studies that employ an assortment of traditional quantitative and qualitative research methods and strategies. Most design and development research, however, tends to rely more on qualitative strategies and deals with real-life projects, rather than with simulated or ...

  8. Design and Development Research 1st Edition

    Design and Development Research: Methods, Strategies, and Issues 1st Edition is written by Rita C. Richey; James D. Klein and published by Routledge. The Digital and eTextbook ISBNs for Design and Development Research are 9781136791284, 1136791280 and the print ISBNs are 9780805857320, 080585732X. Save up to 80% versus print by going digital with VitalSource.

  9. Design and Development Research: Methods, Strategies, and Issues

    AECT Design & Development Outstanding Book Award for 2008! Design and Development Research thoroughly discusses methods and strategies appropriate for conducting design and development research. Rich with examples and explanations, the book describes actual strategies that...

  10. Design and Development Research Methods, Strategies, and Issues

    It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field. Table of Contents. Contents: Preface. An Overview of Design and Development Research. Identifying Design and Development Research Problems.

  11. Design and Development Research : Methods, Strategies, and Issues

    Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field."

  12. A Guide for Novice Researchers: Design and Development Research Methods

    The aim of this paper was to provide a guide to novice researchers on design and development. research. The value and role of design and deve lopment research within the domain of informa-. tion ...

  13. Design and Development Research by Rita C. Richey (ebook)

    Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

  14. Design and development research : methods, strategies, and issues

    Summary: This volume thoroughly discusses methods and strategies appropriate for conducting design and development research. Rich with examples and explanations, the book describes actual strategies that researchers have used to conduct: 1) product and tool research and 2) model research.

  15. Design and Development Research (DDR) For Instructional Design

    Product, Program, and Tool Research. Ellis and Levy (2010) asserted that DDR must go beyond commercial product development by determining a research problem, based on existing research literature and gaps in the literature that researchers assert must be studied to add to the instructional design knowledgebase.

  16. Design and Development Research: Methods, Strategies, and Issues

    Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

  17. Design and Development Research by Richey, Rita C

    Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

  18. Research progress and intellectual structure of design for digital

    The current research interest in DDE lies in evidence-based co-design practices, design issues in digital mental health, acceptance and humanization of digital technologies, digital design for ...

  19. Design and Development Research: Methods, Strategies, and Issues by

    Design and Development Research: Methods, Strategies, and Issues by RICHEY, RITA C, Klein, James D. (2007) Paperback on Amazon.com. *FREE* shipping on qualifying offers. Design and Development Research: Methods, Strategies, and Issues by RICHEY, RITA C, Klein, James D. (2007) Paperback

  20. Sustainability

    Higher education institutions, as organizations that transform society, have a responsibility to contribute to the construction of a sustainable and resilient world that is aware of the collateral effects of technological advances. This is the initial phase of a research that aims to determine whether subjects in the complementary training area have a significant effect on ethical, social ...

  21. Asset management for storm surge barriers: how and why?

    Given the study's objective to investigate the application and development of AM for SSBs, case study research was identified as the most suitable approach. It aligns with authors exploratory and explanatory goals, as it is well-suited for addressing 'how' and 'why' questions and comprehensively studying a phenomenon within its real life ...

  22. design_and_development_research-methods,_strategies,_and_issues

    Design and Development Research is appropriate for both experienced researchers and those preparing to become researchers. It is intended for scholars interested in planning and conducting design and development research, and is intended to stimulate future thinking about methods, strategies, and issues related to the field.

  23. Journal of Medical Internet Research

    Background: Digital serious games (SGs) have rapidly become a promising strategy for entertainment-based health education; however, developing SGs for children with chronic diseases remains a challenge. Objective: In this study, we attempted to provide an updated scope of understanding of the development and evaluation of SG educational tools and develop a framework for SG education ...