Assessment in Engineering Education: Evolution, Approaches and Future Collaborations

Journal of Engineering Education, Jan 2005 by Olds, Barbara M, Moskal, Barbara M, Miller, Ronald L

ABSTRACT

This article examines the current state of assessment in engineering education in the United States as reflected in the Journal of Engineering Education. We begin with a brief review of recent developments in the assessment of engineering education and the events that have inspired change. Next, we explore assessment methodologies that have been used repeatedly in the evaluation of engineering courses, curricula, and research investigations as well as some methods that have not been used extensively but are likely to be informative. We conclude with a discussion of the importance of establishing collaborations between researchers in engineering education and educational research. Throughout this paper we highlight examples of sound and rigorous assessments in engineering education.

Keywords: assessment, evaluation, engineering education

I. INTRODUCTION

The advancement of engineering education in many ways depends on assessment. High-quality assessments can provide educators with information they can use to move the field forward. Inadequate or poorly constructed assessments can cause educators to pursue ineffective paths, resulting in the loss of time, money, and energy. Researchers have also recognized the central role that assessment plays specifically in engineering education. According to Felder, Sheppard, and Smith, "Research, by its nature, requires effective assessment. The infusion of accepted principles and practices of educational assessment are having a significant impact on the development of engineering curricula and the evaluation in terms of student performance" [1]. We use examples from recent articles published in the Journal of 'Engineering Education (JEE) to examine current assessment practices and methods in engineering education in the United States. We acknowledge the many contributions to the literature on the assessment of engineering education that have been reported in other venues, both within engineering education and external to engineering education (pre-collcge educational research, national studies, etc.) However, we have elected to limit our discussion to articles published m JEE because of considerations for the length of the paper and because JEE offers a rigorous review process with an emphasis on engineering education. The purpose of this article is not to present a comprehensive literature review about assessment, but rather to highlight good practices within engineering education as reflected through JEE and to suggest some possible future directions and challenges. Because of the central nature of assessment to engineering education, several other articles in this issue address assessment as a related topic.

The language of assessment can vary slightly from author to author. Therefore, we begin this discussion with a definition, taken from Rogers and Sandos [2], of three key terms as they are used within this paper. The term assessment is used here to refer to the act of collecting data or evidence that can be used to answer classroom, curricular, or research questions. In other words, we use the term assessment in a broader sense than measuring individual student's competencies, such as scores on a classroom exam or homework assignments. Assessment methods are defined here as the procedures used to support the data collection process and are an important consideration in any educational research design. Evaluation, which is often used synonymously with assessment, refers to the interpretations that are made of the evidence collected about a given question. A complete summary of the assessment terms and definitions used in this paper appears in the Appendix.

In the next section, we provide a brief review of recent developments in the assessment of engineering education and reflect upon the events that have inspired change. Events of interest include the accountability mandates of the mid-1980s and recent changes in the engineering accreditation process instituted by ABET. Depending upon the setting and the purpose of the assessment, different methodologies are likely to be appropriate. The majority of this paper is dedicated to a discussion of assessment methodologies that have been used in engineering education. We conclude with a discussion of the importance of establishing collaborations between researchers in engineering education and educational research.

II. RECENT DEVELOPMENTS IN ASSESSMENT IN ENGINEERING EDUCATION

Since approximately the mid-1980s, there has been increasing pressure on institutions of higher education to be accountable to their constituents, including state higher education commissions, alumni, students, parents, and accreditation agencies. Accountability in this context refers to institutions taking responsibility for and demonstrating the effectiveness of their educational programs. Many states (for example, Tennessee and Colorado) passed laws in the late '80s requiring public universities to provide annual reports on their assessment of student outcomes. A quick examination of the guidelines for any of the regional accreditators, such as the Southern Association of Colleges and Schools and the Higher Learning Commission of the North Central Association, reveals a strong emphasis on outcomes-based assessment. In addition, many professional accreditation groups, including engineering, now require the assessment of student outcomes as part of their accreditation process.