Distance Learning Survey Results - Statistical Data Included

DISAM Journal, Spring, 2001 by Commander Patrick K. Hawkins

Introduction

In April 2000 the Defense Institute of Security Assistance Management (DISAM) undertook the task to determine the training needs of the security assistance community. To accomplish this task a security assistance training survey was developed to quantitatively assess the training needs in terms of course delivery methodology. DISAM currently uses a traditional classroom instructional method of teaching at the DISAM facility on Wright-Patterson, AFB, Ohio and various on-site locations throughout the world. DISAM as well as many other activities throughout the world are relying more heavily on the internet and telecommunications technologies. Subsequently, it is a natural progression to explore the possibility of using these technologies to provide training to distant locations at reduced cost, increased efficiency and convenience.

DISAM collected data from respondents using the commercially available software program, Perseus Survey Solutions for the web V2.0, a product of Perseus Development Corporation. This program allowed for the creation and distribution of survey information by collecting, analyzing and reporting results to the survey administrator. The Perseus program allowed for the establishment of a collection file, which was downloaded and the data set was analyzed for trends. The format of the survey allowed the respondent to answer the various questions as well as defining specific goals that were desired. Respondents were asked to note their preferences for studying multimedia lessons delivered via the personal computer either in the workplace or at home. DISAM did not record or maintain data on the identity of the respondent, ensuring complete anonymity. Data were collected over a period of several months.

Data Collection

Data collection was straightforward. Each respondent was requested to identify the organization or assignment which best described their work location, number of years working in security assistance, and grade or rank. In addition, the respondent was requested to respond to a number of questions concerning prior attendance in formal DISAM training courses, either in resident at Wright-Patterson AFB or one of the numerous on-sites. Each respondent was requested to respond to having previous experience with distance learning or web-based training and if the respondent had a preference to either internet/web or CD-ROM media format. The survey asked if the respondent would participate in security assistance training via the internet/web or CD-ROM and if their preference was to study during duty hours, off duty hours or a combination. Finally the respondent was asked if the virtual classroom were provided, which topics in security assistance would be most beneficial to the respondent and were any other topic area s that were not covered that needed to be covered in the virtual classroom.

Results

A total of 274 responses were received on the survey with the majority, 62 percent, from three general organizations, SAO/DAO, implementing agencies and DoD field activities. (Figure 1). Of the 274 responses over 50 percent (139) had five or more years in a security assistance related position and additional 59 (21.5 percent) between one and three years of experience. (Figure 2) Of the respondents 36.5 percent were in pay grades GS-12/13 or O-3/4 which is consistent with the known demographics for the security assistance community. (Figure 3) GS-14 or O-5 made up an additional 17.2 percent. Most had attended at least one traditional DISAM course during their career (56.2 percent) with 23 percent attending three or more. (Figure 4) Most, 65.7 percent, have never previously participated in distance or web-based training. (Figure 5) If given a preference to a mode of either web-based (internet) and/or CD-ROM media, most respondents 62 percent indicated either internet/web or CD-ROM was acceptable. (Figure 6) An additional 20.4 percent indicated only the internet as an acceptable medium. CD-ROM was the least acceptable with 15.3 percent. (Figure 7) When asked if they would participate in security assistance training via internet/web or CD-ROM-based Virtual Classroom, an overwhelming 84.7 percent responded favorably. Those responding favorably to the distance learning alternative indicated a preference for either during regular duty hours (46.0 percent) or a combination of both on and off-duty (38.7 percent), while 12.8 percent indicated a preference for off-duty hours only. (Figure 8).

In addition to general questions concerning preferences, the survey requested the respondents to indicate topics they would be most interested in if the CONUS Orientation course were offered via Virtual Classroom. Overall, the average response was favorable with an average of 3.1 on a scale which ranged from 1 (not at all interested) to 5 (completely interested). (Graphs 1 and 2). The respondents were required to grade each topic area currently offered in the CONUS Orientation course and indicate their level of interest. The most requested topics were foreign military sales process (3.7), foreign policy, legislation, and the security assistance budget (3.6), FMS agreements - terms and conditions (3.5), FMS acquisition policy and process (3.5) and security assistance funds management (3.4). The least favorable were topics on introduction to security assistance (3.1), introduction to the security assistance organization (3.1) and international armaments cooperation program (3.1). Even though these three topics exhibited the lowest overall scores an average 3.1 indicates a moderate interest in the subject topics.