29th Annual Meeting
Acknowledgements
Officers
Proceedings List
Participants
2000 Proceedings Home





10:00-10:50 a.m. SCHOOL REFORM (Discussion Session) Salon A

Presider: Beverly Klecker, Kentucky Department of Education

IMPLEMENTATION OF GRADUATION 2010: YEAR THREE

Mary H O'Phelan, Mary O'Phelan, Antony D. Norman, and Gayle W. Ecton, Western Kentucky University

             In 1997, a steering committee of educators and citizens examined research findings in the area of brain development and identified ways to enhance student learning. Originally, eight separate committees were formed, and each one came up with recommendations for new initiatives to be installed in the schools of the district. The eight strands were music, the arts, foreign language, thinking skills, family involvement, health and emotional health, reading and language development, and community involvement. The 1999-2000 school year was the third year of implementation of this project called Graduation 2010. Graduation 2010 has received much attention from educators, legislators, and the media.
             The authors have served as the evaluation team to document the program's implementation and progress over the years. This presentation reported on the third year of implementation of the eight strands at the elementary schools in the district. The twelve elementary principals and the district superintendent were asked to rate the implementation of the program goals from "0" (no implementation) to "5" (full implementation). Based on survey results, implementation was classified as low, moderate, or high for each strand. Over the three years, the surveys used for data collection have been modified to reflect changes in the program including new initiatives and refined or discontinued goals. Results of the third year implementation surveys were presented and discussed by strand, by school, and compared with results of the previous two years. Problems encountered with assessing implementation were discussed, and the audience was encouraged to share ideas and join in the discussion.

BECOMING A RESTRUCTURED DISTRICT - EXPLORING THE DISTRICT ROLE IN COMPREHENSIVE SCHOOL REFORM

Scott C Bauer, University of New Orleans

             While there is a consensus that school improvement must focus on the school as the center of change activity (Sirotnick, 1989), less attention is focused on the role of the district or the effect of school-based restructuring on central office administrators (Murphy, 1994). This paper presented the results of a study focusing on central office administrators' participation in implementing a comprehensive school reform (CSR) model in the districts' schools and the impact of CSR on the role of these administrators. The central research question examined involved discerning how to mobilize district-level stakeholders and organizational processes to support whole-school change across a school system.
             Data were collected through structured interviews of all district administrators (n=13) in a central Louisiana school system, through observation of schools engaged in adopting a national reform model, and in feedback sessions with groups of administrators. Findings were organized into three categories, dealing with: (1) strategic, (2) administrative, and (3) human resource capacity-building throughout the system.
             Findings revealed that administrators were unsure of their role in CSR. They felt ill-informed about what was going on in the schools and raised important questions about the administrative support they could provide given their positions. Further, they observed that existing administrative practices did not support CSR and school-based decision making and believed that they could play a role in redesigning these processes if given the information and opportunity to participate.


SITE-BASED NEEDS ASSESSMENT: A PRACTICAL MODEL FOR THE APPRAISAL OF THE SCHOOL PROGRAM BY ITS STAKEHOLDERS

Leslie L. Griffin and James W. Nicholson, Jr., Delta State University

             The study was designed to determine if a comprehensive needs assessment instrument could be used at a school site to involve all stakeholders in an in-depth self-study of school programs and climate.
             The instrument was developed for the school setting by a regional education consortium that provided training and technical assistance to member schools. The instrument included the following components: (1) Instructional Leadership, (2) Curriculum and Instructional Management, (3) Instructional Program Delivery, (4) Program Evaluation by Pupil Achievement, (5) School Learning Climate, (6) Staffing/Personnel, (7) Staff Development, (8) Instructional Schedule, (9) Community Resources, and (10) Facilities. Each component was comprised of questions designed to gather information on factors pertinent to the area under investigation. Responses were substantiated with evidence.
             The instrument was used to assess an elementary school with 439 students in grades Pre-K through sixth grade. The staff included two administrators, 26 teachers, and 15 teacher assistants. Parents and other noninstructional staff provided information relevant to several of the components.
             The primary researcher for the project initially met with stakeholders to review sample items from the assessment instrument. Thereafter, periodic site visits were made to direct and assist stakeholders in collecting data, both qualitative and quantitative. Classroom observations were made, documents reviewed, and artifacts collected as evidence for each factor addressed in a component.
             Evidence was analyzed, and recommendations were made related to each factor. Conclusions were drawn for the area being assessed and broad recommendations were made. A comprehensive report describing the school's program and climate provided a reference for stakeholders to use as they reform school programs and improve the school climate.
             The comprehensive needs assessment instrument provides a model for schools desiring to conduct a self-study involving all stakeholders.


10:00-10:50 a.m. ATTITUDES (Symposium) Salon B

Presider: Stephanie Smith, Mississippi State University

INVESTIGATING THE VARIABLES THAT AFFECT TREATMENT INTEGRITY
Investigating the Variables that Affect Treatment Integrity
Stephanie L. Smith, Mississippi State University
The Effects of Behavioral versus Non-behavioral Phrasing on Treatment Acceptability
Lorrie A. Howell, Mississippi State University
Changes in Treatment Acceptability Ratings of an Intervention Described in Behavioral vs. Humanistic Jargon
Stephanie L. Smith, Mississippi State University
Treatment Acceptability as rated by Elementary School Teachers of an Intervention framed Behaviorally or Humanistically
Stephanie L. Smith, Mississippi State University


             The current literature suggests that the way in which a proposed treatment is framed (i.e., behaviorally or humanistically) may affect the degree to which the intervention is implemented by teachers. The authors investigated the affect of behavioral versus humanistic jargon on the reported acceptability of an intervention as rated by pre-field experience, post-field experience, and mentoring school teachers. Two versions of an intervention, differing only by behavioral versus humanistic terms, were presented to each participant. Treatment acceptability of each description was assessed using the Behavioral Intervention Rating Scale (BIRS). An interpolated task was completed to reduce carry-over effects. The investigators found that at the post-field experience level, student teachers rated the behaviorally framed description as less acceptable than the humanistically-framed description. At the pre-field experience level, student teachers did not report any differences in acceptability of the two descriptions of the intervention. However, the same students after their field experience reported a negative bias against the behavioral description of the intervention compared to the humanistic description. The investigators speculated that this bias against behavioral framing may originate through the interaction with the mentor teachers. The teachers that served as mentors for the field-experience students rated the acceptability of the behavioral and humanistic descriptions of the intervention. The mentor teachers reported a negative bias on acceptability ratings of the behavioral description when compared to the ratings of the humanistic description. The authors concluded that terms used to frame an intervention affect the reported acceptability of that intervention. Although both descriptions of the intervention were comprised of the same components, participants rated them differently as a function of their jargon. Both samples of student teachers reported a negative bias against behavioral jargon at the post-field experience level. One of these samples was surveyed at the pre-field experience level, and no differences were observed in acceptability ratings of behavioral and humanistic frame.
             The authors concluded that field experience in the schools changes future teachers' attitudes toward behavioral jargon. Consultants who propose interventions to teachers need to be sensitive to this bias against behavioral jargon as it affects treatment acceptability and possibly treatment integrity.

10:00-10:50 a.m. ADULT EDUCATION (Discussion Session) Meeting Room 1

Presider: Rod Roth, The University of Alabama

PERSPECTIVES ON MIDLIFE DEVELOPMENT

Wendy L. Jordanov, The University of Memphis

             Adult development during middle age is of interest to psychologists, sociologists and many individuals faced with this age or stage of life. Throughout the past 40 years, numerous theorists have shared their perspectives about adult development and middle age. This paper addressed the methodologies and research conclusions of Erikson, Neugarten, Gould, Levinson, Fiske, Vaillant, and Livson. Experiences and challenges that are often expected at midlife are reported. In addition, suggestions of how adults can prepare themselves to age more successfully are discussed.
             One theorist used a clinically-based model, while others used cross-sectional or longitudinal research methods to arrive at their theories. Four theorists chose an age-based approach while three focused on the stages of development. Two theorists noticed no "important" differences in males and females while the others each reported unique characteristics in the development of men and women.
             Experiences and challenges of middle age reported by the theorists were reviewed. Some of the challenges that adults in midlife may experience include recurring themes of identity, intimacy and integrity, a switch in focus to time-left-to-live rather than time-since-birth, a tendency for individuals to increase self-protectiveness as they age, and the painful press of society on individuals wanting to discover themselves. Additional experiences were addressed.
             Recommendations for adults facing midlife are offered by several of these theorists. Some of the suggestions are that adults should strive for balance and self-actualization, set boundaries, move toward egocentricism, develop executive processes, increase self-protectiveness, seek solitude, reevaluate commitments, and maintain flexibility. Additional recommendations were addressed.

THE STRUCTURE OF ACADEMIC VARIABLES AMONG COLLEGE STUDENTS: A META-ANALYTIC APPROACH

Jwa K. Kim, Angelique M. Martinez, and Shelly S. Spaulding, Middle Tennessee State University

             The weighted effect size between college students' grade point average (GPA) and the standardized test scores such as Scholastic Aptitude Test (SAT) and American College Test (ACT) was examined through meta-analysis in various settings. Also explored were the general trend and structure of the published articles concerning the relationship between academic achievement in college and SAT or ACT. A total of 22 published articles between 1987 and 1997 were included for meta-analysis.
             Analysis revealed the effect size of .28 between college GPA and SAT/ACT for the total group with sample size (n) of 108,493. The effect size for the male group, female group, and mixed group was .32 (n = 15,373), .34 (n = 12,890), and .27 (n = 80,230), respectively. In computing the effect size between college GPA and SAT/ACT, using either SAT or ACT resulted in almost identical numerical point: effect size with SAT was .28 (n = 96,286) and with ACT was .29 (n = 12,225). The general trend and structure of published articles in the area of college GPA and SAT/ACT were investigated with respect to journal name, author's name, and year of publication.
             Characteristics of each subgroup in terms of effect size as well as general trend and structure were discussed in conjunction with previous findings. This study disclosed useful information through meta-analysis in the field of college students' academic performance including college GPA, SAT, and ACT.

10:00-10:50 a.m. RESEARCH/STATISTICS (Discussion Session) Meeting Room 2

Presider: Ernie Rakow, The University of Memphis

VIEWING QUANTITATIVE DATA THROUGH QUALITATIVE EYES

Randy Parker, Louisiana Tech University

             School districts, educational, and government organizations, as well as private groups, generate and keep tremendous amounts of data on a regular basis and for a variety of purposes. It is, however, the interpretation of these data that provides understanding and meaning to phenomena and allows researchers to draw appropriate conclusions. The purpose of this paper was to put forth the position that qualitative researchers, in their quest for understanding, have too often viewed official statistics with only a cursory or descriptive analysis without deeper reflection or critical analysis as to the assumptions of the persons who collect and use quantitative data.
             The assumptions and methodological paradigms of researchers influence their decisions in data collection, analysis, and interpretation. Constructivists and critical theorists should find this approach useful in determining how statistics support, contradict, or are inconsistent with participants' worldviews. Just as insight can be gained by looking at the reasons why photographs were taken or saved, viewing quantitative data from a qualitative perspective allows the researcher to examine how enumeration is used by participants in constructing reality. Considering the social processes involved in numerical data collection, as well as, the effects of quantification on how people in varying levels of an organization think, act and react to these processes can provide insight into phenomenological understanding.
             Viewing numerical data qualitatively suggests several questions: (1) How is what to count and how to count it decided? (2) How does counting influence the meaning of events or affect activities? (3) How are rates related to social and historical contexts or social forces? (4) How is a count understood within an organization? and (5) What is the symbolic meaning of counting to the various participants? Viewing quantitative data through qualitative eyes can guide an inquiry that expands rather than confines understanding.


NAVIGATING ELECTRONIC SURVEY METHODS: THREE PILOT STUDIES

Louis A Franceschini, Memphis (TN) City Schools

             Increasingly widespread access to email and the World Wide Web and the ready availability of special-purpose software are two conditions prompting educators to examine the relative advantages of surveying electronically. Using an integrated package called Survey Solutions for the Web, researchers affiliated with a large urban school district undertook a trio of "modal" studies to investigate such hypothesized efficiencies empirically.
             Embedded in a survey of district principals, an initial pilot sought to compare the speed, efficiency, and rate and quality of response of Web- and paper-based questionnaires. While the overall response rate to the questionnaire was low (and that of the treatment group lower than the control's) the Web-based responses were received more quickly and were processed with greater dispatch. No modal effect was observed with respect to the questionnaire's directed response items; nevertheless, the quality of response on the questionnaire's open-ended items was pronounced in favor of the treatment group. When asked about the likelihood of future Web-based surveys, some 64% of the respondent pool answered affirmatively, only 16% negatively.
             In a second pilot, nine faculties were queried via a disk-based, computerized self-administered questionnaire (CSAQ). While return of the materials did not exceed conventional expectations, back-end processing of the data was markedly facilitated. Moreover, as roughly 93% of the disks and diskette mailers presented themselves for reuse, the unit cost per survey was determined to be less than that for paper-based alternatives.
             A final pilot examined the utility of electronic methods in enabling "data driven school improvement." At each of two schools, a stratified random sample of children was administered a Web-based, "school climate" instrument. Uniformly, children evidenced little difficulty in negotiating its interface and were observed to prefer the electronic method almost unanimously. Among faculty, however, the CSAQ was rated the more "user friendly" alternative.

CHARACTERISTICS OF ITEM RESPONDENTS WHO FREQUENTLY UTILIZE MIDPOINT RESPONSE CATEGORIES ON RATING SCALES

Gail H. Weems, The University of Memphis, and Anthony J. Onwuegbuzie, Valdosta State University

             A fervent debate among instrument developers/psychometricians involves the validity of midpoint response categories on scales. Proponents of midpoint options contend that the midpoint increases measurement reliability (Courtenay & Weidemann, 1985) and that the exclusion of the midpoint choice provides a viable option for respondents who genuinely do not have an opinion regarding a particular item, preventing them from "artificially creat[ing] opinions" (de Vaus, 1990, p. 85). Opponents assert that midpoints provide respondents with a way to respond with minimal thought to their responses, culminating in a "piling on the midpoint" (Alreck & Settle, 1985, p. 156) when opinions are not firm, thereby attenuating score reliability (Alwin & Krosnick, 1991). The midpoint controversy likely stems from its seemingly ambiguous meaning. Specifically, the midpoint could imply "neutral," "don't know," "don't care," or "no opinion."
             Researchers have examined the effect of the use and location of midpoint options on score reliability and validity. However, little is known about factors that prevail in making midpoint choices. Thus, this study investigated characteristics of respondents who frequently utilize midpoint categories on rating scales. Also of interest was to examine the effect of including/excluding midpoint choices on item mean and reliability. An additional objective was to determine the effect of utilizing reverse-code items on scale mean and reliability.
             Several datasets were analyzed, yielding many findings. For example, a sample of 77 students revealed that those who most frequently utilized the midpoint option on a 45-item, five-point Likert-format measure of research anxiety tended to be tactile/kinesthetic learners, with negative self-perceptions about their academic competence, who were not self-oriented perfectionists but were socially-prescribed perfectionists, and who lacked persistence. Another sample of 522 students responding to a 43-item, five-point Likert-format measure of library anxiety indicated that elimination of the midpoint option did not increase score reliability. Implications of these and other findings were discussed.

10:00-10:50 a.m. TECHNOLOGY (Display Session) Meeting Room 4
CONDUCTING SURVEY RESEARCH VIA THE INTERNET

Margaret L. Rice, Vivian H. Wright and Elizabeth K. Wilson, The University of Alabama; Jay Cofield, University of Montevallo; and Suzanne P. Stokes, Troy State University

             Researchers in many disciplines have long used surveys to collect research data. In the past, the most common ways of administering the surveys were by mail or phone, both of which can be expensive and time consuming. The advent of the Internet has provided researchers with the ability to conduct surveys that reach a wider population, have a faster turn around time, are less expensive, and require less time.
             Many of the problems associated with traditional data collection methods also affect online data collection, including difficulty in contacting potential participants, non-communication or non-participation by individuals contacted, and being sure you have a representative sample. However, the Internet has advantages over traditional methods: (1) it is generally faster, (2) it is less expensive than phoning or mailing methods, (3) it provides the researcher with the ability to contact wider geographical areas and (4) it provides more accurate data and saves time if the data are transferred automatically from the survey to a database. Thach (1995) analyzed the use of electronic mail to conduct survey research and found it to be cheaper, easier to edit, faster to administer, and simpler to invite participants; it had a higher response rate, more candid answers, and a potentially quicker response time with a wider area of coverage.
             This presentation provided step-by-step instructions on how to create and upload Internet survey forms and how to have the data from the surveys automatically loaded into an existing database. Various projects in which this data collection method was used were discussed.

COMPRESSED VIDEO INSTRUCTION: TRENDS, ISSUES, AND PEDAGOGICAL IMPROVEMENTS

J. Gordon Nelson and Franklin King, Jacksonville State University

             Compressed Video (CV) is a new teleconferencing system allowing for interactions between instructors and students on and off campus. Although universities are becoming more interested in this type of "distance learning" course delivery, little research has been conducted to investigate the effectiveness of this method. In January 1997, Alabama's Jacksonville State University (JSU) established a compressed video network serving four different locations and offering four graduate courses. Since then, several more sites have been added. By summer 2000 there were twelve sites and an average of five courses each semester. Three years of teaching CV courses has provided an opportunity to identify and solve problems unique to successful teaching with this format.
             In spring 2000, a survey was taken to assess the attitudes of graduate students toward a CV class they had taken. This survey was identical to the earlier survey taken in the spring 1997, thus providing an opportunity to compare results at a three-year interval. Trends were analyzed and information gained on several variables; among them, instructor concerns, student attitudes, and course improvements. One major concern was the monitoring of on/off-task behaviors of off-campus students. Survey results indicated that multimedia presentations (e.g., PowerPoint) were found to be well suited to the CV format with off-site students viewing TV monitors, and that these multimedia presentations were highly effective in monitoring student attention in the off-campus sites. Students were enthusiastic, attentive, and interested in the multimedia-presented lectures and interactions. Instructors were also enthusiastic with their presentations.
             This display presented data and issue trends from both surveys, information on JSU-CV hardware and software, and examples of successful multimedia techniques for CV courses. The general finding indicated improved satisfaction in all areas, largely due to multimedia pedagogical techniques.

AUTOMATING DISTRICT-LEVEL REPORTS FOR A STATEWIDE ACCOUNTABILITY PROGRAM

Michele G. Jarrell, The University of Alabama at Birmingham

             The display traced data from student-level results on statewide tests through data analysis, criteria setting, model runs, data export from SAS, data formatting in BASIC, and production of final district-level reports using Microsoft WORD macros. This is a system that has been used in a state program for several years with good results. The original reporting system was developed in WordPerfect but has been adapted to Microsoft WORD. The system prevents hand entering data for numerous performance variables, thus eliminating data errors in the district reports. The reports list each variable with its criterion, the district's score, and a flag indicating whether the district met the variable. District accountability ratings are also calculated and reported.
             The system shows how much simpler reporting results can be when one uses all of the features of various computer programs.

10:00-10:50 a.m. PUBLICATION (Training Session) Meeting Room 5
WRITING AND GETTING PUBLISHED

John R. Petry, The University of Memphis

             Training centered around opportunities and problems associated with writing and publishing articles and manuscripts. Topics included sources of ideas for research and writing, guides for effective writing, proofing and editing a manuscript, publication sources, preparing a manuscript, methods for submitting manuscripts, criteria for evaluating manuscripts, and ethics in authorship and publishing. Other topics included elements of style, such as elementary roles of usage, principles of composition and form, an approach to style, and faults in scholarly writing. The use of the computer in writing and editing was explored.
             Objectives of the session were to increase the awareness of attendees about opportunities to publish, raise standards for writing quality manuscripts, and establish minimum guidelines for professional growth. Use of technology was of primary value, including electronic publication.
             Activities included a diagnosis of the basic writing skills of attendees, analysis of articles ready for submission to publications, and administration of a predictive measure for publication success. Sources for publishing were presented and discussed. Publication sources were identified that gave the manuscript submitters a higher chance of achieving success for acceptance. Participants' manuscripts were evaluated for their content, style, impact on the reader, value to the scholarly community, and importance as a contribution to literature.