This file was prepared for electronic distribution by the inforM staff.
Questions or comments should be directed to inform-editor@umail.umd.edu.

                           CHAPTER TWO

                     UNIVERSITY OF COLORADO 
                      PERSONALIZED LEARNING

               BY MARCIA WESTKOTT AND GAY VICTORIA

     The University of Colorado takes an approach to "The
     Courage to Question" that is more descriptive than
     evaluative. Rather than ask, "What are our goals for
     student learning, and how well are we achieving them?"
     the program asks a more basic question: "From the
     standpoint of student learning, what do we actually do?"
     The report includes a history of the program's experience
     with assessment; an explanation of their descriptive
     focus and results of the process; and current and ongoing
     implications of the project. The report also places the
     project within the context of recent reports on reform in
     higher education.

      HISTORY OF ASSESSMENT IN THE WOMEN'S STUDIES PROGRAM 

The University of Colorado is located in Boulder, Colorado, with an
enrollment of 25,571 students. Its student body is primarily white
(87.5 percent), middle class, and native to Colorado. Women
constitute 46 percent of the student population. Sixty-one percent
of the undergraduate students at CU-Boulder receive some type of
financial aid. CU-Boulder employs 1,094 full-time faculty members
and is considered the leading comprehensive re- search university
in the Rocky Mountain region and among the top public universities
in the country in gaining federal research support. The campus has
several active women's organizations and clubs, although it has no
women's center. The major campus program identified with women is
the Women's Studies Program.

The Women's Studies Program was founded in the early 1970s by a
group of faculty members, students, and community members. By the
fall of 1974, a full time director had been appointed. The
curriculum reflected a national pattern. which the program has
since maintained: interdisciplinary core courses with a women's
studies rubric and courses offered by departments and cross-listed
with women's studies. In 1979, the Women's Studies Program was
subsumed with eleven other programs under the Center for
Interdisciplinary Studies, which was maintained as an umbrella unit
until Student demand for courses reflects both the expanding
scholarship and the social concerns that scholarship addresses

1985 when the center was abolished. Since 1985, women's studies has
grown considerably as an independent program, increasing the number
of majors from twenty-five in 1984 to seventy in fall of 1991 and
employing four full-time and one part-time faculty members.

The growth of the Women's Studies Program during its eighteen-year
history is the result of both national trends and local
circumstances. First, the dramatic expansion of feminist
scholarship has generated a surge of intellectual excitement in
women's studies nationally and internationally. Student demand for
courses reflects both the expanding scholarship and the social
concerns that the scholarship addresses. Concomitantly, as the new
scholarship on women generated academic attention within the
traditional disciplines, more departments sought to hire faculty
members whose scholarly or creative work focused on women or
gender. Thus, while the 1974 proposal to establish the Women's
Studies Program identified fifteen faculty members across campus
who were interested in teaching women's studies in their
departments, a 1991 survey identified forty-two core and affiliated
full-time faculty members who have actually taught these courses
during the past three semesters.

Local circumstances also have promoted the growth of women's
studies at the University of Colorado. A core faculty known for its
outstanding teaching has developed an excellent reputation among
students. Students drawn to women's studies courses are among the
most articulate and capable on campus. "Affiliated" faculty members
(that is, those who are listed in other departments and whose
courses are cross-listed with women's studies) have given
generously of their support and influence at crucial moments in the
program's history. While administrative support has been uneven
from office to office, over the years a general acceptance of and
support for women's studies prevails (for example, approval to
conduct national searches for directors at three separate times).
And finally, the Boulder community--with its numerous feminist
organizations--is a setting that supports women's studies
activities.

In 1988, with the hiring of the present director, the program moved
from a basement location to its present site in Cottage Number One,
the original women's dormitory. In addition to the director's
position, the program received four full-time, tenure-line faculty
positions. In academic year 1991-92, a full-time senior instructor
and a one-third time instructor--as well as seven part-time
instructors--round out the core teaching faculty.

Today, the Women's Studies Program does more than meet its original
aim of offering courses on the new scholarship on women. Since
1983, it has provided a major area of academic concentration for
190 undergraduates who have been awarded the major under the
American Studies designation the program also has granted a
certificate to approximately 100 students. In addition to providing
an integrated curriculum in women's studies for its major and
certificate students, the program also seeks to foster an
intellectual feminist community on campus through its numerous
programs and activities, to support the work of faculty members who
are engaging in feminist scholarship in their disciplines, to
contribute to feminist discourse through scholarly and creative
work, and to promote enlightened and responsible leadership for
women in the community.

When the Women's Studies Program at the University of Colorado was
invited in 1989 to participate in the assessment project, "The
Courage to Question," we initially regarded it as an opportunity to
refine and expand assessment procedures that we had already
developed. Our campus, like other institutions of higher education
in Colorado, had been mandated by the state to assess student
learning in all academic units beginning in 1987-88. Following the
advice of those in the Office of Academic Affairs who were
coordinating the effort, we developed a rather standard procedure.
The faculty identified the knowledge and skills goals that we
thought our students should attain and devised an instrument for
measuring them.

In the first year, the women's studies faculty selected one
knowledge goal and two skills goals to assess. Because the required
survey of feminist theory served at that time as a type of capstone
course for majors, we decided to embed the assessment of these
goals in a requirement for the course. The knowledge goal we
selected was knowledge of major paradigms of feminist thought. The
skills goals we selected were: (1) the ability to write a focused
and coherent analytical essay that is based upon and sustained by
evidence; and (2) the ability to analyze arguments and
interpretation for internal consistency and underlying assumptions.
The final examination in the course was to be assessed for these
student learning goals. After the instructor graded the examination
for the purpose of the course, three faculty members-- including an
outside evaluator from another institution--evaluated the student
exams according to the assessment goals.

The outcome of the assessment project was not especially
illuminating. In fact, it did not tell us much beyond what the
course instructor had discovered in the process of grading the
exams for the class: overall, the students did relatively well in
meeting these goals. This experience, however, led us to question
the approach we had taken to assessment, which eventually led us to
redefine our project for "The Courage to Question."

We were dissatisfied with the process we had developed for several
reasons. First, the state mandate created an atmosphere that
encouraged compliance rather than enthusiasm. Our selection of
knowledge and skills goals as well as the methods of assessment
emerged from a desire for efficiency. We regarded assessment as one
more bureaucratic requirement for evaluation that impinged on our
time. Like most faculty members in women's studies programs, we
were already overworked. We resented yet another requirement for
self-evaluation that interfered with our real work: teaching and
research. Thus, we formally complied with the mandate by following
campus guidelines and embedding the assessment in course
requirements. As a result, our goals and the process of assessing
them looked very much like standard academic fare: one could not
tell much difference between the women's studies assessment plan
and those of traditional arts and sciences disciplines. We were
resigned to the process; we did not "own" it, and we didn't learn
much about ourselves as teachers and learners.

Participation in the NWSA/FIPSE project gave us an opportunity to
re-examine our attitudes toward assessment. First, the situation
was dramatically different. We chose to participate in the project.
The attitude of the national assessment team (as advisors to us)
was flexible, helpful, and respectful of the educational experience
of women's studies students and faculty. We were encouraged to take
a more comprehensive look at assessment, its purposes, and its
possibilities for self-reflection. Through biannual meetings we
were given the opportunity to engage in dialogue with faculty
members from other women's studies programs as a means of
clarifying our individual cam pus approaches as well as raising the
larger question of assessing women's studies. The setting for our
process was supportive and intellectually exciting. The audience
for our reports was not a state bureaucrat but other women's
studies programs and educators interested in assessment.

In this setting, we began to question other aspects of our previous
approach to assessment. We realized that we had selected particular
goals not simply because they might be important but also because
they were convenient--that is, relatively easy to evaluate given
our resources. Moreover, we realized that even when these
understandably pragmatic motives were not operating so explicitly,
our program goals reflected certain intentions by particular
individuals at a specific time. We saw that our program could
identify a variety of combinations of goals, depending on who was
asked and when. Given this shifting context of goal identification,
we decided to push back the question from intention to the context
itself and look at what we were actually doing in our women's
studies courses. With help from our students, we started looking
for answers.

In April and May of 1990, we held a series of potluck dinners with
women's studies majors and certificate students, faculty members,
and the staff advisor. We asked the students, "What actually
happens for you as a learner in women's studies courses and as a
women's studies major/certificate student?" and "What do you learn
and how do you learn it?" The discussions were lively, intense,
thoughtful, and fun. In an interesting way they reproduced the best
of our classroom experiences: a student suggesting an idea; another
picking up on it, confirming it, elaborating on it, taking a
different slant; still another disagreeing with part of it,
clarifying both the agreement and disagreement; another student
mediating the disagreement, searching for some paradox that might
illuminate the discussion. The faculty members and staff advisor
took notes on these discussions and met to interpret them. We
concluded that while students may have taken different slants on
this theme, they were telling us that women's studies was an
exciting learning experience because they as learners were
personally, actively engaged in their learning experience.

          STUDENT LEARNING AND HIGHER EDUCATION REFORM 

Our students were, in effect, telling us that their education in
women's studies produced the learning experience that higher
education reformers have been advocating for the last several
years. Reports on undergraduate education have stressed the
importance of students' involvement in their learning process.
Although the specific goals varied from report to report or among
institutions, the condition best suited to achieve those
goals--active student learning--was clearly the current educational
ideal.

In 1984, the Study Group on Excellence in Higher Education
sponsored by the National Institute of Education (NIE) sounded the
new emphasis for improving undergraduate education.

     There is now a good deal of research evidence to suggest
     that the more time and effort students invest in the
     learning process and the more in- tensely they engage in
     their own education, the greater will be their growth and
     achievement, their satisfaction with their educational
     experiences, and their persistence in college, and the
     more likely they are to continue their learning. -1

The NIE report specified involvement to include devoting energy to
studying working at jobs on campus (rather than at off campus
jobs), participating in student organizations, and interacting
frequently with faculty members and other students. In his 1985
study, Alexander Astin confirmed the importance of the last item:
frequent student-faculty interaction was the most influential
factor affecting students' satisfaction with their undergraduate
experience.2 Subsequent reports issuing from organizations such as
the Association of American Colleges (AAC), the Carnegie Foundation
for the Advancement of Teaching, the American Association for
Higher Education (AAHE), and the Education Commission of the States
reiterated the importance of improving active student involvement
and faculty engagement in teaching and learning.

These reports, while underscoring the ideal, identified impediments
to its realization. Involvement in learning requires time, and both
students and faculty members find themselves pressured by competing
demands. Cutbacks in federal funding require more students to work
off campus and to work more hours. A Carnegie Commission study
found students were much more engaged by their social life and jobs
outside of class than they were by academic or intellectual
interests. -3 Faculty members also feel the pressure or the lure of
competing demands. A Carnegie survey of five thousand faculty
members found that at research universities, the reward system
encourages research over teaching. -4 Prestige within a discipline
nationally also is associated with the degree to which a faculty
member engages in published research. -5 Although faculty members
and administrators frequently affirm the principle that teaching
and research need not necessarily be at odds with one another, the
higher education reports reflect a growing uneasiness with this
nostrum; they suggest or directly state that in practice the time
demands of research impinge upon faculty involvement with teaching.
The consequence of these tugs on student and faculty time,
interests, rewards, and mutual perceptions--tugs that interfere
with active involvement in teaching and learning--is the creation
of what the authors of the AAC report on general education called
the "two cultures in academia":

     On many campuses, students view faculty with the
     ambivalence of respect and resentment, admiration and
     disappointment. Depending on the institution and the
     department, relations between students and faculty can
     range from harmony and colleagueship through mutual
     avoidance to antagonism and undeclared conflict. On such
     campuses, the rhetoric about an "intellectual community"
     is belied by the reality of these two separate cultures.
     -6

The report suggests that the two cultures in academia foster an
attitude of detachment on both sides. Students don't make demands
on faculty members in exchange for faculty members not making
demands on students. Students put in the time they think is
necessary to get the grades they want and then turn to more
exciting interests. Faculty members put in the time they think is
necessary to teach, hold office hours and attend meetings, and
then, if time permits, turn to the real work of research. Neither
side makes too many demands, yet each harbors complaints. Students
contend that faculty members are aloof and condescending; faculty
members complain that students can't write or think or analyze.
Each manages to find one or a few exceptions to what they take to
be the pattern of the other's disinterest or incompetence.

This, of course, is an exaggeration. Obviously, there are faculty
members and students who are actively engaged in intellectually
exciting teaching and learning experiences. But the concerns that
these various reports raise converge in a portrait of a university
culture that fosters isolation, resignation, and discontent on the
part of students and faculty.

The consequences are experienced not simply in the separation of
students and faculty (and, indeed, among students and among faculty
members) but in the curriculum as well. In A New Vitality in
General Education, AAC's task group on general education cites the
problem with the disorganized general education curriculum and
attributes it to the faculty's focus on their specialized research
within their discipline. "We have specialized to such a degree that
we have lost interest in and the capacity for integrating
knowledge." -7 In The Challenge of Connecting Learning, another AAC
task force finds coherence lacking even "within arts and sciences
majors." The authors call for "connected knowing"; that is, making
links among courses and ideas within the major but also encouraging
students to connect personally with the material they were
learning. -8

The reports, thus, describe a problem that did not appear in our
students' accounts of their women's studies learning experience.
While some components described in the reports were
acknowledged--for example, competing tugs on students and faculty
time demands and interests--they did not emerge as central themes.
To the contrary, students reported that faculty members were
generally accessible and responsive to their questions and concerns
and that faculty-student activities bridged the two cultures. They
reported that through taking women's studies courses, they were
challenged to carry the knowledge gained in their classes into
their social life and into their work experience, giving them a
language and a critical framework for evaluating their experience.
They described their classes as demanding and supportive
experiences that fostered connected learning. As one student
stated, "We have wonderful teachers who care about us, are telling
us something real and tangible. They validate our existence as
women, and they are great role models, something women don't have
much of."

        TEACHING AND LEARNING IN WOMEN'S STUDIES CLASSES 

Our students were responding to their women's studies classes in a
way that confirmed recent studies on feminist pedagogy. Grounded in
feminist scholarship and theories of knowledge that have challenged
academic disciplines feminists have questioned traditional teaching
practices. As Culley and Portuges note, "changing what we teach
means changing how we teach." -9 Traditional practices take an
approach to teaching that presumes that objective knowledge is
possible, "mastery" of universal truths is desirable, the teacher
is the uncontested expert, and students learn through competing
with one another. In contrast, feminist pedagogy assumes an
approach that views knowledge as contingent, open, and
interconnected and learning as more effective in a setting that is
non-hierarchical, student-centered, and collaborative.

Most of the writing on feminist pedagogy has documented the non-
traditional practices that feminist teachers use in the classroom.
We were interested in learning more about feminist pedagogy from
the perspective of our students. What in particular were our
students responding to when they described their learning
experiences so positively? Was it the teaching techniques? the
material? some combination? How did they interpret their active
engagement in the classroom?

To try to answer these questions, we turned to studying women's
studies classes more systematically. At the potluck dinners, the
students indicated several dimensions to their active connection
within their classes. We subsequently grouped these dimensions
under three categories: course content, course structure, and
classroom dynamics. While at times these categories may overlap and
influence one another, basically they refer to the subject matter
of the course (what students read, discuss, think about, research~;
the structure of the course (format, requirements); and classroom
dynamics or pedagogy (teaching style, student participation,
faculty-student interaction). Our research was built on these
informal student impressions and the categories we derived from
them. Specifically, we were interested in answering two questions:
( 1 ) were all three of these categories equally important in
fostering active learning or was one component more important than
the others? and (2) was the active learning experience that our
students identified with their women's studies courses unique or
could it be found in other classes ?

We decided to answer these questions from the perspective of
illuminative evaluation, an approach used in educational research
to evaluate innovative educational programs where traditional
approaches have proven inadequate. -10 Evaluation traditionally has
been inextricably linked with testing--testing to provide
quantitative data from which statistical inferences can be drawn.
However, test-oriented evaluation presents a number of problems
when conducting an evaluation of an educational innovation. It is
often difficult to articulate and specify complex goals, to account
for idiosyncratic influences, even to formulate precise research
questions--all issues which this project presented.

Illuminative evaluation offers an alternative "social anthropology"
paradigm. Whereas traditional evaluation procedures tend to operate
in isolation, illuminative evaluation attempts to incorporate the
wider context in which educational programs operate. The goal of
illuminative research is to "unravel [the complex scene
encountered]...[and to] isolate its significant features." -11
Illuminative evaluation is, in fact, a general research strategy
rather than a standard methodological package. The tactics used to
conduct the research are chosen to fit the particular subject at
hand. After making initial observations, the researcher identifies
certain phenomena, events, or opinions as topics for more intensive
inquiry: "As the investigation unfolds...problem areas become
progressively clarified and redefined."-12 This "progressive
focusing" permits unique and previously unidentified phenomena to
be examined.

The illumination approach seemed best suited to the rather
open-ended nature of our questioning. In the initial discussions
our students identified the importance of their own active
engagement, and we derived the categories that might foster that
experience. We then used these categories to inform a series of
classroom observations and to analyze course syllabi. We used the
information that we gathered from these sources to create a
questionnaire (see end of file).

Because we wanted to compare learning experiences in women's
studies classes with those in classes in other departments, we
initially conducted observations in three different courses one
women's studies course, "Women and Religion," and two non-women's
studies courses (an English course "Advanced Shakespeare," and an
American Studies course entitled "American Autobiographies"). We
selected these courses through a process of purposive sampling that
allowed us to control for class level, class size, academic
discipline, and instructor evaluations.

Because we wanted students who had sufficient time as
undergraduates to enable them to reflect upon their educational
experiences, we limited the comparison classes to upper-division
courses. Because class size significantly affects classroom
atmosphere and student engagement, we selected classes with roughly
the same number of students. "Women and Religion" had thirty-two
students, "Advanced Shakespeare" had twenty-five students, and
"American Autobiographies," had twenty-one students. Academic
discipline was another area of consideration. Because content to a
large extent affects style of teaching, we selected courses from
the humanities and social sciences, academic disciplines considered
most similar to women's studies. Since the teaching ability of
women's studies instructors is rated consistently high in faculty
course evaluations, teaching excellence of the instructor also was
a criterion for selection of comparison classes.

Gender was a factor that could not be controlled because of
limitations inherent in our study. Women's studies classes are
exclusively taught by female faculty members and most often the
majority (if not all) of the students are female. This was true for
the "Women and Religion" class: it was taught by a female, and all
of the students were female. The "Advanced Shakespeare" class was
taught by a female and comprised twelve female and thirteen male
students. The "American Autobiographies" class was taught by a male
and had thirteen women and eight men. The gender profile is an
important difference, one which we recognize has significant
implications, given our eventual findings.

All three professors teaching these three courses agreed with
consider- able interest to participate in the project. On the first
day of observation, Re- search Assistant Gay Victoria introduced
herself to the students and gave them a brief description of the
project and the reasons for wanting to make the observations. She
subsequently observed three seventy-five-minute class periods in
each of the three classes during the periods of November 15-16 and
November 26-December 4, 1990. She audio taped all of the classes
with the consent of the instructor and the students.

The class observations were directed by the three components, which
students and faculty members had identified as contributing to
active learning in women's studies classes--content, structure, and
dynamics. Content was, of course, an obvious area of difference
between the women's studies and non-women's studies classes.
Although both the "Advanced Shakespeare" class and the class on
"American Autobiographies" presented multi- cultural approaches to
the course material (incorporating discussions regarding race and
class as well as gender whenever appropriate), neither of them had
women as their primary focus. In contrast, the content of the
"Women and Religion" class was focused solely on women.

All three courses contained many structural similarities: all
appeared to incorporate similar types of course requirements
(critical thinking and writing skills were stressed in all three
classes); all were generally conducted in a discussion rather than
lecture format; and all formally structured some aspects of the
class to be determined by students. Interestingly enough, the
women's studies class was conducted in a seating arrangement which
was more or less traditional: for example, rows of seated students,
with the instructor in front. The other two classes, in contrast,
were conducted in a less traditional circle arrangement.

Dynamics presented a number of interesting observations. The
pedagogy most often associated with feminist approaches--such as
student-centered or dialogic teaching--was not unique to the
women's studies class. All three instructors involved students in
discussion and responsibility for directing the class. While all
three classes had active participation rates, the average response
rates for the "Advanced Shakespeare" course (83.3 percent of the
students spoke) and the "American Autobiographies" course (70.3
percent) were somewhat higher than the average participation rate
in the "Women and Religion" course (46.6 percent). This was an
interesting finding, given students' reporting on their active
learning in women's studies classes. One way to interpret the
difference was to speculate that the slightly larger class size
affected the participation rate. Another explanation was that this
class was an anomaly and that students were, in fact, not actively
involved. Yet another interpretation suggested that active learning
is not the same as, or confined to, student responses to
professors' questions. Students may be actively involved without
necessarily verbalizing their responses in class. When we looked at
how students engaged the material, we discovered something that
supported the latter interpretation. The students in the "Women and
Religion" course related classroom material to their own lives, a
process that did not take place in the other two classes.

For example, during a discussion of the relationship between war
and ritual and war as ritual, a student of the "Women and Religion"
class observed:

     Over Thanksgiving, my dad and I got into a lot of
     conversations about the war...He tried to justify it to
     me...you know, thinking that we should go to war.... I
     asked him a question, "Well, how do you think things
     would be different if there was a matriarchy instead of
     patriarchy?" The way he saw matriarchy is--and this is
     where the shock was--that, all of the sudden, men would
     follow one woman's orders. Like there would be the one
     woman on the top and then it would be exactly like it is
     right now.

Class members empathized with this student but also discussed the
reasons why someone might automatically think of that model of
matriarchy, given popular examples of women heads of state.

Students in the "American Autobiographies" and the "Advanced
Shakespeare" class did not engage in this type of dynamic.
Admittedly, the subject matter of these two classes may have
offered fewer opportunities to make personal connections with the
course material than "Women and Religion" did. However, even when
opportunities did present themselves in these other classes,
students (male or female) did not make the connections--for
whatever reason. It was unclear at this point why this dynamic was
present only in the women's studies class. One possible explanation
could have been the fact that the professor in this class actually
"modeled" the integration of the personal with the intellectual by
using examples from her own religious upbringing and those of
family members to illustrate various points about the influence of
religion.

Yet "modeling" did occur during observations of one of the other
classes. The female professor in "Advanced Shakespeare" made at
least two attempts to encourage students to connect the themes of
war in Henry V (the play under discussion) to the Gulf War (which
had escalated at the time). She herself volunteered that she had a
difficult time reading the play without thinking about contemporary
parallels. Each time she encouraged students to reflect on a
connection (without directing them how to reflect), the students
quickly returned to a discussion of the text itself. Thus, although
the professor herself modeled making contemporary connections to
the material, the class resisted. There may be many reasons for
this resistance: for example, students (with friends or loved ones
at risk) may have felt too closely affected by the Gulf War to
discuss it. Nevertheless, only the students in the women's studies
class volunteered connections between the material, themselves, and
their present contexts.

The observations of the three classes suggested some interesting
initial answers to our questions. Pedagogy alone did not foster a
personal connection to the material. Indeed, those techniques most
often associated with feminist pedagogy--that is, student-centered
learning, discussion emphasis, a democratization of
responsibility--occurred more frequently in the two classes which
were not the women's studies course. However, although these
pedagogical techniques fostered active student learning in the
classroom, student engagement was not "personal" in the way that it
was for women's studies students. This distinction required our
clarifying the difference between "active" engagement and
"personal" engagement. It also required our exploring more fully
what "personal" connection meant in the classroom. Surely the
students actively involved in "Advanced Shakespeare" and "American
Autobiographies" were learning in a way that could hardly be called
"impersonal." They obviously were intellectually excited by the
mate- rial and the class discussions. They were not detached; they
were "turned on" by learning. This description was true also of the
women's studies students. Yet for them, something additional was
happening. They were connecting the content of the material with
their lives, and they were connecting themselves with the content
of the material.

We thus concluded that content was more important to fostering
personalized learning than pedagogy alone. It was not enough that
a professor modeled a personal connection to the material or that
she fostered student involvement through discussion. The students
in the women's studies class were also actively involved because
the material touched them deeply. They read about the history of
women in the Judeo-Christian tradition, and they wanted to know
historically what it was like for women to be excluded from certain
religious practices. They read theological tracts and reflected on
their own spirituality. They read about women's involvement in
contemporary religious cults and spoke with concern about women
they knew who were involved in these organizations. Content itself,
it would seem, sparked the personal connection.

We decided to test our speculation about the centrality of content
through observing additional classes. We selected five courses for
this second phase of the project: two women's studies courses
("Feminist Theory" and "Fathers and Daughters"); two English
classes ("American Women Writers" and "Readings in American
Poetry"); and a course from the Religious Studies Department on
"Sufism." The same criteria used in the first phase of the project
(upper division, teaching excellence, size, and academic
discipline) were used in selecting classes for the second phase.
The second phase, however, included an additional consideration not
included in the first. Because we speculated that content was one
aspect of women's studies courses that uniquely informed student
engagement in learning (through personalizing knowledge), we
included "American Women Writers," a course with a content focus on
women but not offered through the Women's Studies Program. Although
some students from other departments were enrolled in the course,
most were English majors. Therefore, this course enabled us to
compare the responses of women's studies students to those of
non-women's studies students in a course focusing exclusively on
women.

Three of the classes were taught by female faculty members
("American Women Writers," "Feminist Theory," and "Fathers and
Daughters") and two by male faculty members ("Readings in American
Poetry" and "Sufism"). The students in the two women's studies
classes were once again either exclusively or predominantly female
(the "Feminist Theory" class had two male students). The three
non-women's studies classes had a mixture of male and female
students. All five classes were upper-division classes with
anywhere from seventeen to twenty-six students. Three separate
observations consisting of one class period (either fifty or
seventy-five minutes) were carried out in each of these five
classes during the period from March 5 to April 10, 1991, using the
same procedure as in the first phases.

With regard to structure (requirements, skills, classroom format),
all five classes in phase two had similar course requirements and
were conducted either through discussion or a combination
discussion/lecture format. All five of the classes placed a great
deal of emphasis on critical thinking and writing skills. All were
conducted in a circular seating arrangement. In terms of pedagogy
or dynamics, all but one of the five classes formally incorporated
students into various aspects of designing and/or running of the
class. The class that was most traditionally structured (designed
and led by the faculty) was a women's studies course, "Feminist
Theory." Again, the two English classes--"American Women Writers"
and "Readings in American Poetry"--were the most highly
student-centered, delegating much of the responsibility for
designing questions and leading class discussion to the students.
This pattern did not surprise us. Influenced by one of its faculty
members, the English Department has been known on campus for
innovation in fostering student-centered learning. -13 

The most interesting findings concerned the personalization of
knowing. Again, students reproduced the earlier pattern of
personalizing learning in their women's studies classes. And,
again, for the most part, students resisted personalizing learning
in the three courses that were not women's studies. However, two
exceptions to the earlier pattern proved to be especially
illuminating. The first anomaly was a lengthy and intense
personalized discussion in one class period of the religious
studies class, "Sufism." The professor had just returned student
papers and, to the class as a whole, made a personal response to
material in one of the student'.s papers, a response validating a
point the student made. Several other students--first a male, then
a fe- male--followed by also connecting personally to the point the
professor made. The discussion continued to weave in and out of
academic and personal reflections on love and piety.

The second exception involved the lack of modeling of, or formal
requirement for, engaging in personalized learning during our
observation of the "Feminist Theory" course. Although it is
possible that the professor modeled personalized learning in other
class sessions, it did not occur during our observations. Yet, even
in this class which was also the most traditionally structured,
students made personal connections to the material. This finding
was especially interesting when compared to our observations of
student engagement in the English Department's "American Women
Writers" class. Despite modeling on the part of the female
instructor, in this class the students resisted connecting the
material to their personal lives. In contrast, despite the absence
of the professor's modeling in the women's studies "Feminist
Theory" class, students repeatedly made connections between their
lives and the material under discussion. It seemed as though these
junior- and senior-level students, most of whom were women's
studies majors, had developed an approach to their women's studies
courses in which they expected personal connections to be made,
even when such connections were not formally encouraged.

These findings suggested further comparisons. The professor in the
religious studies class was especially skillful in eliciting
students' personal responses. Not only did he model it himself but
he did so in a way that was directed to specific issues that
encouraged particular students to respond. He appeared to know his
students well and directed his questioning to them personally. For
example, through his questioning of a student musician, the student
was led to reflect on a parallel between his experience of playing
the violin and stages of spiritual growth. In the session we
observed, however, students in the religious studies class did not
volunteer personal connections on their own. Unlike the women's
studies students, they did not initiate personalized learning but
waited until the professor gave them permission to do so or
explicitly requested it.

As we reflected on these differences, we were struck by what
appeared to be a unique atmosphere among students in the women's
studies courses. Many of these students--especially majors--knew
one another; they met for events and activities outside of the
classroom, and they had taken other classes together. This core
(sometimes consisting of only three or four students ) created an
atmosphere of trust and mutual respect. There also were the ones
who took a leadership role in initiating discussions about their
personal responses to the material. They helped to create, in
effect, a student culture. It was this student culture that
appeared to function whether or not men were present (there were
two men in the "Feminist Theory" class) and whether or not students
received formal faculty encouragement for personalized learning.
Our gradual unravelling of our questions, therefore, led us to the
conclusion that the women's studies students themselves played a
major role in creating their classroom experience.

The patterns we discovered in class observations were confirmed by
our initial analysis of the questionnaires administered to the
students in all five classes. Given our observations of the
salience of the personalized connection to the course content, we
were especially interested in student responses to the questions
addressing this issue: 

* How often does course content relate to you personally? 
* How often in the classroom does it feel acceptable to relate
course mater al to your personal life? 
* How often do you feel "encouraged" by the instructor to relate
course material to your personal life? 
* How often in the classroom do you verbally express a personal
connection to course content ? 
* How often does course content actually affect you or your life in
some significant way? 

Applying a simple t-test, we found that students in the women's
studies classes scored significantly higher than students in the
other classes on all of these questions. Moreover, we found that
students in the English Department course "American Women Writers"
scored significantly higher than students in the other non-women's
studies classes but lower than students in the women's studies
classes. This appeared to confirm our supposition that both content
and student culture contributed to the personal connection, but we
are looking forward to conducting a more elaborate statistical
analysis of the questionnaire before drawing conclusions from these
data.

Nevertheless, the students' written responses to the open-ended
questions certainly confirmed the patterns of the initial class
observations and the answers to the questions on personal
connection to the material. When asked how the course content
affected their lives, students in the English Ind religious studies
classes responded generally by referring to what they learned, "It
gave me a new perspective on American literature and life." "It
gave me a broader perspective on literature." "It has helped me to
understand a religion and culture different from my own." Very few
students from these classes stated that the course helped them to
think differently about or reevaluate their lives (the majority of
these comments came from women students in "American Women
Writers"). And one male student responded angrily to the question
itself, "Although courses in religious studies (including this one)
touch me deeply, I have little or no interest in sharing my
'personal life' (in regards to religion) with my classmates.
Spirituality and academia do not go together very well. The mind
often cannot relate to the heart. I don't really want to talk about
it here."

In contrast, the responses from many of the students in the women's
studies class indicated an ease with and desire for making a
personal connection to the material, "This course will stay with me
for the rest of the summer." "I apply everything I learn in women's
studies classes to my life." "My women's studies courses have
strengthened me." "I tend to read theories and think about how they
apply to my life." "This class pushes me to self- examination and
reevaluation and opens new avenues of thought." A political science
major who had taken numerous women's studies classes noted,
"Without women's studies classes half of my sanity would be missing
in my educational experience. I think my education was extremely
enhanced through taking women's studies classes."

The comments on the questionnaires helped us to clarify more fully
the difference that we had noted earlier between students' active
and personal engagement in their classes. When the students in the
non-women's studies classes were intellectually involved with the
material, they were excited by the ideas and enjoyed the learning
process itself. We noticed this same pro- cess with the women's
studies students, but they also expressed another dimension that
could best be described as ethical. The women's studies students
were concerned with drawing the implications of their learning for
Our students become excited by this material not only because it is
intellectually innovative and compelling but especially because it
explains their own experiences guiding their own actions in the
world. They wanted to learn about the world: its history; its
political, economic, and social structures; its cultural forms; its
irrationalities and its positive possibilities. They also wanted to
learn about themselves in relationship to the world in order to
help them make judgments about making choices and interacting with
others.

The ethical concerns that our students bring to their women's
studies classes reflect the conditions that bring them to these
classes in the first place--an experience of the world in which the
traditional expectations for women and men are challenged. They
want to understand the traditions and the challenges, not in order
to discover some new "politically correct" mode of behavior, but to
explore the possibilities for change and to revalue parts of their
own past.

                           CONCLUSION 

Our two major discoveries--the importance of course content in
promoting activity, personalized learning and the culture of
women's studies that assumes personal/intellectual
connections--raise for us many additional issues and questions. The
influence of content (over either course structure or teaching
dynamics) in creating a personally and intellectually exciting
learning experience cannot be overemphasized. It suggests the
powerful influence of simply exposing students to works on women's
history and literature, to analyses of the economic, social~ and
political structures influencing women's lives, to feminist theory,
to the psychology of women, to women's art and music and theater.
Our students' positive responses to the content of women's studies
remind us of our own personal and intellectual excitement in
"discovering" the works that eventually came to define women's
studies as a new field. It also suggests the importance of the
efforts of the past ten years to create curricular reform. The
current backlash against that reform reflects the power that the
new scholarship wields. Women's studies is a new perspective that
challenges traditional structures and beliefs. Our students become
excited by this material not only because it is intellectually
innovative and compelling but especially because it explains their
own experiences. These are the "aha" moments when students
understand their personal lives in the context of wider,
overlapping, and interlocking fields.

We suspect that the culture of personalized learning created by
women's studies students is grounded in this compelling connection.
In the absence of a dominant cultural discourse that would validate
their lives, and in the context of prevailing cultural forms that
undermine them, our students often seek out their first women's
studies classes as avenues to self-understanding. The desire for
the intellectual is deeply rooted in the personal. When they do
encounter the material that helps them to make sense of their
lives--and those issues and problems that were hitherto
"nameless"--they establish an expectation that women's studies
course content will pertain to women's lives in general and to
their lives in particular. We suspect that the student culture of
personalized learning emerges from this shared expectation for the
intellectual to explain the personal. It appears, also, that the
expectation is reinforced not only by course content and faculty
support and modeling but also by students' mutually supportive
interaction.

We would like to learn more about this student culture. Ideally, we
would like to follow a cohort of student majors longitudinally from
their first introductory women's studies course through graduation.
We would want to learn why of all the students enrolled in
"Introduction to Women's Studies"--some choose to become majors. We
would want to follow their initial encounter with the material--and
with the struggle with it that Lee Knefelkamp identifies as the
tension between support and challenged. By observing middle-range
classes, we would want to learn how individual expectations for
personalized learning develop into a student culture that fosters
it. Are there certain student-teacher interactions that support it?
Are there other components to this student culture? other
activities that promote it? What is the influence of an all-female
class in promoting a culture of personalized learning? We would
also want to know more about the culture it- elf. Are certain
voices and perspectives privileged? Are some groups silenced or
intimidated? Are there assumptions about what constitutes a
personal connection that are culturally limiting? Is there a
tension between what Belenky et al. have called connected knowing
and separate (for example, analytical) knowing? What happens when
students encounter material that is difficult or "inconvenient" to
know? These are the questions that we are starting to ask in phase
three, which extends our work from "The Courage to Question." We
have begun to study "Introduction to Women's Studies," using
classroom observation, student journals, questionnaires, and
interviews.

Meanwhile, we still are required by the state to conduct a yearly
assessment of student learning. Our experience with "The Courage to
Question" has led us to abandon our previous approach and to adopt
a portfolio method. Our approach rejects a method whereby faculty
members alone measure student learning and proceeds from the
assumption of an equal partnership between students and faculty in
assessing student learning. 

Our portfolio process is embedded in a new capstone course for
majors and certificates. A major requirement for the course is a
ten-page paper, a reconstructive narrative of the student's journey
as a women's studies major. To help prepare to write the narrative,
students are asked to pull together materials from their women's
studies courses (in the future, newly declared majors will be asked
to keep a portfolio of these materials). As another building block,
students are asked to write short memoirs of their individual
courses, addressing questions such as, "Why did I take this course?
What did I learn? How? Was I challenged? How? Was I supported? How?
How would I change the class? What questions did I have going into
the class? Were they answered? Were any left unanswered?" Building
from these class memoirs and portfolio items, the students write
narratives that make sense of their learning experience as women's
studies majors and certificates. By sifting through memories,
papers, exams, and personal journals, students must remember
themselves as they were before they became women's studies majors
and reconstruct their development. In doing so, students are
required to recognize the interplay between personal connections
and intellectual experience.

The second capstone course requirement involves students' extending
their narratives to a project, the "next step." The definition of
the project is flexible. It might be an artistic expression that
interprets their learning experience, an analytical paper that
pursues an unanswered question, an investigation of an intended
career, a short story. When students present their narratives and
"next step" projects, they may invite other faculty members and
students to the class. Through her presentation and dialogue with
those present, each student will be encouraged to reflect on her
learning (both product and process) and to link her learning
experience to her future plans. The assessment report will draw
from these presentations, narratives, and portfolios. Authored by
a subcommittee of faculty and student participants, the report will
be submitted as the Women's Studies Program's yearly assessment of
student learning.

Creating an assessment method that is more informative and useful
to students and faculty members is only one of the benefits of our
participation in "The Courage to Question." The process itself has
encouraged us to reflect more fully on our classroom experiences.
It has helped us with redefining our requirements for the major (to
include new courses on critical thinking and a capstone course~. We
also have revitalized connections with faculty outside of women's
studies. Other faculty members who participated in the project have
expressed an interest in our focus on personalized learning. We, on
the other hand, have learned from them useful techniques to foster
student-centered learning. Our participation also has introduced us
to new scholarship on assessment, student learning, and curricular
reform, enabling us to assume some leadership in recent campus
efforts to revitalize undergraduate education.

Although our approach to "The Courage to Question" looks more like
research than assessment, we are pleased that we have taken this
direction. It has allowed us to gain some perspective on classroom
learning in women's studies that will enable us to clarify our
goals both individually and collectively. Our discovery of the
personalization of knowledge is not exactly new. Women's studies
from the beginning has made the connection between the personal and
the intellectual. What is new for us is to begin to consider what
t:his connection means specifically for teaching and learning.

1. Involvement in Learning: Realizing the Potential of Amencan
Higher Education (Washington, D.C.: National Institutes of
Education, 1984), 17.

2. A. W. Astin. Achieving Educational Exceuence: A Critical
Assessment of Priorities and Practices in Higher Education (San
Francisco: Jossey-Bass, 1985). 

3. Campus Life: In Search of Community (Princeton: The Carnegie
Foundation for the Advancement of Teaching, 1990). 

4. The Condition of the Professoriate: Attitudes and Trends
(Princeton: The Carnegie Foundation for the Advancement of
Teaching, 1989). 

5. E. L. Boyer, College: The Undergraduate Expenence in America
(New York: Harper and Row 1987). 

6. A New Vitality in General Education (Washington, D.C .:
Association of American Colleges, 1988) 42. 

7. A New Vitality, 23. 

8. The Challenge of Connecting Learning, Liberal Learning and the
Arts and Sciences Major. Vol. 1 (Washington, D.C.: Association of
American Colleges, 1991). 

9. M. Culley and C. Portuges, eds., Gendered Subjects: The Dynamics
of Feminist Teaching (Boston Routledge & Kegan Paul, 1985), 2. 

10. M. Parlett and G. Dearden, eds., Introduction to Illuminative
Evaluation: Studies in Higher Education (Cardiff-by-Sea, Calif:
Pacific Sounding Press, 1977); M. Parlett and D. Hamilton
"Evaluation as Illumination: A New Approach to the Study of
Innovative Programs," in Beyond the Numbers Game, D. Hamilton. et
al., eds., (London: Macmillan, 1978), 6-22; J. P. Shapiro and B.
Reed, "Illuminative Evaluation Meeting the Special Needs of
Feminist Projects," in Humanity and Society (November 1984) 432-41;
M. A. Trow, "Methodological Problems in the Evaluation of
Innovation," in M. C. Wittrock and E. E. Wiley. eds., The
Evaluation of Instruction (New York: Holt, Rinehart and Winston,
1970), 289-305. 

11. M. Parlett and D. Hamilton. "Evaluation as Illumination: A New
Approach to the Study of Innovative Programs," in D. Hamilton et
al, eds., Beyond the Numbers Game (London: Macmillan, 1978) 6-22,
17.

12. Ibid, 18. 

13. Martin Bickman, "Active Learning in the University: An Inquiry
into Inquiry," in Mary Ann Shea, ed., On Teaching, Vol. I (Boulder:
The University of Colorado Faculty Teaching Excellence Program,
1987): 31 66. I 4. L. Lee Knefelkamp, Developmental Instruction:
Fostering Intellectual and Personal Growth of Students (Doctoral
dissertation, University of Minnesota, 1974). 

15. M. F. Belenky, B. M. Clinchy, N. R. Goldberger, and J. M.
Tarule, Women's Ways of Knowing (New York: Basic Books, 1986).



          STUDENT QUESTIONNAIRE UNIVERSITY OF COLORADO

Provide three responses to each question below: 
A. answer in regard to courses from your major area of study 
B. answer in regard to courses from outside your major area of
study 
C. answer in regard to this course

1 . On the average, how often do you miss class sessions ? 
     Never    Rarely    Occasionally    Frequently    Always 
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

2. What is the usual reason for missing class?

3. How many fellow students do you usually know by name? 
      None    A Few     About Half          Most      All
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

4. How often do you meet with fellow students outside of class?   
     Always   Never       Rarely       Occasionally  Frequently 
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5


5. What is the usual purpose of meeting with students outside of
class?
A.
B.
C.

6. How many fellow students would you say you have friendships
with?              
     None     A Few      About Half        Most       All
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

7. How often do you think about or "mull over" course or course
related material out-side of class (other than for class
preparation or for class assignments)? 
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

8. How often do you discuss aspects of the course material with
someone outside of class? 
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

9. With whom do you generally have these discussions? (e.g.,
friends, mother, roommate. etc.)?
A.
B.
C.


10. How often does course content motivate you to do additional
reading? 
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

11. How often do you find yourself getting "interested" in the
course material? 
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

12. How often do you find yourself getting "absorbed" in the course
material.
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

13. How often does course content relate to you personally?
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

14. How often in the classroom does it feel acceptable to relate
course material to your personal life? 
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

15. How often do yoU feel "encouraged" by the instructor to relate
course material to yourpersanal life?
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

16. How often in the classroom do you verbally express a personal
connection to course content?
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

17. How often does course content actually affect you or your life
in some significant way? 
     Never   Rarely     Occasionally    Frequently   Always
A.     1        2            3               4         5 
B.     1        2            3               4         5 
C.     1        2            3               4         5

18. Describe how course content has affected you or your life?
A.
B.
C.

19. In the space below or on the back, write any additional
comments you might have regarding any of the question(s) in this
questionnaire.

20. Age:

21. sex: Female/Male

22. Which one of the following race groups do you identify with and
feel you belong to? 
1. American Indian 
2. Black (or Afro American) 
3. Hispanic (or Mexican American/Chicano, etc.) 
4. Asian (or Oriental) 
5. Anglo (or Caucasian)

23. How much education was completed by your parent who went to
school longer? 
1. junior high 
2. high school vocational/technical 
4. college (4 year degree)
5. graduatc school (doctor, lawyer, Ph.D., etc.)

24. In which social class would you say that your family is
located? 
1. lower class 
2. working class 
3. middle class
4. upper middle class 
5. upper class

25. Your current student classification: 
1. Freshman 
2. Sophomore 
3. Junior 
4. Senior 
5. Unclassified

26. Your academic major:
    Second major/certificate:

27. If you would be willing to participate in further discussion
regarding your learning experiences at the University of Colorado,
please list your name, current address, and permanent address
below.