The Decision Making Individual Differences Inventory (DMIDI) is a catalogue of over 170 individual difference measures commonly used in judgment and decision-making research. Basic descriptive information (including references & scale information) is available for all measures. Topics covered include attitude to risk, cognitive ability, motivation and personality (which includes time orientation). DMIDI is maintained by Kirstin Appelt, Kerry Milch, Michel Handgraaf and Elke Weber (all affiliated to the Center for Research on Environmental Decisions, Columbia University, New York).
A similar initiative is the Social-Personality Psychology Questionnaire Instrument Compendium (QIC), which links only to pages where (a) the full instrument is shown, and (b) the instrument was put on the web by the person who created the instrument, thus ensuring that the instrument was intended to be put into the public domain. QIC is maintained by Alan Reifman from Texas Tech University.
The (U.S. National Institutes of Health) National Cancer Institute Grid-Enabled Measures (GEM) database is a website of behavioral and social science measures. Researchers have the ability to search, download, submit and provide feedback on measures. The purpose of GEM is to provide a resource that enables researchers to:
# Use standardized, vetted measures; and
# Share data that results from using these measures
Showing posts with label non-cognitive skills. Show all posts
Showing posts with label non-cognitive skills. Show all posts
Friday, March 11, 2011
Wednesday, March 9, 2011
What Do Students Learn in College?
They might attend their lectures, do additional hours of study and get good grades; but... what are students learning in college? A recent article in the New York Times asks just this question: "what are America's kids actually learning in college?". Thanks to Peter C for sending on the link. According to the NYT article, "a provocative new book, Academically Adrift: Limited Learning on College Campuses, makes a strong case that for a large portion of the nation’s seemingly successful undergraduates, the years in college barely improve their skills in critical thinking, complex reasoning and writing." The authors are Professors Richard Arum of New York University and Josipa Roksa of the University of Virginia. A Google-Books preview is available here.
Arum and Roska's research draws on survey responses, transcript data, and the Collegiate Learning Assessment, a standardised test administered to students in their first semester and then again at the end of their second year. More details on the authors' research project are available here. According to the authors' analysis (of more than 2,300 undergraduates at twenty-four institutions), 45 percent of these students demonstrate no significant improvement in a range of skills, including: critical thinking, complex reasoning and writing (during their first two years of college). According to the authors, "many students come to college not only poorly prepared by prior schooling for highly demanding academic tasks that ideally lie in front of them, but — more troubling still — they enter college with attitudes, norms, values, and behaviors that are often at odds with academic commitment."
In relation to academic commitment, education economists would draw attention to the idea of non-cognitive skills. Pedro Martins has shown that a targeted program related to non-cognitive ability – study skills, motivation, and self-esteem – can improve student achievement at state schools in Portugal. In work that I have done with Liam and Colm, there is a clear demonstration of academic advantage for Irish university students who are more future-orientated and more conscientious. A targeted program (providing academic and social supports) was evaluated in the setting of an Irish university by Denny, Doyle, O’Reilly and O’Sullivan (2010); the results suggesting it was an effective means of improving academic outcomes for socio-economically disadvantaged students attending Irish universities.
Returning to the NYT article, it interprets Arum and Roksa's research to indicate that "students are hitting the books less and partying more. Easier courses and easier majors have become more and more popular. Perhaps more now than ever, the point of the college experience is to have a good time and walk away with a valuable credential after putting in the least effort possible." A study by three Cornell economists found a large increase in enrollment in courses with a median grade of A; after a new policy which introduced the publication of course median grades on the Internet. This is suggestive of students enrolling in classes where it easier to obtain higher grade-scores; an issue which I raised before in relation to the Irish Leaving Certificate: the final examination at the end of second-level education Ireland.
Recent research by Brian Jacob, Brian McCall and Kevin Stange (all from the University of Michigan) specifically addresses the issue of the consumption-value of college education. Jacob, McCall and Stange report that students "appear to value several college attributes which we categorize as consumption because their benefits arguably accrue only while actually enrolled, including college spending on student activities, sports, and dormitories." In addition, research by Babcock and Marks (discussed on this blog before) documents that academic time investment among full-time college students fell from 40 hours per in 1961 to 27 hours per week in 2003. Another article from the NYT tells us that Arum and Roksa's research is "consistent with the findings of the National Survey of Student Engagement, which has polled more than 2 million students at more than 1,000 colleges and universities over more than a decade — and reported that many spend little time studying or writing."
According to this article in the Huffington Post, the Collegiate Learning Assessment "has its share of critics who say it doesn't capture learning in specialized majors or isn't a reliable measure of college performance because so many factors are beyond their control." Nonetheless, it looks like this debate is set to grow more widespread in the future. It also resonates with last year's debate in Ireland about the issue of grade inflation. Introducing a research component into the undergraduate curriculum could be one way to improve students' skills in critical thinking, complex reasoning and writing. In 2005, Trinity College Dublin launched a summer programme offering undergraduate students, typically from Science and Engineering, the opportunity to work in research for an 11 week period, on projects in laboratory environments.
Arum and Roska's research draws on survey responses, transcript data, and the Collegiate Learning Assessment, a standardised test administered to students in their first semester and then again at the end of their second year. More details on the authors' research project are available here. According to the authors' analysis (of more than 2,300 undergraduates at twenty-four institutions), 45 percent of these students demonstrate no significant improvement in a range of skills, including: critical thinking, complex reasoning and writing (during their first two years of college). According to the authors, "many students come to college not only poorly prepared by prior schooling for highly demanding academic tasks that ideally lie in front of them, but — more troubling still — they enter college with attitudes, norms, values, and behaviors that are often at odds with academic commitment."
In relation to academic commitment, education economists would draw attention to the idea of non-cognitive skills. Pedro Martins has shown that a targeted program related to non-cognitive ability – study skills, motivation, and self-esteem – can improve student achievement at state schools in Portugal. In work that I have done with Liam and Colm, there is a clear demonstration of academic advantage for Irish university students who are more future-orientated and more conscientious. A targeted program (providing academic and social supports) was evaluated in the setting of an Irish university by Denny, Doyle, O’Reilly and O’Sullivan (2010); the results suggesting it was an effective means of improving academic outcomes for socio-economically disadvantaged students attending Irish universities.
Returning to the NYT article, it interprets Arum and Roksa's research to indicate that "students are hitting the books less and partying more. Easier courses and easier majors have become more and more popular. Perhaps more now than ever, the point of the college experience is to have a good time and walk away with a valuable credential after putting in the least effort possible." A study by three Cornell economists found a large increase in enrollment in courses with a median grade of A; after a new policy which introduced the publication of course median grades on the Internet. This is suggestive of students enrolling in classes where it easier to obtain higher grade-scores; an issue which I raised before in relation to the Irish Leaving Certificate: the final examination at the end of second-level education Ireland.
Recent research by Brian Jacob, Brian McCall and Kevin Stange (all from the University of Michigan) specifically addresses the issue of the consumption-value of college education. Jacob, McCall and Stange report that students "appear to value several college attributes which we categorize as consumption because their benefits arguably accrue only while actually enrolled, including college spending on student activities, sports, and dormitories." In addition, research by Babcock and Marks (discussed on this blog before) documents that academic time investment among full-time college students fell from 40 hours per in 1961 to 27 hours per week in 2003. Another article from the NYT tells us that Arum and Roksa's research is "consistent with the findings of the National Survey of Student Engagement, which has polled more than 2 million students at more than 1,000 colleges and universities over more than a decade — and reported that many spend little time studying or writing."
According to this article in the Huffington Post, the Collegiate Learning Assessment "has its share of critics who say it doesn't capture learning in specialized majors or isn't a reliable measure of college performance because so many factors are beyond their control." Nonetheless, it looks like this debate is set to grow more widespread in the future. It also resonates with last year's debate in Ireland about the issue of grade inflation. Introducing a research component into the undergraduate curriculum could be one way to improve students' skills in critical thinking, complex reasoning and writing. In 2005, Trinity College Dublin launched a summer programme offering undergraduate students, typically from Science and Engineering, the opportunity to work in research for an 11 week period, on projects in laboratory environments.
Saturday, February 5, 2011
Resilience
One of the non-cognitive skills that recent research has emphasized is resilience to adversity, for example Heckman & Cunha, 2009. We could do with a bit of that here & indeed some folks are doing their bit to that end.
Monday, January 3, 2011
Can Targeted, Non-Cognitive Skills Programs Improve Achievement?
This is the title of a new research paper by Pedro Martins from the University of London. Martins’ findings show that a targeted program related to non-cognitive ability – in this case study skills, motivation, and self-esteem – can improve student achievement at state schools in Portugal. In work that I have done with Liam and Colm, there is a clear demonstration of academic advantage for Irish university students who are more future-orientated and more conscientious. Given all of the above, there is a case for considering whether the Portugese program can translate (with obvious modifications) to Irish universities, and Irish schools. Of course, it must be borne in mind that there is an existing Access program in Irish universities (and Irish schools) which provides academic and social supports. The Access program was evaluated in the setting of an Irish university by Denny, Doyle, O’Reilly and O’Sullivan (2010); the results suggesting that Access programs can be an effective means of improving academic outcomes for socio-economically disadvantaged students attending Irish universities. One question that I plan to investigate further is whether the design of Access programs in Ireland exlicitly considers the concept of non-cognitive skill formation. I would be interested to hear from any readers who have any information on this.
Subscribe to:
Posts (Atom)