PropertyValue
?:abstract
  • Increased use of computer-based assessments has facilitated data collection processes that capture both response product data (i.e., correct and incorrect) and response process data (e.g., time-stamped action sequences). Evidence suggests a strong relationship between respondents’ correct/incorrect responses and their problem-solving proficiency scores. However, few studies have reported the predictability of fine-grained process information on respondents’ problemsolving proficiency levels and the degree of granularity needed for accurate prediction. This study uses process data from interactive problem-solving items in the Programme for the International Assessment of Adult Competencies (PIAAC) to predict proficiency levels with hierarchical classification methods. Specifically, we extracted aggregate-level process variables and item-specific sequences of problem-solving strategies. Two machine learning methods – random forest and support vector machine – affiliated with two multiclass hierarchical classification approaches (i.e., flat classification and hierarchical classification) were examined. Using seven problem-solving items from the U.S. PIAAC process data sample, we found that the hierarchical approach affiliated with any machine learning method performed moderately better than the flat approach in proficiency level prediction. This study demonstrates the feasibility of using process variables to classify respondents by problem-solving proficiency levels, and thus, supports the development of tailored instructions for adults at different levels. (xsd:string)
?:author
?:comment
  • (PIAAC) (xsd:string)
?:dataSource
  • PIAAC-Bibliography (xsd:string)
?:dateModified
  • 2023 (xsd:gyear)
?:datePublished
  • 2023 (xsd:gyear)
?:duplicate
?:fromPage
  • 145 (xsd:string)
is ?:hasPart of
?:inLanguage
  • english (xsd:string)
?:isPartOf
?:issueNumber
  • 1 (xsd:string)
is ?:mainEntity of
?:name
  • Predicting problem-solving proficiency with multiclass hierarchical classification using process data: A machine learning approach (xsd:string)
?:publicationType
  • article (xsd:string)
?:sourceInfo
  • Bibsonomy (xsd:string)
  • In Psychological Test and Assessment Modeling, 65(1), 145-178, 2023 (xsd:string)
?:studyGroup
  • PIAAC - Programme for the International Assessment of Adult Competencies (xsd:string)
?:tags
  • 2023 (xsd:string)
  • FDZ_PIAAC (xsd:string)
  • FDZbericht (xsd:string)
  • PIAAC (xsd:string)
  • PIAAC_input2023 (xsd:string)
  • PIAAC_pro (xsd:string)
  • article (xsd:string)
  • english (xsd:string)
  • indexproved (xsd:string)
  • noindex (xsd:string)
  • review_proved (xsd:string)
  • reviewed (xsd:string)
  • transfer23 (xsd:string)
?:toPage
  • 178 (xsd:string)
rdf:type
?:url
?:volumeNumber
  • 65 (xsd:string)