{"id":306,"date":"2018-03-06T08:13:46","date_gmt":"2018-03-06T07:13:46","guid":{"rendered":"https:\/\/brainsintheclouds.eu\/?page_id=306"},"modified":"2018-06-25T10:04:34","modified_gmt":"2018-06-25T09:04:34","slug":"documenting-the-learning-and-competences","status":"publish","type":"page","link":"https:\/\/brainsintheclouds.eu\/?page_id=306","title":{"rendered":"Documenting the Learning and Competences"},"content":{"rendered":"<p><strong>Learning analytics<\/strong><br \/>\nThe aim was to find out which activities the children performed and how these were related to competencies. It was important for us \u2013 accordingly to John Hattie \u2013 to make the learning of the children visible. (visible-learning.org)<br \/>\nIn order to do so, we had to find a way to track the children\u2019s activities. As the project proposal suffered budget cuts that concerned mainly the IT equipment, we had to refrain from the original idea that most of the activities would happen online and we had to find a way to track tasks that were performed offline.<br \/>\nWe came up with the decision to deliver the learning material as well as the assignments in the form of \u201ctasksheets\u201d and print a QR-code on each sheet.<\/p>\n<p><strong>Hand-it-in-App<\/strong><br \/>\nThe Hand-it-in-App is an online application that allowed children to \u201chand in\u201d their work by scanning the QR code of the related task sheet.<br \/>\nWhen following the QR code on a specific task sheet, kids reached a page that contained the digital version of the task. In the user interface, the children could identify themselves by choosing their personal icon (sticker). Then they could provide results (answer questions, upload pictures, provide links to videos), write feedback and tick a smiley to indicate how much they liked the task.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-671\" src=\"https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/media-1-300x160.png\" alt=\"\" width=\"373\" height=\"199\" srcset=\"https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/media-1-300x160.png 300w, https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/media-1.png 668w\" sizes=\"auto, (max-width: 373px) 85vw, 373px\" \/><\/p>\n<p><strong>Competency framework<\/strong><br \/>\nWe decided to use an existing competences framework instead of inventing a new one.<br \/>\nAs the boxes covered quite a large variety of topics and transversal skills, we chose the \u201c21st century skills\u201d framework of the University of Melbourne (http:\/\/www.atc21s.org\/, http:\/\/www.p21.org\/), which is very general and holistic. We liked its approach to not only include knowledge but also skills and attitudes. Our boxes covered about two thirds of its categories, and we added six more to cover all our boxes.<br \/>\nThe 15 most often used competencies were:<br \/>\n<em>1. Follow instructions (e.g. tutorial video or instruction manual)<\/em><br \/>\n<em>2. Develop, implement and communicate new ideas to others effectively<\/em><br \/>\n<em>3. Infer, query evidence, conjecture alternatives and draw conclusions<\/em><br \/>\n<em>4. Use technology as a tool to research, organize, evaluate and communicate information<\/em><br \/>\n<em>5. Improve handicraft skills<\/em><br \/>\n<em>6. Analyze how parts of a whole interact with each other to produce overall outcomes\u00a0<\/em><em>in complex systems. Examine ideas, identify and analyse arguments<\/em><br \/>\n<em>7. Ability to concentrate for extended as well as short periods of time<\/em><br \/>\n<em>8. Use various types of reasoning (inductive, deductive, etc.) as appropriate to the\u00a0<\/em><em>situation<\/em><br \/>\n<em>9. Be open to non-familiar, unconventional and innovative solutions to problems\u00a0<\/em><em>and ways to solve problems<\/em><br \/>\n<em>10. Confidence when speaking in public<\/em><br \/>\n<em>11. Prioritize, plan and manage work to achieve the intended group result<\/em><br \/>\n<em>12. Logical thinking (programming) \u2013 formulate algorithms in various forms<\/em><br \/>\n<em>13. Monitor, define, prioritize and complete tasks without direct oversight<\/em><br \/>\n<em>14. Know when it is appropriate to listen and when to speak<\/em><br \/>\n<em>15. Work effectively in diverse teams<\/em><\/p>\n<p>However, as not all the tasks were actually performed (the locations were free to select which tasks they wanted to offer), the list of actually addressed competencies was smaller. The top 15 of this list are shown in the following table. Qualitative feedback of teachers confirmed an overall increase of these competencies in their groups.<br \/>\nThe 15 most addressed competencies in locations:<\/p>\n<p><em>1. Ability to read and understand different texts, adopting strategies appropriate to various reading purposes (reading for information, for study or for pleasure) and to various text types<\/em><br \/>\n<em>2. Sound knowledge of basic vocabulary, functional grammar and style, functions of language<\/em><br \/>\n<em>3. Ability to concentrate for extended as well as short periods of time<\/em><br \/>\n<em>4. Know a wide range of idea creation techniques (such as brainstorming)<\/em><br \/>\n<em>5. Know when it is appropriate to listen and when to speak<\/em><br \/>\n<em>6. Speak with clarity and awareness of audience and purpose. Listen with care, patience and honesty<\/em><br \/>\n<em>7. Act responsibly with the interests of the larger community in mind<\/em><br \/>\n<em>8. Follow instruction (e.g. tutorial video or instruction manual)<\/em><br \/>\n<em>9. Analyze how parts of a whole interact with each other to produce overall outcomes in complex systems. Examine ideas, identify and analyse arguments<\/em><br \/>\n<em>10. Be open to non-familiar, unconventional and innovative solutions to problems and ways to solve problems<\/em><br \/>\n<em>11. Improve handicraft skills<\/em><br \/>\n<em>12. Ask significant questions that clarify various points of view and lead to better solutions<\/em><br \/>\n<em>13. Be open to new and worthwhile ideas (both incremental and radical concepts)<\/em><br \/>\n<em>14. Create new and worthwhile ideas (both incremental and radical concepts)<\/em><br \/>\n<em>15. Develop, implement and communicate new ideas to others effectively<\/em><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Evaluations<\/strong><br \/>\nAs we knew for each task which competencies it addressed, we could easily produce charts that showed an overview of student\u2019s addressed competencies, like the one in the following table.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter  wp-image-694\" src=\"https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval1-300x138.png\" alt=\"\" width=\"322\" height=\"148\" srcset=\"https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval1-300x138.png 300w, https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval1-768x352.png 768w, https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval1-1024x470.png 1024w, https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval1-1200x551.png 1200w, https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval1.png 1377w\" sizes=\"auto, (max-width: 322px) 85vw, 322px\" \/><\/p>\n<p>The other evaluation shows which tasks were already done by which students:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-696\" src=\"https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval3-300x116.png\" alt=\"\" width=\"300\" height=\"116\" srcset=\"https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval3-300x116.png 300w, https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval3-768x296.png 768w, https:\/\/brainsintheclouds.eu\/wp-content\/uploads\/2018\/06\/eval3.png 992w\" sizes=\"auto, (max-width: 300px) 85vw, 300px\" \/><\/p>\n<p>This helped the teachers to keep an overview of what was done and showed students how much they have already done and how much they still could do. (Sometimes these sheets were put on the wall.)<\/p>\n<p><strong>Limitations<\/strong><br \/>\nAlthough this system of tracking activities and evaluating competencies theoretically worked quite well, it showed some major weaknesses:<br \/>\n\u2022 Incompleteness of data: All three locations often had to deal with unstable or unavailable internet. If the hand-it-inapp was not available, then the teachers would have to manually take notes and enter the data later, as soon as the internet was available again. In this process, data was often lost.<br \/>\n\u2022 Too little added value: In the end, the evaluations did not produce enough added value to justify the additional effort of the hand-it-in-app (for teachers as well as for students) &#8211; especially under weak internet conditions (see above). We had several ideas how to improve the visualization of the learning progress in order to improve student\u2019s motivation but did not have time to put it into practice.<br \/>\nDue to these limitations it was not possible to meaningfully link the data with the rest of the evaluation. However it strengthened the interpretation of the other outcomes.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Learning analytics The aim was to find out which activities the children performed and how these were related to competencies. It was important for us \u2013 accordingly to John Hattie \u2013 to make the learning of the children visible. (visible-learning.org) In order to do so, we had to find a way to track the children\u2019s &hellip; <a href=\"https:\/\/brainsintheclouds.eu\/?page_id=306\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Documenting the Learning and Competences&#8221;<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-306","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=\/wp\/v2\/pages\/306","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=306"}],"version-history":[{"count":9,"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=\/wp\/v2\/pages\/306\/revisions"}],"predecessor-version":[{"id":697,"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=\/wp\/v2\/pages\/306\/revisions\/697"}],"wp:attachment":[{"href":"https:\/\/brainsintheclouds.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=306"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}