#GuildChat for 05/15/2015: Tracking Learning with Technology
Our next #GuildChat takes place Friday May 15th at 11am PT / 2pm ET. Our topic for this week’s chat is Tracking Learning with Technology.
Organizations and institutions have always strove to track the effectiveness of their strategies and
approaches. From Marketing departments collecting data on their latest campaign to Sales projecting revenue in shorter and shorter terms; knowing what is working and what is not helps in making quick decisions and adjusting to changing needs.
In this week’s #GuildChat we look closer at the efforts to track learning and the technologies being deployed to gauge the effectiveness and efficiency of various approaches at improving performance and changing behavior. Can learning really be tracked? What tools and technologies are being used today and which are emerging to provide organizations better measure of learning’s impact on the bottom line.
Here are the questions currently scheduled to be posed during the chat.
- Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOULD mean? #GuildChat
- Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat
- Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat
- Q4) Would you agree or disagree that there may be a potential dark side in trying to track learning? Why or why not? #GuildChat
- Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildChat
- Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in practice? #GuildChat
- Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat
Chat Transcript
NOTE: Tweets are listed in the order they were posted and are shown in Eastern Time. To visit the actual posting for a particular tweet, click the associated user name for the posting.
2:02 PM | eLearningGuild | Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGuild |
2:02 PM | eLearningGuild | Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the hashtag in your tweets. |
2:02 PM | JD_Dillon | RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui… |
2:03 PM | eLearningGuild | Please take a moment to introduce and tell us a little bit about yourself. The first question will be posed in just 2 minutes. #GuildChat |
2:04 PM | LearnovateSA | RT @eLearningGuild: Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the has… |
2:04 PM | LearnovateSA | RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui… |
2:05 PM | learndrops | Laura with the Learndrops Project. Working on an instructional design crowdsourcing project. #GuildChat https://t.co/XBf3eTKiX5 |
2:05 PM | learning9togrow | Jorge Zavala in Califonia #guildchat |
2:05 PM | eLearningGuild | Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOULD mean? #GuildChat |
2:05 PM | britz | Hi everyone. Mark Britz joining in from #Syracuse. Long-time learning pro now w/ the @elearningguild, still all about learning :) #guildchat |
2:05 PM | urbie | RT @eLearningGuild: Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the has… |
2:05 PM | JD_Dillon | JD in Orlando, FL. Learning geek, sharer, local info hub for #ATD2015 attendees! #GuildChat https://t.co/ZqXBpIQNSZ |
2:06 PM | urbie | RT @LnDDave: TRANSCRIPT NOW POSTED – #GuildChat for 05/08/2015: Using Electronic Performance Support Systems (EPSS) http://t.co/VH65uK7kk4 |
2:06 PM | britz | RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL… |
2:06 PM | learndrops | A1a: Track outward, measurable signs of learning w/ respect to individual. Where is help needed? #GuildChat https://t.co/2Qqu90kZwF |
2:06 PM | LnDDave | Greetings #GuildChat. David from @eLearningGuild looking forward to today’s chat. |
2:06 PM | learndrops | A1b: Track performance of course, statistically and based on evals. Places for course improvement. #GuildChat |
2:06 PM | learndrops | A1c: Track performance & uplift in an organization: progress in learning/sharing activities + real world KPIs. #GuildChat |
2:07 PM | CandiceCPLP | Hi, all – Candice in NC, evangelizing the 5 moments of need. #guildchat |
2:07 PM | urbie | #GuildChat urban from somewhere in the 48th state |
2:07 PM | urbie | RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui… |
2:07 PM | learning9togrow | the complex world of how you now that the people learn and how they learn #guildchat |
2:07 PM | urbie | RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL… |
2:07 PM | JD_Dillon | A1) Usually means “completion” of some activity; rather talk about measuring performance improvement. #guildchat https://t.co/8B5dnCPK4l |
2:07 PM | LnDDave | RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL… |
2:08 PM | britz | RT @JD_Dillon: A1) Usually means “completion” of some activity; rather talk about measuring performance improvement. #guildchat https://t.… |
2:08 PM | Quinnovator | Clark Quinn, L&D improvement instigator, consultant/author/speaker, Walnut Creek CA #guildchat |
2:09 PM | LnDDave | A1) tracking learning always seemed like the wrong phrase. Measuring? Maybe. But not tracking. #GuildChat |
2:09 PM | urbie | #GuildChat A1 A thing looking over your shoulder to make sure you’re actually in front of a PC in an LMS for the requisite amount of time. |
2:09 PM | CandiceCPLP | A1) to me, tracking results in all dimensions, but that’s not what I’m asked for! #guildchat |
2:09 PM | learning9togrow | A1) registering the path followed by people while the are learning #guildchat |
2:10 PM | CandiceCPLP | @JD_Dillon – or performance of any kind, improvement or not, eh? #guildchat |
2:10 PM | MelMilloway | Hey, all. Missing #Guildchat because I have a lot to get done before #ATD2015. Enjoy the chat and I shall see some of you there! |
2:10 PM | AlwaysBreaking | A1) “Tracking” usually refers to stats about training. Completions, attendance, number sessions, registrations, etc. #GuildChat |
2:10 PM | britz | @LnDDave Yet even Measuring is extremely problematic. Learning is internal/personal. Training the input. performance the output #guildchat |
2:11 PM | JD_Dillon | @CandiceCPLP True … it’s the only outcome that matters … #GuildChat |
2:11 PM | salah784 | RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL… |
2:11 PM | LearnovateSA | RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL… |
2:11 PM | salah784 | RT @eLearningGuild: Please take a moment to introduce and tell us a little bit about yourself. The first question will be posed in just 2 m… |
2:11 PM | CraigTaylor74 | 1) #Guildchat It sounds like what it is. A half-assed term. |
2:11 PM | CraigTaylor74 | RT @britz: @LnDDave Yet even Measuring is extremely problematic. Learning is internal/personal. Training the input. performance the output … |
2:12 PM | eLearningGuild | Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat |
2:12 PM | salah784 | RT @eLearningGuild: Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the has… |
2:12 PM | LnDDave | A1) in the context of organizations, learning isn’t a key metric; it’s less about what we know and more about what we do. #GuildChat |
2:12 PM | Quinnovator | a1) tracking learning should measure change in abilities, tends to currently mean ‘completion’ #guildchat |
2:12 PM | learndrops | Seems like tracking is often what we do. Measuring is closer to what we should do. @LnDDave #GuildChat https://t.co/YwMADHNIOs |
2:12 PM | salah784 | RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui… |
2:12 PM | britz | RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat |
2:12 PM | Quinnovator | RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat |
2:12 PM | britz | RT @Quinnovator: a1) tracking learning should measure change in abilities, tends to currently mean ‘completion’ #guildchat |
2:12 PM | urbie | RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat |
2:12 PM | learndrops | A2a: Need to separate the internal from the external – observable. #GuildChat https://t.co/nrTCimGEXE |
2:12 PM | learning9togrow | A1) I would like to see as real measurement about how much the people learned not only the path followed #guildchat |
2:12 PM | LnDDave | RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat |
2:13 PM | CandiceCPLP | A1b) Seems to be used mostly by co’s that are process-oriented, instead of value- or results-oriented #guildchat |
2:13 PM | learndrops | A2b: We cannot measure the degree & depth to which understanding of a key dynamic changes. “Learning” is internal. #GuildChat |
2:13 PM | Quinnovator | a2) we can assess competencies, but we should also be looking at other evidence of accomplishment (e.g. success in task) #guildchat |
2:13 PM | CandiceCPLP | RT @LnDDave: A1) in the context of organizations, learning isn’t a key metric; it’s less about what we know and more about what we do. #Gu… |
2:13 PM | learndrops | A2c: We can, however, observe & measure performance. How you respond to scenarios that draw upon that understanding. #GuildChat |
2:13 PM | JD_Dillon | A2) You can measure behavior change, including display of knowledge – but you can’t “track learning” #guildchat https://t.co/YtqweKxLDR |
2:13 PM | JD_Dillon | A2) You can measure behavior change, including display of knowledge – but you can’t “track learning” #guildchat https://t.co/YtqweKxLDR |
2:14 PM | AlwaysBreaking | A2) Learning can be tracked by measuring performance. As people learn, they tend to perform better on the job. #guildchat |
2:14 PM | learning9togrow | I know that I learned when I can use the acquired knowledge applied in a given situation, no just a test #guildchat |
2:14 PM | ECHersh | a2) We are tracking learning via monitoring implementation of new knowledge and skills. #GuildChat |
2:14 PM | LnDDave | A2) I hate absolutes. I’ll say that with today’s tech some, but not all, learning activities can be tracked. #GuildChat |
2:14 PM | Quinnovator | @CraigTaylor74 def’n of learning: new behavior in same context, so measured change in behavior indicates learning, no? #guildchat |
2:14 PM | urbie | #GuildChat A2 Dunno. Depends on the definition and what watchers want to take away. Proctors walking on elevated catwalks can track. |
2:14 PM | britz | A2. Experiences, exposure, involvement with content, yes. What was learned from them… not so easy. #guildchat |
2:14 PM | Quinnovator | @CraigTaylor74 (to go a wee bit ‘behaviorist’ ;) #guildchat |
2:15 PM | Tech_Sharer | RT @LnDDave: A2) I hate absolutes. I’ll say that with today’s tech some, but not all, learning activities can be tracked. #GuildChat |
2:15 PM | learndrops | Agree. The real-world component is important. #GuildChat https://t.co/5RmwZfOOWt |
2:15 PM | LnDDave | A2) part of the challenge with this is a lack of consensus around what it means to have “learned”. #GuildChat |
2:15 PM | britz | RT @LnDDave: A2) part of the challenge with this is a lack of consensus around what it means to have “learned”. #GuildChat |
2:15 PM | ECHersh | @AlwaysBreaking: Re A2) How do you measure job performance? #guildchat |
2:15 PM | CandiceCPLP | A2) Have to define ‘learning’ first. Several options: show your work, journaling, demonstration, performance coaching. #guildchat |
2:16 PM | learndrops | RT @britz: A2. Experiences, exposure, involvement with content, yes. What was learned from them… not so easy. #guildchat |
2:16 PM | learning9togrow | a2) the bloom taxonomy gave us 6 levels and getting to the last one is where we can perform a evaluation #guildchat |
2:16 PM | urbie | #GuildChat A2 Certain LMSs (don’t ask me which) can monitor clicks, time spent in a space, all manner of e-minutiae. |
2:16 PM | learning9togrow | A2) I agree with you @LnDDave:, but how do you build this consensus? #guildchat |
2:16 PM | CraigTaylor74 | @Quinnovator what if my behaviour has changed because I’ve followed a job aid? #Guildchat |
2:17 PM | urbie | #GuildChat A2 But tracking learning, don’t think so. Is it learning that you want to measure? Or is it application post-event? |
2:17 PM | britz | @ECHersh @AlwaysBreaking Depends on the job tasks/requirements and measures of success #guildchat |
2:17 PM | AlwaysBreaking | @ECHersh Depends on the job. Sales performance has tangible metrics, some of which are influenced by training/learning. #guildchat |
2:17 PM | Quinnovator | that doesn’t sound right, Bloom’s is about determining what level you need, not getting to top #guildchat https://t.co/wg58OPIkWu |
2:18 PM | urbie | #GuildChat A2 A while ago I learned that some compulsory (compliance) training is mandated that the learner be in the course a set time. |
2:19 PM | Quinnovator | @learning9togrow tho’ not a fan of bloom’s in general (cf Sugrue evisceration: http://t.co/uxAiHOanbU) #guildchat |
2:19 PM | eLearningGuild | Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat |
2:19 PM | Quinnovator | @learndrops @CraigTaylor74 no, following job aid doesn’t mean learned #guildchat |
2:19 PM | learning9togrow | Do you learn what you need and then evaluate if you learned? #guildchat |
2:19 PM | britz | RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat |
2:19 PM | urbie | RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat |
2:19 PM | Quinnovator | @CraigTaylor74 that’s not the same context: task w/ job aid not same as task w/o #guildchat |
2:19 PM | Quinnovator | RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat |
2:20 PM | CandiceCPLP | Big diff btwn ‘tracking’ and ‘measuring’ – one is a path, the other a result #guildchat |
2:20 PM | Quinnovator | RT @CandiceCPLP: Big diff btwn ‘tracking’ and ‘measuring’ – one is a path, the other a result #guildchat |
2:20 PM | CandiceCPLP | @Quinnovator @learndrops @CraigTaylor74 It does mean you learned to use the job aid! #guildchat |
2:20 PM | learning9togrow | A3) if learning is a journey, I assume that i would like to know that I reach the end of it #guildchat |
2:20 PM | urbie | #GuildChat A3 Should learning be tracked? Dunno. Maybe we need another word. Tracked is like “Sic the dogs on ’em” so don’t wanna go there. |
2:21 PM | learndrops | A3a: Data gives us insight. Allows us to see how things work & make improvements. Can be important tool. #GuildChat https://t.co/SQlJHxv6V6 |
2:21 PM | kukharenko | RT @Quinnovator: that doesn’t sound right, Bloom’s is about determining what level you need, not getting to top #guildchat https://t.co/wg5… |
2:21 PM | LnDDave | RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat |
2:21 PM | Quinnovator | a3) we should track learning, but more too: performance, what we’ve looked at, etc, trying to determine what leads to success #guildchat |
2:21 PM | ECHersh | @AlwaysBreaking. Some prof more easily tracked than others. Tracking learning implement across sectors (e.g. via MOOCs) is tough #guildchat |
2:21 PM | learndrops | A3b: The problem is not in the data / act of tracking. The problem is in the goal of that tracking. #GuildChat |
2:21 PM | CraigTaylor74 | @CandiceCPLP @Quinnovator @learndrops LOL. True that!! :-) #Guildchat |
2:21 PM | JD_Dillon | A3) Measure the desired outcomes and correlate to how our interventions support them #GuildChat https://t.co/qqiToKEJuu |
2:21 PM | learning9togrow | RT @CandiceCPLP Big diff btwn ‘tracking’ and ‘measuring’ – one is a path, the other a result #guildchat |
2:21 PM | learndrops | A3c: To what end are we optimizing our systems? Success on a test? Or success in life? #GuildChat |
2:22 PM | urbie | #GuildChat A3 Certainly appreciate the need to determine efficacy. Which is why I try (sometimes unsuccessfully) to get #make in somewhere. |
2:22 PM | learndrops | RT @Quinnovator: a3) we should track learning, but more too: performance, what we’ve looked at, etc, trying to determine what leads to suc… |
2:22 PM | AlwaysBreaking | @ECHersh yeah, that would be a challenge. Focusing on competencies can help with tracking/measuring. #guildchat |
2:22 PM | LnDDave | RT @JD_Dillon: A3) Measure the desired outcomes and correlate to how our interventions support them #GuildChat https://t.co/qqiToKEJuu |
2:22 PM | SimonBlairTrain | Sorry I’m late to #Guildchat. My other meeting is done now. |
2:23 PM | urbie | #GuildChat A3 Learners should do something with whatever they were exposed to and make something: a blog post, report, widget. Something. |
2:23 PM | britz | A3. We should be conscious of our OWN learning (monitoring) and sharing it so as to build upon and adjust for new information #guildchat |
2:23 PM | urbie | #GuildChat A3 Then share it with a peer, manager, other human that matters. |
2:23 PM | SimonBlairTrain | A3: We should track results (e.g. business impact). Learning is a means, not and end. #Guildchat |
2:24 PM | CandiceCPLP | A3) think we should be ‘tracking’ accountability for performance/mastery – can be learner, manager, coach, trainer… need a RACI #guildchat |
2:24 PM | unboxedtech | RT @SimonBlairTrain: A3: We should track results (e.g. business impact). Learning is a means, not and end. #Guildchat |
2:24 PM | learning9togrow | tracking provide information to find out if we succeed or not, we need to know both cases #guildchat |
2:24 PM | JD_Dillon | RT @britz: A3. We should be conscious of our OWN learning (monitoring) and sharing it so as to build upon and adjust for new information #g… |
2:24 PM | LnDDave | A3) There’s no single bullet on what should be measured. Context matters. #GuildChat |
2:24 PM | Quinnovator | @CraigTaylor74 @learndrops agreed, and job aid may not make sense to learn (e.g. info changing too fast). #guildchat |
2:24 PM | urbie | RT @LnDDave: A3) There’s no single bullet on what should be measured. Context matters. #GuildChat |
2:25 PM | JD_Dillon | RT @LnDDave: A3) There’s no single bullet on what should be measured. Context matters. #GuildChat |
2:25 PM | AlwaysBreaking | @SimonBlairTrain Exactly. Outcomes and performance are what matters. Attendance doesn’t matter if people can’t apply anything. #guildchat |
2:25 PM | CandiceCPLP | @urbie I’m ok with that if it includes ‘a connection’ Too many pieces/parts and not enough context #guildchat |
2:25 PM | SimonBlairTrain | @LnDDave Right! What’s the the problem the client wants to solve? That will tell you what to measure. #Guildchat |
2:25 PM | learning9togrow | The final step to confirm learning is the capability to show it, and teachig is the hardest one @urbie #guildchat |
2:25 PM | CandiceCPLP | @LnDDave We’re on the same wavelength today, Dave! #guildchat |
2:25 PM | SimonBlairTrain | @AlwaysBreaking Exactly! #Guildchat |
2:25 PM | learndrops | RT @AlwaysBreaking: @SimonBlairTrain Exactly. Outcomes and performance are what matters. Attendance doesn’t matter if people can’t apply an… |
2:26 PM | Quinnovator | a3) (channeling @britz), should be tracking interactions with others: what we create, contribute, etc as well as what we touch #guildchat |
2:26 PM | eLearningGuild | Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat |
2:26 PM | learning9togrow | there is no one way @LnDDave , but in any way we need to know how we are moving on #guildchat |
2:26 PM | urbie | @CandiceCPLP #GuildChat Training flows something like.. Manager assigns/agrees to it. Learner completes it. Manager evaluates application |
2:27 PM | Quinnovator | RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat |
2:27 PM | AlwaysBreaking | A4) The dark side is getting caught up in metrics that have nothing to do with the organizational impact of learning. #guildchat |
2:27 PM | learndrops | I like the emphasis this puts on the “fiber” of learning in society, its use. #GuildChat https://t.co/TUO077swZd |
2:28 PM | urbie | @learning9togrow #GuildChat A3 Depends who does most of the heavy (learning) lifting. It has to be the learner. Teacher doing the work, no. |
2:28 PM | CandiceCPLP | @urbie I was thinking more about manager supports it and has a role in reinforcing, but yeah #guildchat |
2:28 PM | SimonBlairTrain | A4: If Big Brother is tracking your learning, will you be expected to justify it? #Guildchat |
2:28 PM | Quinnovator | a4) certainly if we mis-assign things like ‘time’ to learning, or assume ‘if we touch it, it is learned’, that’s a bad thing #guildchat |
2:28 PM | unboxedtech | RT @AlwaysBreaking: A4) The dark side is getting caught up in metrics that have nothing to do with the organizational impact of learning. #… |
2:28 PM | britz | RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat |
2:28 PM | learndrops | A4a: People change over time. Struggle in the past, does not preclude success in the future. #GuildChat https://t.co/N28dQepig4 |
2:29 PM | JD_Dillon | A4) I’d be concerned about where we place our effort/value around measurement and focus on outcomes #GuildChat https://t.co/YBeEQCYxa5 |
2:29 PM | learndrops | A4b: Tracking needs to be coupled with a growth mindset, with limitations on who can access what data, for what purposes. #GuildChat |
2:29 PM | Quinnovator | a4) if tracking ‘learning’ (e.g. social interactions, accessing resources) is held against u (e.g. “wasting time”), that’d be bad #guildchat |
2:29 PM | urbie | @CandiceCPLP #GuildChat I learned that at a 2013 @atd_vos conference so I know it works. Plus I apply it for good effect often. |
2:29 PM | Quinnovator | RT @AlwaysBreaking: A4) The dark side is getting caught up in metrics that have nothing to do with the organizational impact of learning. #… |
2:29 PM | JD_Dillon | A4) Assuming “learning” happened and resulted in desired behavior could lead to more bad “training” #GuildChat https://t.co/YBeEQCYxa5 |
2:29 PM | urbie | RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat |
2:30 PM | britz | RT @Quinnovator: a4) if tracking ‘learning’ (e.g. social interactions, accessing resources) is held against u (e.g. “wasting time”), that’d… |
2:30 PM | SimonBlairTrain | Our data says you accessed the job aid 254 times. You should’ve memorized it by now. You’re fired! #Guildchat https://t.co/NWe1HKIRWb |
2:31 PM | ECHersh | A4) Tracking learning shld be about improvement and gains — for learner and trainer (to ensure strengthened future iterations). #guildchat |
2:31 PM | learning9togrow | time to learn is relative easy to measure but how to take a measurement of interaction, that is a key element to learn? #guildchat |
2:31 PM | CandiceCPLP | A4) No potential-reality. Using seat time to reflect engagement; trying to enforce minimum required learning (4 hours a qtr!) #guildchat |
2:31 PM | CraigTaylor74 | @Quinnovator @learndrops Or only undertaken on a rare occasion. (Emergency landings) #Guildchat |
2:31 PM | LnDDave | RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat |
2:31 PM | urbie | #GuildChat A4 Gate should be transparency/visibility. Does the learner know they will be tracked? Are they aware (policy?) how it’s used? |
2:32 PM | CandiceCPLP | a4b) Also, where’s the motivation? How to identify where connections are made, critical thinking used? It’s just bad data. #guildchat |
2:32 PM | britz | A4 Efforts at trying to Track learning take attention off what matters most, and what is still done least – measuring execution #guildchat |
2:32 PM | LnDDave | A4) you always have to ask “how will this information be used?” #GuildChat |
2:33 PM | learndrops | @SimonBlairTrain Goodness! Or means you’re diligent & never miss a step. Outcomes over data points. #guildchat https://t.co/KZVcLffdv5 |
2:33 PM | urbie | #GuildChat A4 I’ve done work places where termination of employment could result if performance didn’t meet expectations. |
2:33 PM | LnDDave | RT @britz: A4 Efforts at trying to Track learning take attention off what matters most, and what is still done least – measuring execution … |
2:33 PM | JD_Dillon | RT @LnDDave: A4) you always have to ask “how will this information be used?” #GuildChat |
2:33 PM | learndrops | RT @LnDDave: A4) you always have to ask “how will this information be used?” #GuildChat |
2:34 PM | urbie | #GuildChat A4 So shine a big light on tracking to make it visible. Ideally photo studio lighting to eliminate shadows. |
2:34 PM | eLearningGuild | Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildChat |
2:34 PM | CandiceCPLP | @LnDDave YES! and demand an answer. #guildchat |
2:34 PM | urbie | RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC… |
2:34 PM | Quinnovator | RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC… |
2:34 PM | Quinnovator | RT @LnDDave: A4) you always have to ask “how will this information be used?” #GuildChat |
2:34 PM | britz | RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC… |
2:35 PM | Quinnovator | a5) xAPI can track more than learning. The point is that courses aren’t the only way of learning, so we need to track activity #guildchat |
2:35 PM | JD_Dillon | A5) Track resource use and correlate to changes in performance – could be done w/ Google Analytics #GuildChat https://t.co/lK3WpbZxVb |
2:35 PM | urbie | #GuildChat A5 Per the PTB (Powers That Be) any number of dashboards do that. I’m of the low-tech camp: make something I can see, touch. |
2:36 PM | CandiceCPLP | a5) I learn a lot from our internal ‘troll’ networks. What’s working, what’s not. #guildchat |
2:36 PM | JD_Dillon | A5) xAPI (if applied effectively and resulting data is reviewed in meaningful ways) #GuildChat https://t.co/lK3WpbZxVb |
2:37 PM | learning9togrow | RT @CandiceCPLP a5) I learn a lot from our internal ‘troll’ networks. What’s working, what’s not. #guildchat |
2:37 PM | DonaldClark | #GuildChat Don’t measure learning measure impact – kill Kirkpatrick and use business measures |
2:37 PM | JoolieGray | RT @DonaldClark: #GuildChat Don’t measure learning measure impact – kill Kirkpatrick and use business measures |
2:38 PM | learndrops | A5: LMS (track down to the assessment level item, performance management), gamification tools. #guildchat https://t.co/7xcx03L3BB |
2:38 PM | JD_Dillon | A5) Reporting in @Axonify helps me understand potential changes in knowledge, correlate to performance #GuildChat https://t.co/lK3WpbZxVb |
2:38 PM | urbie | #GuildChat A5 One caveat: policy has to match practice. Train someone to sell ethically then set unreasonable expectations. No. |
2:38 PM | urbie | RT @DonaldClark: #GuildChat Don’t measure learning measure impact – kill Kirkpatrick and use business measures |
2:39 PM | Axonify | RT @JD_Dillon: A5) Reporting in @Axonify helps me understand potential changes in knowledge, correlate to performance #GuildChat https://t… |
2:39 PM | britz | A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildchat |
2:40 PM | Quinnovator | @DonaldClark (risking :) Kirkpatrick designed to measure impact, been misused: Level 4 (starting point) is about biz measures! #guildchat |
2:40 PM | urbie | RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc… |
2:40 PM | LnDDave | RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC… |
2:40 PM | Quinnovator | @DonaldClark but agree fully, biz measures only thing that ultimately matters #guildchat |
2:40 PM | JD_Dillon | RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc… |
2:41 PM | eLearningGuild | Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in practice? #GuildChat |
2:41 PM | Quinnovator | a5) don’t like the ‘activity’ measures that assume “if they’re busy, it is good”. Anticipate and look for real impact #guildchat |
2:41 PM | LnDDave | RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc… |
2:41 PM | LnDDave | RT @eLearningGuild: Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in… |
2:42 PM | urbie | #GuildChat A5 Some places I’ve been use ________ Five Levels of Evaluation. “That’s all I have to say about that.” F. Gump |
2:42 PM | DonaldClark | RT @Quinnovator: a5) don’t like the ‘activity’ measures that assume “if they’re busy, it is good”. Anticipate and look for real impact #gui… |
2:42 PM | urbie | RT @eLearningGuild: Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in… |
2:42 PM | SimonBlairTrain | @Quinnovator Yes! I’ll take “effective” over “busy” any day of the week! #Guildchat |
2:43 PM | AlwaysBreaking | A6) Trek from Cognitive Advisors is an excellent xAPI example. #guildchat |
2:43 PM | urbie | #GuildChat A6 SCORM, AICC I’ve seen used lots. But it’s usually described as being “compliant”. So lots of features only few are used. |
2:43 PM | learndrops | RT @Quinnovator: a5) don’t like the ‘activity’ measures that assume “if they’re busy, it is good”. Anticipate and look for real impact #gui… |
2:43 PM | JD_Dillon | A6) xAPI examples are emerging – but its about tracking all types of activity – not just learning data #GuildChat https://t.co/xgtTXfoFol |
2:43 PM | Quinnovator | @DonaldClark even K agreed he misnumbered ;). Wish we had a better model! #guildchat |
2:44 PM | Quinnovator | RT @eLearningGuild: Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in… |
2:44 PM | LnDDave | A6) @MMTorranceis doing some great work with museums using tech like this. #GuildChat |
2:44 PM | LnDDave | RT @JD_Dillon: A6) xAPI examples are emerging – but its about tracking all types of activity – not just learning data #GuildChat https://t.… |
2:44 PM | britz | RT @LnDDave A6) @MMTorrance is doing some great work with museums using tech like this. #GuildChat |
2:45 PM | write2tg | Missing the #guildchat but will check the transcript later. From what I see on my feed, there’s some interesting conversation happening! |
2:46 PM | LnDDave | A6) there were some great examples of the potential@of XAPI showcased at #Devalewrn last year. #GuildChat |
2:46 PM | DonaldClark | #guildchat xAPI dumps the old RLO model so much better |
2:46 PM | urbie | #GuildChat A6 Seeing meaningful results from an LMS report’s usually “above my pay grade” or something I can’t make sense of. |
2:47 PM | DonaldClark | #guildchat SCORM was a big mistake driven by lego block metaphor of reusable learning objects by Masie & Wayne Hodgins |
2:47 PM | CandiceCPLP | Expecting to learn more at mLearn in a few weeks! #guildchat |
2:47 PM | urbie | #GuildChat A6 Intel had a great analytics and reporting: roll out training and some months later yields (and bonus checks) got bigger. |
2:47 PM | pbacsich | RT @DonaldClark: #guildchat SCORM was a big mistake driven by lego block metaphor of reusable learning objects by Masie & Wayne Hodgins |
2:47 PM | britz | MT @LnDDave A6) some gr8 examples of the potential of xAPI showcased at #Devlearn last year. #GuildChat /let me get (fix) this for u Dave :) |
2:48 PM | eLearningGuild | Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat |
2:48 PM | Quinnovator | RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat |
2:49 PM | urbie | RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat |
2:49 PM | CandiceCPLP | Ian Huckabee did a good job explaining, too. #guildchat |
2:49 PM | SimonBlairTrain | A7: When do we get telepathy and mind melds? A literal brain dump would be so quick! #guildchat |
2:49 PM | learning9togrow | I can assume a lot of new tools online integrating social media and machine learning to measure patterns #guildchat |
2:49 PM | LnDDave | RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat |
2:50 PM | urbie | #GuildChat A7 Why the continued push to rely on new technology to tell us something that needs to be seen (in some objective human way)? |
2:50 PM | tolja | RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc… |
2:50 PM | JD_Dillon | A7) Terminators and Ultron? Maybe? No? #GuildChat https://t.co/OKliWv7Soz |
2:50 PM | CandiceCPLP | A7) More with brain-based, but the real impacts will be in AI-related efforts, driven by Elon Musk. No, really! #guildchat |
2:50 PM | urbie | #GuildChat A7 It’s like we agree that learning is a social sort of thing. So why dehumanize it at the end? |
2:51 PM | Quinnovator | a7) could be doing a better job of using games for learning and assessment, for one #guildchat |
2:51 PM | LnDDave | A7) Data analytics. #GuildChat |
2:51 PM | learndrops | A7: Tool intersection: learning, gamification, creation– that explore motivation & cooperative systems #guildchat https://t.co/2J4lO42i7k |
2:51 PM | urbie | RT @learndrops: A7: Tool intersection: learning, gamification, creation– that explore motivation & cooperative systems #guildchat https:/… |
2:51 PM | Quinnovator | a7) further out, I think semantic assessments of SoMe contributions is a possibility on the horizon #guildchat |
2:52 PM | Quinnovator | a7) WWWD: What Would (IBM’s) Watson Do? ;) #guildchat |
2:52 PM | AlwaysBreaking | A7) I actually think xAPI will be the foundation that helps us better understand learning. It pulls data from any source. #guildchat |
2:52 PM | learning9togrow | RT @learndrops A7: Tool intersection: learning, gamification, creation– that explore motivation… #guildchat https://t.co/wUrxsqMJe7 |
2:52 PM | DonaldClark | #GuildChat Two letters – AI http://t.co/e1GILOTB80 namely adaptive learning also smart spaced-practice and VR http://t.co/ZDFtwuoM24 |
2:52 PM | LnDDave | RT @Quinnovator: a7) further out, I think semantic assessments of SoMe contributions is a possibility on the horizon #guildchat |
2:54 PM | learning9togrow | I agree that is a social area, but technology can help to nurture and speed the process of learning #guildchat |
2:54 PM | AlwaysBreaking | A7) Analytic tools that evaluate millions of small chunks of data will be the next growth area for training. #guildchat |
2:54 PM | urbie | #GuildChat A7 Okay. A little out there. An Apple Watch with a Galvenometer. Learner sweats whilst performing, training FAIL. Dry skin: WIN. |
2:54 PM | britz | A7. I suspect as machine learning advances we will learn more from it about ourselves and our cognitive processes #guildchat |
2:55 PM | DonaldClark | #GuildChat Measurement of real competences thro ‘learning by doing’ in sims & VR fascinating |
2:55 PM | eLearningGuild | Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat |
2:55 PM | LearnovateSA | RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat |
2:56 PM | britz | RT @eLearningGuild Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat |
2:56 PM | urbie | #GuildChat A7 Maybe eye-tracking. Eyes open, good chance they’re learning. Eyes closed, not so much. |
2:56 PM | urbie | RT @eLearningGuild: Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat |
2:56 PM | LnDDave | A7) part of what will move his forward is the ownership of “learning data” shifting from L&D to I.T. #GuildChat |
2:56 PM | LnDDave | RT @eLearningGuild: Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat |
2:56 PM | SimonBlairTrain | @urbie Unless they’re focusing on the audio. :-) #guildchat |
2:56 PM | CandiceCPLP | @DonaldClark yes! Can you cite examples you like? #guildchat |
2:57 PM | DonaldClark | #GuildChat Why does airline industry use flight sims but oethrs don’t? Pilots go down with the plane ;) |
2:57 PM | urbie | #GuildChat Final thoughts.. @learndrops and tool intersection. Some application of existing tech/practice that we haven’t heard about yet. |
2:57 PM | britz | @urbie sometimes, in a moment of reflection, I close my eyes. Real learning is experience, practice, conversation & reflection #guildchat |
2:57 PM | CandiceCPLP | @urbie Wow, you went from tracking learning to tracking eye movements! Impressive! #guildchat |
2:57 PM | LnDDave | RT @britz: @urbie sometimes, in a moment of reflection, I close my eyes. Real learning is experience, practice, conversation & reflection … |
2:58 PM | urbie | @CandiceCPLP #GuildChat I’m a #designthinking person at heart. Throw lots of ideas out there n maybe one or three will have legs. |
2:58 PM | JD_Dillon | Start w/ outcomes and design towards effective collection and use of data … #GuildChat https://t.co/CgX690mGNK |
2:58 PM | bballings | RT @Quinnovator: a5) xAPI can track more than learning. The point is that courses aren’t the only way of learning, so we need to track acti… |
2:59 PM | LnDDave | RT @JD_Dillon: Start w/ outcomes and design towards effective collection and use of data … #GuildChat https://t.co/CgX690mGNK |
2:59 PM | urbie | Sigh. Now that’s #GuildChat is over it’s >12 hours til #satchat |
2:59 PM | Quinnovator | Thoughts: learning is a process, not an event. Tracking learning needs to be similarly continual. We need a finer-grained model #guildchat |
3:00 PM | britz | RT @Quinnovator: Thoughts: learning is a process, not an event. Tracking learning needs to be similarly continual. We need a finer-grained … |
3:00 PM | urbie | MT #GuildChat #lrnchat https://t.co/JcX6JRsiEI |
3:00 PM | eLearningGuild | Thanks for joining #GuildChat everyone. We’ll see you next week. Look for a transcript of today’s chat soon! |
Leave a Reply