#GuildChat for 05/15/2015: Tracking Learning with Technology

Our next #GuildChat takes place Friday May 15th at 11am PT / 2pm ET. Our topic for this week’s chat is Tracking Learning with Technology.

Organizations and institutions have always strove to track the effectiveness of their strategies and
approaches. From Marketing departments collecting data on their latest campaign to Sales projecting revenue in shorter and shorter terms; knowing what is working and what is not helps in making quick decisions and adjusting to changing needs.

In this week’s #GuildChat we look closer at the efforts to track learning and the technologies being deployed to gauge the effectiveness and efficiency of various approaches at improving performance and changing behavior. Can learning really be tracked? What tools and technologies are being used today and which are emerging to provide organizations better measure of learning’s impact on the bottom line.

Here are the questions currently scheduled to be posed during the chat.

Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOULD mean? #GuildChat
Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat
Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat
Q4) Would you agree or disagree that there may be a potential dark side in trying to track learning? Why or why not? #GuildChat
Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildChat
Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in practice? #GuildChat
Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat

Chat Transcript

NOTE: Tweets are listed in the order they were posted and are shown in Eastern Time. To visit the actual posting for a particular tweet, click the associated user name for the posting.

2:02 PM	eLearningGuild	Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGuild
2:02 PM	eLearningGuild	Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the hashtag in your tweets.
2:02 PM	JD_Dillon	RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui…
2:03 PM	eLearningGuild	Please take a moment to introduce and tell us a little bit about yourself. The first question will be posed in just 2 minutes. #GuildChat
2:04 PM	LearnovateSA	RT @eLearningGuild: Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the has…
2:04 PM	LearnovateSA	RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui…
2:05 PM	learndrops	Laura with the Learndrops Project. Working on an instructional design crowdsourcing project. #GuildChat https://t.co/XBf3eTKiX5
2:05 PM	learning9togrow	Jorge Zavala in Califonia #guildchat
2:05 PM	eLearningGuild	Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOULD mean? #GuildChat
2:05 PM	britz	Hi everyone. Mark Britz joining in from #Syracuse. Long-time learning pro now w/ the @elearningguild, still all about learning :) #guildchat
2:05 PM	urbie	RT @eLearningGuild: Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the has…
2:05 PM	JD_Dillon	JD in Orlando, FL. Learning geek, sharer, local info hub for #ATD2015 attendees! #GuildChat https://t.co/ZqXBpIQNSZ
2:06 PM	urbie	RT @LnDDave: TRANSCRIPT NOW POSTED – #GuildChat for 05/08/2015: Using Electronic Performance Support Systems (EPSS) http://t.co/VH65uK7kk4
2:06 PM	britz	RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL…
2:06 PM	learndrops	A1a: Track outward, measurable signs of learning w/ respect to individual. Where is help needed? #GuildChat https://t.co/2Qqu90kZwF
2:06 PM	LnDDave	Greetings #GuildChat. David from @eLearningGuild looking forward to today’s chat.
2:06 PM	learndrops	A1b: Track performance of course, statistically and based on evals. Places for course improvement. #GuildChat
2:06 PM	learndrops	A1c: Track performance & uplift in an organization: progress in learning/sharing activities + real world KPIs. #GuildChat
2:07 PM	CandiceCPLP	Hi, all – Candice in NC, evangelizing the 5 moments of need. #guildchat
2:07 PM	urbie	#GuildChat urban from somewhere in the 48th state
2:07 PM	urbie	RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui…
2:07 PM	learning9togrow	the complex world of how you now that the people learn and how they learn #guildchat
2:07 PM	urbie	RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL…
2:07 PM	JD_Dillon	A1) Usually means “completion” of some activity; rather talk about measuring performance improvement. #guildchat https://t.co/8B5dnCPK4l
2:07 PM	LnDDave	RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL…
2:08 PM	britz	RT @JD_Dillon: A1) Usually means “completion” of some activity; rather talk about measuring performance improvement. #guildchat https://t.…
2:08 PM	Quinnovator	Clark Quinn, L&D improvement instigator, consultant/author/speaker, Walnut Creek CA #guildchat
2:09 PM	LnDDave	A1) tracking learning always seemed like the wrong phrase. Measuring? Maybe. But not tracking. #GuildChat
2:09 PM	urbie	#GuildChat A1 A thing looking over your shoulder to make sure you’re actually in front of a PC in an LMS for the requisite amount of time.
2:09 PM	CandiceCPLP	A1) to me, tracking results in all dimensions, but that’s not what I’m asked for! #guildchat
2:09 PM	learning9togrow	A1) registering the path followed by people while the are learning #guildchat
2:10 PM	CandiceCPLP	@JD_Dillon – or performance of any kind, improvement or not, eh? #guildchat
2:10 PM	MelMilloway	Hey, all. Missing #Guildchat because I have a lot to get done before #ATD2015. Enjoy the chat and I shall see some of you there!
2:10 PM	AlwaysBreaking	A1) “Tracking” usually refers to stats about training. Completions, attendance, number sessions, registrations, etc. #GuildChat
2:10 PM	britz	@LnDDave Yet even Measuring is extremely problematic. Learning is internal/personal. Training the input. performance the output #guildchat
2:11 PM	JD_Dillon	@CandiceCPLP True … it’s the only outcome that matters … #GuildChat
2:11 PM	salah784	RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL…
2:11 PM	LearnovateSA	RT @eLearningGuild: Q1) What does the phrase “Tracking learning” mean to you? Is there a difference between what it means and what it SHOUL…
2:11 PM	salah784	RT @eLearningGuild: Please take a moment to introduce and tell us a little bit about yourself. The first question will be posed in just 2 m…
2:11 PM	CraigTaylor74	1) #Guildchat It sounds like what it is. A half-assed term.
2:11 PM	CraigTaylor74	RT @britz: @LnDDave Yet even Measuring is extremely problematic. Learning is internal/personal. Training the input. performance the output …
2:12 PM	eLearningGuild	Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat
2:12 PM	salah784	RT @eLearningGuild: Today’s chat is scheduled to last one hour. We’ll post questions using #GuildChat; as a reminder be sure to use the has…
2:12 PM	LnDDave	A1) in the context of organizations, learning isn’t a key metric; it’s less about what we know and more about what we do. #GuildChat
2:12 PM	Quinnovator	a1) tracking learning should measure change in abilities, tends to currently mean ‘completion’ #guildchat
2:12 PM	learndrops	Seems like tracking is often what we do. Measuring is closer to what we should do. @LnDDave #GuildChat https://t.co/YwMADHNIOs
2:12 PM	salah784	RT @eLearningGuild: Welcome to #GuildChat, brought to you by @eLearningGuild. Today we’re talking tracking learning with technology. #elGui…
2:12 PM	britz	RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat
2:12 PM	Quinnovator	RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat
2:12 PM	britz	RT @Quinnovator: a1) tracking learning should measure change in abilities, tends to currently mean ‘completion’ #guildchat
2:12 PM	urbie	RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat
2:12 PM	learndrops	A2a: Need to separate the internal from the external – observable. #GuildChat https://t.co/nrTCimGEXE
2:12 PM	learning9togrow	A1) I would like to see as real measurement about how much the people learned not only the path followed #guildchat
2:12 PM	LnDDave	RT @eLearningGuild: Q2) Can learning really be tracked? If yes, how so? If no, why not? #GuildChat
2:13 PM	CandiceCPLP	A1b) Seems to be used mostly by co’s that are process-oriented, instead of value- or results-oriented #guildchat
2:13 PM	learndrops	A2b: We cannot measure the degree & depth to which understanding of a key dynamic changes. “Learning” is internal. #GuildChat
2:13 PM	Quinnovator	a2) we can assess competencies, but we should also be looking at other evidence of accomplishment (e.g. success in task) #guildchat
2:13 PM	CandiceCPLP	RT @LnDDave: A1) in the context of organizations, learning isn’t a key metric; it’s less about what we know and more about what we do. #Gu…
2:13 PM	learndrops	A2c: We can, however, observe & measure performance. How you respond to scenarios that draw upon that understanding. #GuildChat
2:13 PM	JD_Dillon	A2) You can measure behavior change, including display of knowledge – but you can’t “track learning” #guildchat https://t.co/YtqweKxLDR
2:13 PM	JD_Dillon	A2) You can measure behavior change, including display of knowledge – but you can’t “track learning” #guildchat https://t.co/YtqweKxLDR
2:14 PM	AlwaysBreaking	A2) Learning can be tracked by measuring performance. As people learn, they tend to perform better on the job. #guildchat
2:14 PM	learning9togrow	I know that I learned when I can use the acquired knowledge applied in a given situation, no just a test #guildchat
2:14 PM	ECHersh	a2) We are tracking learning via monitoring implementation of new knowledge and skills. #GuildChat
2:14 PM	LnDDave	A2) I hate absolutes. I’ll say that with today’s tech some, but not all, learning activities can be tracked. #GuildChat
2:14 PM	Quinnovator	@CraigTaylor74 def’n of learning: new behavior in same context, so measured change in behavior indicates learning, no? #guildchat
2:14 PM	urbie	#GuildChat A2 Dunno. Depends on the definition and what watchers want to take away. Proctors walking on elevated catwalks can track.
2:14 PM	britz	A2. Experiences, exposure, involvement with content, yes. What was learned from them… not so easy. #guildchat
2:14 PM	Quinnovator	@CraigTaylor74 (to go a wee bit ‘behaviorist’ ;) #guildchat
2:15 PM	Tech_Sharer	RT @LnDDave: A2) I hate absolutes. I’ll say that with today’s tech some, but not all, learning activities can be tracked. #GuildChat
2:15 PM	learndrops	Agree. The real-world component is important. #GuildChat https://t.co/5RmwZfOOWt
2:15 PM	LnDDave	A2) part of the challenge with this is a lack of consensus around what it means to have “learned”. #GuildChat
2:15 PM	britz	RT @LnDDave: A2) part of the challenge with this is a lack of consensus around what it means to have “learned”. #GuildChat
2:15 PM	ECHersh	@AlwaysBreaking: Re A2) How do you measure job performance? #guildchat
2:15 PM	CandiceCPLP	A2) Have to define ‘learning’ first. Several options: show your work, journaling, demonstration, performance coaching. #guildchat
2:16 PM	learndrops	RT @britz: A2. Experiences, exposure, involvement with content, yes. What was learned from them… not so easy. #guildchat
2:16 PM	learning9togrow	a2) the bloom taxonomy gave us 6 levels and getting to the last one is where we can perform a evaluation #guildchat
2:16 PM	urbie	#GuildChat A2 Certain LMSs (don’t ask me which) can monitor clicks, time spent in a space, all manner of e-minutiae.
2:16 PM	learning9togrow	A2) I agree with you @LnDDave:, but how do you build this consensus? #guildchat
2:16 PM	CraigTaylor74	@Quinnovator what if my behaviour has changed because I’ve followed a job aid? #Guildchat
2:17 PM	urbie	#GuildChat A2 But tracking learning, don’t think so. Is it learning that you want to measure? Or is it application post-event?
2:17 PM	britz	@ECHersh @AlwaysBreaking Depends on the job tasks/requirements and measures of success #guildchat
2:17 PM	AlwaysBreaking	@ECHersh Depends on the job. Sales performance has tangible metrics, some of which are influenced by training/learning. #guildchat
2:17 PM	Quinnovator	that doesn’t sound right, Bloom’s is about determining what level you need, not getting to top #guildchat https://t.co/wg58OPIkWu
2:18 PM	urbie	#GuildChat A2 A while ago I learned that some compulsory (compliance) training is mandated that the learner be in the course a set time.
2:19 PM	Quinnovator	@learning9togrow tho’ not a fan of bloom’s in general (cf Sugrue evisceration: http://t.co/uxAiHOanbU) #guildchat
2:19 PM	eLearningGuild	Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat
2:19 PM	Quinnovator	@learndrops @CraigTaylor74 no, following job aid doesn’t mean learned #guildchat
2:19 PM	learning9togrow	Do you learn what you need and then evaluate if you learned? #guildchat
2:19 PM	britz	RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat
2:19 PM	urbie	RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat
2:19 PM	Quinnovator	@CraigTaylor74 that’s not the same context: task w/ job aid not same as task w/o #guildchat
2:19 PM	Quinnovator	RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat
2:20 PM	CandiceCPLP	Big diff btwn ‘tracking’ and ‘measuring’ – one is a path, the other a result #guildchat
2:20 PM	Quinnovator	RT @CandiceCPLP: Big diff btwn ‘tracking’ and ‘measuring’ – one is a path, the other a result #guildchat
2:20 PM	CandiceCPLP	@Quinnovator @learndrops @CraigTaylor74 It does mean you learned to use the job aid! #guildchat
2:20 PM	learning9togrow	A3) if learning is a journey, I assume that i would like to know that I reach the end of it #guildchat
2:20 PM	urbie	#GuildChat A3 Should learning be tracked? Dunno. Maybe we need another word. Tracked is like “Sic the dogs on ’em” so don’t wanna go there.
2:21 PM	learndrops	A3a: Data gives us insight. Allows us to see how things work & make improvements. Can be important tool. #GuildChat https://t.co/SQlJHxv6V6
2:21 PM	kukharenko	RT @Quinnovator: that doesn’t sound right, Bloom’s is about determining what level you need, not getting to top #guildchat https://t.co/wg5…
2:21 PM	LnDDave	RT @eLearningGuild: Q3) Should we even be trying to track learning? If so, why? If no, what should we be tracking? #GuildChat
2:21 PM	Quinnovator	a3) we should track learning, but more too: performance, what we’ve looked at, etc, trying to determine what leads to success #guildchat
2:21 PM	ECHersh	@AlwaysBreaking. Some prof more easily tracked than others. Tracking learning implement across sectors (e.g. via MOOCs) is tough #guildchat
2:21 PM	learndrops	A3b: The problem is not in the data / act of tracking. The problem is in the goal of that tracking. #GuildChat
2:21 PM	CraigTaylor74	@CandiceCPLP @Quinnovator @learndrops LOL. True that!! :-) #Guildchat
2:21 PM	JD_Dillon	A3) Measure the desired outcomes and correlate to how our interventions support them #GuildChat https://t.co/qqiToKEJuu
2:21 PM	learning9togrow	RT @CandiceCPLP Big diff btwn ‘tracking’ and ‘measuring’ – one is a path, the other a result #guildchat
2:21 PM	learndrops	A3c: To what end are we optimizing our systems? Success on a test? Or success in life? #GuildChat
2:22 PM	urbie	#GuildChat A3 Certainly appreciate the need to determine efficacy. Which is why I try (sometimes unsuccessfully) to get #make in somewhere.
2:22 PM	learndrops	RT @Quinnovator: a3) we should track learning, but more too: performance, what we’ve looked at, etc, trying to determine what leads to suc…
2:22 PM	AlwaysBreaking	@ECHersh yeah, that would be a challenge. Focusing on competencies can help with tracking/measuring. #guildchat
2:22 PM	LnDDave	RT @JD_Dillon: A3) Measure the desired outcomes and correlate to how our interventions support them #GuildChat https://t.co/qqiToKEJuu
2:22 PM	SimonBlairTrain	Sorry I’m late to #Guildchat. My other meeting is done now.
2:23 PM	urbie	#GuildChat A3 Learners should do something with whatever they were exposed to and make something: a blog post, report, widget. Something.
2:23 PM	britz	A3. We should be conscious of our OWN learning (monitoring) and sharing it so as to build upon and adjust for new information #guildchat
2:23 PM	urbie	#GuildChat A3 Then share it with a peer, manager, other human that matters.
2:23 PM	SimonBlairTrain	A3: We should track results (e.g. business impact). Learning is a means, not and end. #Guildchat
2:24 PM	CandiceCPLP	A3) think we should be ‘tracking’ accountability for performance/mastery – can be learner, manager, coach, trainer… need a RACI #guildchat
2:24 PM	unboxedtech	RT @SimonBlairTrain: A3: We should track results (e.g. business impact). Learning is a means, not and end. #Guildchat
2:24 PM	learning9togrow	tracking provide information to find out if we succeed or not, we need to know both cases #guildchat
2:24 PM	JD_Dillon	RT @britz: A3. We should be conscious of our OWN learning (monitoring) and sharing it so as to build upon and adjust for new information #g…
2:24 PM	LnDDave	A3) There’s no single bullet on what should be measured. Context matters. #GuildChat
2:24 PM	Quinnovator	@CraigTaylor74 @learndrops agreed, and job aid may not make sense to learn (e.g. info changing too fast). #guildchat
2:24 PM	urbie	RT @LnDDave: A3) There’s no single bullet on what should be measured. Context matters. #GuildChat
2:25 PM	JD_Dillon	RT @LnDDave: A3) There’s no single bullet on what should be measured. Context matters. #GuildChat
2:25 PM	AlwaysBreaking	@SimonBlairTrain Exactly. Outcomes and performance are what matters. Attendance doesn’t matter if people can’t apply anything. #guildchat
2:25 PM	CandiceCPLP	@urbie I’m ok with that if it includes ‘a connection’ Too many pieces/parts and not enough context #guildchat
2:25 PM	SimonBlairTrain	@LnDDave Right! What’s the the problem the client wants to solve? That will tell you what to measure. #Guildchat
2:25 PM	learning9togrow	The final step to confirm learning is the capability to show it, and teachig is the hardest one @urbie #guildchat
2:25 PM	CandiceCPLP	@LnDDave We’re on the same wavelength today, Dave! #guildchat
2:25 PM	SimonBlairTrain	@AlwaysBreaking Exactly! #Guildchat
2:25 PM	learndrops	RT @AlwaysBreaking: @SimonBlairTrain Exactly. Outcomes and performance are what matters. Attendance doesn’t matter if people can’t apply an…
2:26 PM	Quinnovator	a3) (channeling @britz), should be tracking interactions with others: what we create, contribute, etc as well as what we touch #guildchat
2:26 PM	eLearningGuild	Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat
2:26 PM	learning9togrow	there is no one way @LnDDave , but in any way we need to know how we are moving on #guildchat
2:26 PM	urbie	@CandiceCPLP #GuildChat Training flows something like.. Manager assigns/agrees to it. Learner completes it. Manager evaluates application
2:27 PM	Quinnovator	RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat
2:27 PM	AlwaysBreaking	A4) The dark side is getting caught up in metrics that have nothing to do with the organizational impact of learning. #guildchat
2:27 PM	learndrops	I like the emphasis this puts on the “fiber” of learning in society, its use. #GuildChat https://t.co/TUO077swZd
2:28 PM	urbie	@learning9togrow #GuildChat A3 Depends who does most of the heavy (learning) lifting. It has to be the learner. Teacher doing the work, no.
2:28 PM	CandiceCPLP	@urbie I was thinking more about manager supports it and has a role in reinforcing, but yeah #guildchat
2:28 PM	SimonBlairTrain	A4: If Big Brother is tracking your learning, will you be expected to justify it? #Guildchat
2:28 PM	Quinnovator	a4) certainly if we mis-assign things like ‘time’ to learning, or assume ‘if we touch it, it is learned’, that’s a bad thing #guildchat
2:28 PM	unboxedtech	RT @AlwaysBreaking: A4) The dark side is getting caught up in metrics that have nothing to do with the organizational impact of learning. #…
2:28 PM	britz	RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat
2:28 PM	learndrops	A4a: People change over time. Struggle in the past, does not preclude success in the future. #GuildChat https://t.co/N28dQepig4
2:29 PM	JD_Dillon	A4) I’d be concerned about where we place our effort/value around measurement and focus on outcomes #GuildChat https://t.co/YBeEQCYxa5
2:29 PM	learndrops	A4b: Tracking needs to be coupled with a growth mindset, with limitations on who can access what data, for what purposes. #GuildChat
2:29 PM	Quinnovator	a4) if tracking ‘learning’ (e.g. social interactions, accessing resources) is held against u (e.g. “wasting time”), that’d be bad #guildchat
2:29 PM	urbie	@CandiceCPLP #GuildChat I learned that at a 2013 @atd_vos conference so I know it works. Plus I apply it for good effect often.
2:29 PM	Quinnovator	RT @AlwaysBreaking: A4) The dark side is getting caught up in metrics that have nothing to do with the organizational impact of learning. #…
2:29 PM	JD_Dillon	A4) Assuming “learning” happened and resulted in desired behavior could lead to more bad “training” #GuildChat https://t.co/YBeEQCYxa5
2:29 PM	urbie	RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat
2:30 PM	britz	RT @Quinnovator: a4) if tracking ‘learning’ (e.g. social interactions, accessing resources) is held against u (e.g. “wasting time”), that’d…
2:30 PM	SimonBlairTrain	Our data says you accessed the job aid 254 times. You should’ve memorized it by now. You’re fired! #Guildchat https://t.co/NWe1HKIRWb
2:31 PM	ECHersh	A4) Tracking learning shld be about improvement and gains — for learner and trainer (to ensure strengthened future iterations). #guildchat
2:31 PM	learning9togrow	time to learn is relative easy to measure but how to take a measurement of interaction, that is a key element to learn? #guildchat
2:31 PM	CandiceCPLP	A4) No potential-reality. Using seat time to reflect engagement; trying to enforce minimum required learning (4 hours a qtr!) #guildchat
2:31 PM	CraigTaylor74	@Quinnovator @learndrops Or only undertaken on a rare occasion. (Emergency landings) #Guildchat
2:31 PM	LnDDave	RT @eLearningGuild: Q4) Many suggest there’s potentially a dark side to trying to track learning. Do you agree? Why or why not? #GuildChat
2:31 PM	urbie	#GuildChat A4 Gate should be transparency/visibility. Does the learner know they will be tracked? Are they aware (policy?) how it’s used?
2:32 PM	CandiceCPLP	a4b) Also, where’s the motivation? How to identify where connections are made, critical thinking used? It’s just bad data. #guildchat
2:32 PM	britz	A4 Efforts at trying to Track learning take attention off what matters most, and what is still done least – measuring execution #guildchat
2:32 PM	LnDDave	A4) you always have to ask “how will this information be used?” #GuildChat
2:33 PM	learndrops	@SimonBlairTrain Goodness! Or means you’re diligent & never miss a step. Outcomes over data points. #guildchat https://t.co/KZVcLffdv5
2:33 PM	urbie	#GuildChat A4 I’ve done work places where termination of employment could result if performance didn’t meet expectations.
2:33 PM	LnDDave	RT @britz: A4 Efforts at trying to Track learning take attention off what matters most, and what is still done least – measuring execution …
2:33 PM	JD_Dillon	RT @LnDDave: A4) you always have to ask “how will this information be used?” #GuildChat
2:33 PM	learndrops	RT @LnDDave: A4) you always have to ask “how will this information be used?” #GuildChat
2:34 PM	urbie	#GuildChat A4 So shine a big light on tracking to make it visible. Ideally photo studio lighting to eliminate shadows.
2:34 PM	eLearningGuild	Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildChat
2:34 PM	CandiceCPLP	@LnDDave YES! and demand an answer. #guildchat
2:34 PM	urbie	RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC…
2:34 PM	Quinnovator	RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC…
2:34 PM	Quinnovator	RT @LnDDave: A4) you always have to ask “how will this information be used?” #GuildChat
2:34 PM	britz	RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC…
2:35 PM	Quinnovator	a5) xAPI can track more than learning. The point is that courses aren’t the only way of learning, so we need to track activity #guildchat
2:35 PM	JD_Dillon	A5) Track resource use and correlate to changes in performance – could be done w/ Google Analytics #GuildChat https://t.co/lK3WpbZxVb
2:35 PM	urbie	#GuildChat A5 Per the PTB (Powers That Be) any number of dashboards do that. I’m of the low-tech camp: make something I can see, touch.
2:36 PM	CandiceCPLP	a5) I learn a lot from our internal ‘troll’ networks. What’s working, what’s not. #guildchat
2:36 PM	JD_Dillon	A5) xAPI (if applied effectively and resulting data is reviewed in meaningful ways) #GuildChat https://t.co/lK3WpbZxVb
2:37 PM	learning9togrow	RT @CandiceCPLP a5) I learn a lot from our internal ‘troll’ networks. What’s working, what’s not. #guildchat
2:37 PM	DonaldClark	#GuildChat Don’t measure learning measure impact – kill Kirkpatrick and use business measures
2:37 PM	JoolieGray	RT @DonaldClark: #GuildChat Don’t measure learning measure impact – kill Kirkpatrick and use business measures
2:38 PM	learndrops	A5: LMS (track down to the assessment level item, performance management), gamification tools. #guildchat https://t.co/7xcx03L3BB
2:38 PM	JD_Dillon	A5) Reporting in @Axonify helps me understand potential changes in knowledge, correlate to performance #GuildChat https://t.co/lK3WpbZxVb
2:38 PM	urbie	#GuildChat A5 One caveat: policy has to match practice. Train someone to sell ethically then set unreasonable expectations. No.
2:38 PM	urbie	RT @DonaldClark: #GuildChat Don’t measure learning measure impact – kill Kirkpatrick and use business measures
2:39 PM	Axonify	RT @JD_Dillon: A5) Reporting in @Axonify helps me understand potential changes in knowledge, correlate to performance #GuildChat https://t…
2:39 PM	britz	A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildchat
2:40 PM	Quinnovator	@DonaldClark (risking :) Kirkpatrick designed to measure impact, been misused: Level 4 (starting point) is about biz measures! #guildchat
2:40 PM	urbie	RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc…
2:40 PM	LnDDave	RT @eLearningGuild: Q5) What current technologies help us better understand the learning that is taking place in our organizations? #GuildC…
2:40 PM	Quinnovator	@DonaldClark but agree fully, biz measures only thing that ultimately matters #guildchat
2:40 PM	JD_Dillon	RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc…
2:41 PM	eLearningGuild	Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in practice? #GuildChat
2:41 PM	Quinnovator	a5) don’t like the ‘activity’ measures that assume “if they’re busy, it is good”. Anticipate and look for real impact #guildchat
2:41 PM	LnDDave	RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc…
2:41 PM	LnDDave	RT @eLearningGuild: Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in…
2:42 PM	urbie	#GuildChat A5 Some places I’ve been use ________ Five Levels of Evaluation. “That’s all I have to say about that.” F. Gump
2:42 PM	DonaldClark	RT @Quinnovator: a5) don’t like the ‘activity’ measures that assume “if they’re busy, it is good”. Anticipate and look for real impact #gui…
2:42 PM	urbie	RT @eLearningGuild: Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in…
2:42 PM	SimonBlairTrain	@Quinnovator Yes! I’ll take “effective” over “busy” any day of the week! #Guildchat
2:43 PM	AlwaysBreaking	A6) Trek from Cognitive Advisors is an excellent xAPI example. #guildchat
2:43 PM	urbie	#GuildChat A6 SCORM, AICC I’ve seen used lots. But it’s usually described as being “compliant”. So lots of features only few are used.
2:43 PM	learndrops	RT @Quinnovator: a5) don’t like the ‘activity’ measures that assume “if they’re busy, it is good”. Anticipate and look for real impact #gui…
2:43 PM	JD_Dillon	A6) xAPI examples are emerging – but its about tracking all types of activity – not just learning data #GuildChat https://t.co/xgtTXfoFol
2:43 PM	Quinnovator	@DonaldClark even K agreed he misnumbered ;). Wish we had a better model! #guildchat
2:44 PM	Quinnovator	RT @eLearningGuild: Q6) SCORM and xAPI are considered by many as learning tracking technology. What good examples have you seen of these in…
2:44 PM	LnDDave	A6) @MMTorranceis doing some great work with museums using tech like this. #GuildChat
2:44 PM	LnDDave	RT @JD_Dillon: A6) xAPI examples are emerging – but its about tracking all types of activity – not just learning data #GuildChat https://t.…
2:44 PM	britz	RT @LnDDave A6) @MMTorrance is doing some great work with museums using tech like this. #GuildChat
2:45 PM	write2tg	Missing the #guildchat but will check the transcript later. From what I see on my feed, there’s some interesting conversation happening!
2:46 PM	LnDDave	A6) there were some great examples of the potential@of XAPI showcased at #Devalewrn last year. #GuildChat
2:46 PM	DonaldClark	#guildchat xAPI dumps the old RLO model so much better
2:46 PM	urbie	#GuildChat A6 Seeing meaningful results from an LMS report’s usually “above my pay grade” or something I can’t make sense of.
2:47 PM	DonaldClark	#guildchat SCORM was a big mistake driven by lego block metaphor of reusable learning objects by Masie & Wayne Hodgins
2:47 PM	CandiceCPLP	Expecting to learn more at mLearn in a few weeks! #guildchat
2:47 PM	urbie	#GuildChat A6 Intel had a great analytics and reporting: roll out training and some months later yields (and bonus checks) got bigger.
2:47 PM	pbacsich	RT @DonaldClark: #guildchat SCORM was a big mistake driven by lego block metaphor of reusable learning objects by Masie & Wayne Hodgins
2:47 PM	britz	MT @LnDDave A6) some gr8 examples of the potential of xAPI showcased at #Devlearn last year. #GuildChat /let me get (fix) this for u Dave :)
2:48 PM	eLearningGuild	Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat
2:48 PM	Quinnovator	RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat
2:49 PM	urbie	RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat
2:49 PM	CandiceCPLP	Ian Huckabee did a good job explaining, too. #guildchat
2:49 PM	SimonBlairTrain	A7: When do we get telepathy and mind melds? A literal brain dump would be so quick! #guildchat
2:49 PM	learning9togrow	I can assume a lot of new tools online integrating social media and machine learning to measure patterns #guildchat
2:49 PM	LnDDave	RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat
2:50 PM	urbie	#GuildChat A7 Why the continued push to rely on new technology to tell us something that needs to be seen (in some objective human way)?
2:50 PM	tolja	RT @britz: A5. Social tools can do much to track who is learning and doing when people narrate their work openly #showyourwork #wol #guildc…
2:50 PM	JD_Dillon	A7) Terminators and Ultron? Maybe? No? #GuildChat https://t.co/OKliWv7Soz
2:50 PM	CandiceCPLP	A7) More with brain-based, but the real impacts will be in AI-related efforts, driven by Elon Musk. No, really! #guildchat
2:50 PM	urbie	#GuildChat A7 It’s like we agree that learning is a social sort of thing. So why dehumanize it at the end?
2:51 PM	Quinnovator	a7) could be doing a better job of using games for learning and assessment, for one #guildchat
2:51 PM	LnDDave	A7) Data analytics. #GuildChat
2:51 PM	learndrops	A7: Tool intersection: learning, gamification, creation– that explore motivation & cooperative systems #guildchat https://t.co/2J4lO42i7k
2:51 PM	urbie	RT @learndrops: A7: Tool intersection: learning, gamification, creation– that explore motivation & cooperative systems #guildchat https:/…
2:51 PM	Quinnovator	a7) further out, I think semantic assessments of SoMe contributions is a possibility on the horizon #guildchat
2:52 PM	Quinnovator	a7) WWWD: What Would (IBM’s) Watson Do? ;) #guildchat
2:52 PM	AlwaysBreaking	A7) I actually think xAPI will be the foundation that helps us better understand learning. It pulls data from any source. #guildchat
2:52 PM	learning9togrow	RT @learndrops A7: Tool intersection: learning, gamification, creation– that explore motivation… #guildchat https://t.co/wUrxsqMJe7
2:52 PM	DonaldClark	#GuildChat Two letters – AI http://t.co/e1GILOTB80 namely adaptive learning also smart spaced-practice and VR http://t.co/ZDFtwuoM24
2:52 PM	LnDDave	RT @Quinnovator: a7) further out, I think semantic assessments of SoMe contributions is a possibility on the horizon #guildchat
2:54 PM	learning9togrow	I agree that is a social area, but technology can help to nurture and speed the process of learning #guildchat
2:54 PM	AlwaysBreaking	A7) Analytic tools that evaluate millions of small chunks of data will be the next growth area for training. #guildchat
2:54 PM	urbie	#GuildChat A7 Okay. A little out there. An Apple Watch with a Galvenometer. Learner sweats whilst performing, training FAIL. Dry skin: WIN.
2:54 PM	britz	A7. I suspect as machine learning advances we will learn more from it about ourselves and our cognitive processes #guildchat
2:55 PM	DonaldClark	#GuildChat Measurement of real competences thro ‘learning by doing’ in sims & VR fascinating
2:55 PM	eLearningGuild	Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat
2:55 PM	LearnovateSA	RT @eLearningGuild: Q7) What new technologies lay on the horizon to help us get a better understanding of learning? #GuildChat
2:56 PM	britz	RT @eLearningGuild Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat
2:56 PM	urbie	#GuildChat A7 Maybe eye-tracking. Eyes open, good chance they’re learning. Eyes closed, not so much.
2:56 PM	urbie	RT @eLearningGuild: Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat
2:56 PM	LnDDave	A7) part of what will move his forward is the ownership of “learning data” shifting from L&D to I.T. #GuildChat
2:56 PM	LnDDave	RT @eLearningGuild: Time is drawing short. Any final thoughts you’d like to share about today’s topic? #GuildChat
2:56 PM	SimonBlairTrain	@urbie Unless they’re focusing on the audio. :-) #guildchat
2:56 PM	CandiceCPLP	@DonaldClark yes! Can you cite examples you like? #guildchat
2:57 PM	DonaldClark	#GuildChat Why does airline industry use flight sims but oethrs don’t? Pilots go down with the plane ;)
2:57 PM	urbie	#GuildChat Final thoughts.. @learndrops and tool intersection. Some application of existing tech/practice that we haven’t heard about yet.
2:57 PM	britz	@urbie sometimes, in a moment of reflection, I close my eyes. Real learning is experience, practice, conversation & reflection #guildchat
2:57 PM	CandiceCPLP	@urbie Wow, you went from tracking learning to tracking eye movements! Impressive! #guildchat
2:57 PM	LnDDave	RT @britz: @urbie sometimes, in a moment of reflection, I close my eyes. Real learning is experience, practice, conversation & reflection …
2:58 PM	urbie	@CandiceCPLP #GuildChat I’m a #designthinking person at heart. Throw lots of ideas out there n maybe one or three will have legs.
2:58 PM	JD_Dillon	Start w/ outcomes and design towards effective collection and use of data … #GuildChat https://t.co/CgX690mGNK
2:58 PM	bballings	RT @Quinnovator: a5) xAPI can track more than learning. The point is that courses aren’t the only way of learning, so we need to track acti…
2:59 PM	LnDDave	RT @JD_Dillon: Start w/ outcomes and design towards effective collection and use of data … #GuildChat https://t.co/CgX690mGNK
2:59 PM	urbie	Sigh. Now that’s #GuildChat is over it’s >12 hours til #satchat
2:59 PM	Quinnovator	Thoughts: learning is a process, not an event. Tracking learning needs to be similarly continual. We need a finer-grained model #guildchat
3:00 PM	britz	RT @Quinnovator: Thoughts: learning is a process, not an event. Tracking learning needs to be similarly continual. We need a finer-grained …
3:00 PM	urbie	MT #GuildChat #lrnchat https://t.co/JcX6JRsiEI
3:00 PM	eLearningGuild	Thanks for joining #GuildChat everyone. We’ll see you next week. Look for a transcript of today’s chat soon!

Chat Transcript

Leave a Reply Cancel reply