A Framework For Evaluating Knowledge-Mapping Tools
A Framework For Evaluating Knowledge-Mapping Tools
knowledge-mapping tools
Samuel Driessen, Willem-Olaf Huijsen and Marjan Grootveld
Abstract
Purpose – This article describes the knowledge-mapping framework the authors designed based on
their theoretical and practical research on knowledge mapping. It also shows the practical use of the
Framework for companies interested in knowledge-mapping tools.
Design/methodology/approach – In the first place the authors position their research in the context of
knowledge management and knowledge-mapping research and practice. An example of their practical
research on knowledge mapping is given as a preliminary step to describe their knowledge-mapping
framework. The use of this framework is illustrated. Finally, the authors validate their framework against a
number of commercially available tools with knowledge-mapping functionality.
Findings – The authors found that their framework is useful, insightful and robust when applied to new
knowledge-mapping tools/functionality.
Research limitations/implications – The important issue how to embed knowledge-mapping tools in
organizations is not considered to be in the scope of this article.
Practical implications – Based on concrete examples the authors illustrate the practical implications of
Samuel Driessen is based their knowledge-mapping framework for companies. The Framework can be used for defining
knowledge-mapping tool requirements, the assessment and comparison of commercial tools, and the
at Océ-Technologies,
assessment of available knowledge in an organization.
Venlo, The Netherlands.
Originality/value – Knowledge mapping and its use have been a research issue for some time.
Willem-Olaf Huijsen and
Companies have also adopted knowledge-mapping tools to support and stimulate knowledge sharing
Marjan Grootvel are based
in their organizations and to help employees find the expertise they are looking for. But no research has
at the Telematica Instituut,
been done on how to help companies decide what kind of knowledge-mapping tool they need or how
Enschede, The Netherlands. any tools they already have can be combined in a knowledge-mapping tool. This article describes a
unique and new Framework the authors devised to help companies do just that.
Keywords Knowledge management, Knowledge mapping, Decision support systems
Paper type Research paper
1. Introduction
Over the years articles and papers have appeared about knowledge mapping and its use,
e.g. Wexler (2001); Eppler (2001); Huijsen et al. (2004b). Not too many papers have been
written on how you actually build a knowledge-mapping tool and, most importantly, on how
to embed this tool in your organization. Least of all, papers have been written on how a
company decides what kind of knowledge-mapping tool it wants or needs. This issue is the
topic of this article, because there are many kinds of knowledge-mapping tools. Essentially,
however, they can be summarized in one clear framework. The purpose of this article is to
present such a framework and show its use in practice. This Framework was designed
based on several years of extensive theoretical research and practical implementations,
mainly within the Metis knowledge-management project[1].
Definitions of knowledge management abound. In the authors’ view the objective of
knowledge management is to transform organizations with just smart people to smart,
knowledge-productive organizations. The ability to gather information, generate new
DOI 10.1108/13673270710738960 VOL. 11 NO. 2 2007, pp. 109-117, Q Emerald Group Publishing Limited, ISSN 1367-3270 j JOURNAL OF KNOWLEDGE MANAGEMENT j PAGE 109
knowledge, disseminate and apply this knowledge to improve and innovate is an
organization’s knowledge productivity (Kessels, 2001). Of these abilities, particularly
information gathering benefits from knowledge mapping. Knowledge mapping is about
making the knowledge that is available within an organization transparent and is about
providing insights into its qualities (Huijsen et al., 2003, 2004b). Generally, when employees
look for knowledge, they draw from three sources: other employees, documents of various
types, and information systems (including the internet). First, other employees typically
include close colleagues and other colleagues one knows to have relevant expertise. Unless
it is very important, the search is typically limited to only a few people, which are in direct
proximity (Kraut et al., 1988). Still, there may be others with high-quality knowledge one
misses because one does not know them or is unaware of the expertise one’s colleagues
have. Second, documents often come in large numbers, and with a poor structure to them,
making a quick and effective search very difficult. Third, information systems tend to be
numerous too, and each system has a different interface and internal structure, so that
finding knowledge and piecing together information from across a number of systems is a lot
to ask. The distributed nature of organizational knowledge makes it very hard to get a clear,
complete overview, and to draw conclusions.
Knowledge mapping aims to optimize the effective and efficient use of the corporate
knowledge base by addressing the question how to best support finding the knowledge and
building insights into the qualities of this knowledge (Cross et al., 2001; Huijsen et al., 2004a;
Vail, 1999; Wexler, 2001). Knowledge-mapping systems provide support for addressing
these issues, collecting data on the corporate knowledge from various information systems.
Therefore a knowledge map does not contain knowledge but points to it, as Cross et al.
(2001) states. Collecting data can be done manually, as Wexler (2001) states, but also
(semi-)automatically. The focus in the current article is on (semi-)automatic
knowledge-mapping systems. The knowledge-mapping process is described in detail in
Huijsen et al. (2004b). Put differently, the focus is on information technology, which is one of
the three categories of knowledge management that Schütt (2003) distinguishes. The other
categories – i.e. processes and organization and culture – are outside the scope of this
paper. The next step now after defining knowledge mapping is to illustrate the use of
knowledge-mapping tools. This step is necessary to make the relevance of the
knowledge-mapping framework clear.
j j
PAGE 110 JOURNAL OF KNOWLEDGE MANAGEMENT VOL. 11 NO. 2 2007
Besides stimulating collaboration, improving efficiency in problem solving and finding
experts, knowledge maps can also support introducing new employees to the company and
keeping an overview over the expertise in the organization. New (and young) employees
learn from colleagues, about the level of expertise and/or working methods and
organizational culture. However, for an employee of a software house this is more difficult
for he/she may practically never be at the office but working at the customer’s. These
employees therefore lack the overview over the expertise in the company they are working
for (employer and customer). A knowledge map, which gives an overview over the expertise
in the company, in which knowledge domains, documents, and people are related, solves
their (part of their) problem. This knowledge map also benefits older employees sent on
secondment, who cannot get acquainted with the new colleagues and get an idea of their
expertise. At the other end of the spectrum are employees exiting the company. As
knowledge is in people’s head, these employees can take knowledge essential to the
company with them when they leave (refer to DeLong (2004)). A company must know what
knowledge it needs in time to realize its organizational goals. A knowledge map can help you
gain insight in what knowledge is ‘‘available’’ in the organization and what is not. Based on
this insight decisions can be made to hire people with a certain expertise. Furthermore a
company can decide to try and make sure certain knowledge will not be lost, when
employees exit the company. Knowledge maps can show the dynamics in the level of
knowledge on a certain topic in a company. Keeping a pointer to an ex-colleague in the
system can also be useful. In this way a company can hire this ex-colleague to come back for
a certain time to share knowledge with current employees.
All these different applications of knowledge mapping can make it difficult for companies to
decide what knowledge they want to have mapped and what knowledge is already being
mapped. The authors found that all the above-mentioned and other types of knowledge
maps can be ‘summarized’ in one knowledge-mapping framework. Knowledge mapping
basically consists of relations between knowledge items, (groups of) people, activities,
concepts and terms. These elements will be explained below. But first a case study should
help the reader get a good idea of the use of the framework.
j j
VOL. 11 NO. 2 2007 JOURNAL OF KNOWLEDGE MANAGEMENT PAGE 111
Figure 1 Model of the knowledge-mapping system for Basell’s ERC
j j
PAGE 112 JOURNAL OF KNOWLEDGE MANAGEMENT VOL. 11 NO. 2 2007
knowledge maps and thereby deal with these issues. First, the following definition of
knowledge maps is used in this article:
A knowledge map is a presentation of one or more aspects of the knowledge available within an
organization that aims to fulfill a specific information need for one or more employee roles within
the organization.
Thus, as discussed in section 3, knowledge maps may differ with respect to the aspects of
organizational knowledge they deal with. The current Framework enumerates the possible
aspects of organizational knowledge. The next section presents a general, high-level
entity-relationship model that describes the entities and their relationships that are central in
understanding the organizational knowledge.
j j
VOL. 11 NO. 2 2007 JOURNAL OF KNOWLEDGE MANAGEMENT PAGE 113
3. Groups:
B ‘‘created’’ – see under ‘‘persons’’;
B ‘‘executes’’ – a group may execute a given activity;
B ‘‘has expertise on’’ – a group may have expertise on a given concept;
B ‘‘has expertise required by’’ – a group may have expertise required by a given activity;
B ‘‘is subgroup of’’ – groups may be hierarchically structured; and
B ‘‘is interested in’’ – see under ‘‘persons’’.
4. Knowledge items:
B ‘‘contains knowledge required by’’ – knowledge items may contain knowledge
required by certain activities;
B ‘‘describes’’ – knowledge items describe or specify activities; and
B ‘‘is about’’ – knowledge items are about concepts.
5. Persons:
B ‘‘accessed’’ – people access knowledge items;
B ‘‘created’’ – people and groups create knowledge items;
B ‘‘exchanged information with’’ – people exchange information with each other on
concepts;
B ‘‘executes’’ – a person may execute a given activity;
B ‘‘has expertise on’’ – people and groups have expertise on concepts;
B ‘‘has expertise required by’’ – a person may have expertise required by a given
activity;
B ‘‘is interested in’’ – people and groups are interested in concepts; and
B ‘‘is part of’’ – people are part of groups.
6. Terms:
B ‘‘is term for’’ – is a term used for describing a given concept; and
B ‘‘is preferred term for’’ – is the preferred term used for describing a given concept.
j j
PAGE 114 JOURNAL OF KNOWLEDGE MANAGEMENT VOL. 11 NO. 2 2007
4.3 Benefits from the knowledge-mapping framework
The authors’ proposed conceptual framework for knowledge mapping enables new ways of
working with knowledge mapping by articulating and visualizing relevant aspects of
requirements and existing tools. This is of use in the following activities: first, in assessing the
available knowledge. The information on relevant entities as it is available in existing
information systems is the basis for any knowledge-mapping system one may want to
implement. Therefore, it is important, at the outset, to first make an inventory of the potential
sources and the entities, relations, and attributes they may yield. The framework may readily
be used to collect the results of such an inventory, and to understand their potential for the
knowledge-mapping system. Second, in defining system requirements. The framework
enables organizations that are in the process of defining their knowledge-mapping
requirements to comprehensively assess all relevant aspects. Third, in assessing tools. A
plethora of tools is available that address one or more aspects of knowledge mapping; few
tools fully implement the knowledge-mapping concept (section 5 describes the results of the
tool study). This may or may not be a problem in implementing knowledge mapping,
depending on the scope of the desired functionality. Also, the documentation on the tools
offered by vendors typically and understandably stresses the functionality the tool does
offer, and does so in a verbose, non-technical way that makes it difficult to assess the
technical characteristics and inner workings that are relevant to a good assessment. The
framework enables assessment of tools in all relevant aspects by providing an exhaustive list
of types of entities and relations, so that vendor documentation can be read more effectively,
and relevant additional questions to vendors can be phrased in a more targeted way. Fourth,
in comparing tools against each other, and matching them against requirements. The
combination of the previous two uses of the Framework also enables matching tools with
established requirements.
j j
VOL. 11 NO. 2 2007 JOURNAL OF KNOWLEDGE MANAGEMENT PAGE 115
interfacing with a substantial number of information sources. Apart from connector
technology it is also necessary to solve the subscription and authentication issues; here the
authors assume that the searcher is allowed to access all underlying information sources.
Now if some sources refer to employees, others to projects (the activity entity in the
framework) and a third group to documents, retrieving and presenting who authored what
document in the course of which project is certainly feasible. This extends the search
functionality with knowledge-mapping functionality.
A number of inspected tools register what users search for and/or what knowledge items
(content) they contribute, which instantiates the Framework relations ‘‘is interested in’’ and
‘‘created’’, respectively. From this the tools conclude to a person’s interest and expertise,
respectively. This supports the process of expertise location (Lamont, 2003; Leavitt, 2003) in
an organization and can stimulate people to maintain their expertise and interests in a
personal profile that colleagues can access. Along with locating expertise three tools in the
selection claim to automatically derive communities. People who have produced knowledge
items in a certain knowledge domain and/or search for it are considered members of the
same virtual community by one of the tools. For another tool people retrieving related content
constitute such a community (cf. the relation ‘‘accessed’’). Based on common topics in email
communication (cf. the relation ‘‘is about’’) a third tool derives what it calls communities of
interest. This matches the group aspect of the framework. All tools present this information in
relation to the content domain and enable the user to contact community members on the
spot, deploying the ‘‘contact information’’ that may be associated with the entity ‘‘person’’.
However, since neither tool actively notifies community members of this arrangement, it is
doubtful whether any community feeling arises (Wenger and Snyder, 2000).
6. Conclusions
The authors described the knowledge-mapping framework they developed based on
theoretical and practical research they conducted on knowledge mapping. At a theoretical
level this framework contributes to the research on knowledge mapping. Practically, the
authors’ framework helps companies gain insight in the elements of knowledge-mapping
tools they already have, define requirements of the knowledge mapping tool they would like,
assess existing tools and compare them to each other. The authors validated their
framework against a number of commercially available tools with knowledge-mapping
functionality. An important asset of this type of tools is the federated search functionality. With
respect to the sample of tools the main conclusion is that they do not make the framework’s
entities and relationships as explicit as desirable in a proper knowledge map. However, they
implement many of the framework’s entities and relations. The authors conclude that the
framework describes these tools well. Therefore, it does not only model the situations that
gave rise to it but also proved to be robust to new (types of) knowledge-mapping tools.
Finally, future research is planned in the following directions: firstly, the authors will
investigate whether the framework can be developed into a separate tool. Secondly, the
knowledge-mapping research reported on here so far has focused on semi-automatically
collecting data for the knowledge map. The authors now intend to focus on fully-automatic
data collection in the near future.
Notes
1. Refer to http://metis.telin.nl/
References
Cross, R., Parker, A., Prusak, L. and Borgatti, S.P. (2001), ‘‘Knowing what we know: supporting
knowledge creation and sharing in social networks’’, Organizational Dynamics, Vol. 30 No. 2, pp. 100-20.
j j
PAGE 116 JOURNAL OF KNOWLEDGE MANAGEMENT VOL. 11 NO. 2 2007
DeLong, D. (2004), Lost Knowledge: Confronting the Threat of an Aging Workforce, Oxford University
Press, Oxford.
Eppler, M.J. (2001), ‘‘Making knowledge visible through intranet knowledge maps: concepts, elements,
cases’’, Proceedings of the 34th Hawaii International Conference on System Sciences, Vol. 4, p. 4030.
Gertner, D. (1978), ‘‘On relational meaning: the acquisition of verb meaning’’, Child Development,
Vol. 49, pp. 988-98.
Huijsen, W., Driessen, S.J. and Jacobs, J.W.M. (2004a), ‘‘Explicit conceptualizations for knowledge
mapping’’, Vol. 3, pp. 231-6, Sixth International Conference on Enterprise Information Systems (ICEIS
2004), Porto, April.
Huijsen, W., Driessen, S.J. and Swaak, J. (2003), ‘‘Knowledge mapping advances’’, Enschede,
available at: https://doc.telin.nl/dscgi/ds.py/get/file-39897/g1734-rapport- metis-taak-knowledge-
mapping-2003-v2004-03-01.pdf
Huijsen, W., van Vliet, H. and Plessius, H. (2004b), ‘‘Picture this: mapping knowledge in higher education
organizations’’, Proceedings EISTA 2004, Orlando, FL, pp. 429-34.
Kessels, J.W.M. (2001), ‘‘Learning in organisations: a corporate curriculum for the knowledge
economy’’, Futures, Vol. 33, pp. 497-506.
Kraaij, W. (2004), ‘‘Variations on language modelling for information retrieval’’, Enschede, available at:
http://purl.org/utwente/41478
Krajewsky, R. (2004), ‘‘Lesson 1: introduction: federated searching defined’’, available at: http://web.
simmons.edu/ , krajewsk/federatedsearching/
Kraut, R., Egido, C. and Galegher, J. (1988), ‘‘Patterns of contact and communication in scientific
research collaboration’’, Proceedings of the 1988 ACM conference on Computer-Supported
Cooperative Work, pp. 1-12.
Lamont, J. (2003), ‘‘Expertise location and the learning organization’’, KMWorld Magazine, Vol. 12 No. 1,
January, available at: www.kmworld.com/publications/magazine/index.cfm? action ¼ readarticle
&Article_ID ¼ 1397&Publication_ID ¼ 83
Leavitt, P. (Ed.) (2003), Expertise Locator Systems: Finding the Answers, American Productivity &
Quality Center (APQC), Houston, TX.
Schütt, P. (2003), ‘‘The post-Nonaka knowledge management’’, Journal of Universal Computer Science,
Vol. 9 No. 6, pp. 451-62.
Swaak, J., Efimova, L., Kempen, M. and Graner, M. (2004), ‘‘Finding in-house knowledge: patterns and
implications’’, in Tochterman, K. and Maurer, H. (Eds), Proceedings of I-KNOW’04, Know-Center Austria,
Graz, Austria, pp. 27-34.
van den Berg, C. and Popescu, I. (2005), ‘‘An experience in knowledge mapping’’, Journal of
Knowledge Management, Vol. 9 No. 2, pp. 123-8.
Vail, E.F. III (1999), ‘‘Mapping organisational knowledge’’, Knowledge Management Review, Vol. 8,
May/June, pp. 10-15.
Wenger, E.C. and Snyder, W.M. (2000), ‘‘Communities of practice: the organizational frontier’’, Harvard
Business Review, January-February, pp. 139-45.
Wexler, M.N. (2001), ‘‘The who, what and why of knowledge mapping’’, Journal of Knowledge
Management, Vol. 5 No. 3, pp. 249-63.
Corresponding author
Samuel Driessen can be contacted at: samuel.driessen@oce.com
j j
VOL. 11 NO. 2 2007 JOURNAL OF KNOWLEDGE MANAGEMENT PAGE 117
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.