Publishing in Medical Education: Is it all about the metrics?

Sarah Allsop

In the latest publishing blog, BMERG blog editor Dr Sarah Allsop explores what research metrics are and if these are the only way for medical educators to show their impact.

Photo by Moritz Mentges on Unsplash

We are often told that we need to publish, we need to think about journal metrics, we need to build our research profile; but what do these things actually mean and they the best way for education researchers to show and share their impact?

Lets start by taking a look at the term ‘research metrics’.

Research metrics (or indicators) are numerical markers designed to help evaluate research outputs. There are a number of different metrics in use, considered at different levels depending on whether they are indicators about an article, a journal or the author. Some of the most common metrics are citation counts, altmetrics, h-index and journal impact factors.

Citation counts: This is an article metric and is a simple count of the number of times an article has been cited in others work. It is a very commonly used metric aiming to quantitatively measure the impact and influence of a publication.

Altmetrics: Short for alternative metrics, this is an article metric, but in contrast to the traditional citation count includes tracking the online attention and engagement received by research outputs, including social media mentions, downloads, views, and media coverage. This is often displayed as a colourful ‘donut’. Altmetrics therefore potentially offer a broader perspective on the impact and reach of research beyond citations. Tools like Altmetric Explorer can help you to track this type of metric.

H-index: This is one of the most commonly used author metric proposed as a way to measure both the quantity (number of publications) and the quality (number of citations) of an author’s work. An author has an h-index of h, if h of their publications have been cited at least h times each, for example, an h-index of 5, means at least 5 papers that have been cited at least 5 times each.

Journal Impact Factors: The Journal Impact Factor (JIF) is perhaps the most commonly used journal metric, and assesses the average number of citations received by articles published in a specific journal within a particular timeframe. Of note whilst it is an indicator of reach and popularity, it has been criticised as a measure of prestige rather than necessarily quality [1].

So, are there other ways to show impact?

Whilst it is undoubtedly true that research metrics are important, you can also highlight reach, value and impact of your work in other ways. This can range widely and can also incorporate a more qualitative approach to impact evidence sharing your own story, plus testimonials from others. Examples include:

Using case studies: Do you have examples of where you have advised others on their practice or shared techniques or guidance with other institutions? Use these as case studies of external impact of your expertise.

Exploring networks: Think big – are you involved with working with other associations, companies or professional bodies? Don’t forget to highlight and share your work in this way and the extended reach these activities might have. Think local – are you involved with local mentoring schemes or other programmes of work that support others to achieve. Not all examples have to be national or international to show profound impact for those around you.

Using multimedia: Are there other ways you can be communicating your work that might raise awareness and increase the audience for your work. You could consider a blog, writing for a website, making YouTube videos, podcasts or designing infographics of your work. Thinking outside the box can have amazing consequences, perhaps leading to invitations to speak at new places due to sharing your work more innovatively and visibly.

Which leads me on to my one really important point – in order to show your impact, you need to think about your visibility. Are you visible on your institution’s profile pages? Do you have professional social media accounts or ResearchGate, Google Scholar or LinkedIn profiles? Consideration for how you build your profile using these tools will allow you to highlight your achievements and share your resources to a potentially wider audience. Watch out for a new blog coming soon on maximising your external profile.

Read more about research metrics: