My take on the battle of bibliographic software
Time was when managing a reference bibliography required a stack of cards, either plain 3 x 5s or, if you were very technologically advanced, bigger ones with holes punched around the edge, and a secretary or, if you were technologically advanced but lower than pond-scum on the hierarchy, a knitting needle, a typewriter and a big bottle of correction fluid.
Time was when the worst part about having a paper rejected by Nature, and considering resubmission to Science, was the thought of having to reformat both the citations and the references themselves.
Today, though, these nightmares are all but forgotten.
There are several packages that will manage your sources and help you to create citations and references in the papers you are churning out. I’ve used one of them, Bookends, a paid-for option for the Mac, for a few years now, and would not be without it. Recently, though, I had need to corral a bunch of authors and their disparate systems into a smooth-reading whole. So I turned to Mendeley, which offers onlineness and social tools. With Mendeley, you can create groups (open or closed) and use them to gather references from the several authors. If they’ve heard of Mendeley. And if they know vaguely how to use it. It seemed, at first, like an ideal solution.
Problems
In theory, one of the great things about Mendeley is that you can search the papers others have inserted to find one you need, and then copy that to your own library. Unfortunately, there are often duplicates. Furthermore, the differences between two instances of what must be the same original source are not trivial; if you actually care about this sort of thing, Mendeley may add work, as it forces you to go elsewhere to get the “correct” details. These are my qualitative impressions — I have not backed them up with analysis as an old chum did a while back — but they are enough to make me wary of relying on Mendeley as a source of sources, ITSWIM.1
An even bigger problem, for me, came when I tried to use Mendeley to insert citations into a Word document and then produce the bibliography. In a nutshell, it was hopeless. There did not seem to be any kind of fine-grained control over the output, with author names, for example, being all over the shop and some of the formatting impossible to alter.
Bookends is completely different, offering extremely fine-grained control of output (You’ld like to use § as a delimiter? Certainly.) and formatting for citations and references. It also inserts no unwanted cruft into the document itself, something I noted only after switching from Mendeley to Bookends and wondering why Bookends kept barfing about non-existent citations that weren’t citations at all; they were Mendeley’s undigested pearls.
In the end, I used Mendeley to gather material from some of the other authors, and exported from there into Bookends for the final runs. And that showed up yet another weakness of Mendeley, the way it handles utf-8 stuff, including diacriticals. Øȟ ẙȅṩ indeed.
Solutions
With the document in question done and dusted, at least for now, I thought it might be worthwhile thinking about future efforts of the same kind. As I said, one of Mendeley’s great strengths is that it shares bibliographic information. The downside is the quality of that information, about which, to be fair, Mendeley makes no claims. Its other great weakness, at least in the free version I used, is that it offers almost no formatting abilities. Bookends has great and almost infinitely flexible formatting. Ironically, the one “social” aspect of Bookends is that users can share their formatting templates for specific publications and for importing from specific databases. That is a tremendous benefit.
What if Bookends allowed users to share bibliographic information?
Not the PDFs themselves because there would be rights issues. But the actual metadata. One advantage I can see is that because I do care about accuracy, I know the details I have are mostly correct. I could share with confidence. And I could hope that other people who have actually paid for the software might be similarly diligent. It would also be possible to do something better than Mendeley about disputed items. Mendeley currently flags some things as needing attention, but doesn’t actually tell me where to look. Anyway, that’s just a thought. A second thought is that maybe Bookends already allows this, and I have not discovered how. Given its many complexities, most of which I have not yet discovered, this is not beyond the realms of possibility.
I suppose another solution might be for Mendeley to start doing a better job of curating the accuracy of its entries, but somehow that doesn’t seem nearly as likely.
Finally
There are, of course, other solutions that allow sharing for the discovery of sources. Citeulike still has a lot going for it, although I have neglected it of late.2 It certainly offers an alternative for collecting references from a group of authors. I’ve no idea how it performs in generating citations and bibliographies, but it could easily replace Mendeley as the corral, with an easy export to Bookends. Others I haven’t used at all. For now, I’m sticking with Bookends. And paying for it. Happily.
Footnotes:- The same chum is first author on Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web, which although it is now over three years old remains an excellent introduction to the costs and benefits of online libraries. [↩]
- Maybe I should consider synchronizing Bookends and Citeulike on a regular basis. [↩]
Add your own comment
Hi Jeremy,
Great post. As a community liaison with Mendeley, I’d like to comment on a couple things you mentioned in your post.
From what I gather, your main issues with Mendeley are: 1) Accuracy of metadata obtained through Mendeley’s article catalog, 2) Ability to produce customized citation formats, 3) Better user interface/experience with regards to metadata fields.
Assuming this is correct, let me touch on each of these.
1) The research catalog is generated from the aggregation of millions of documents being uploaded by Mendeley users. These data are not necessarily the easiest to consolidate. We know of many issues and are working hard to improve the quality of the massive database.
2) Your word processing issues are justified as regards to citation style editing. In fact, Mendeley has about a dozen built-in citation styles you can select from and another 1000+ you can select from our repository. If you need a specific and custom format, it is not yet possible to do so within our application. It’s a feature soon to be implemented. The extra “cruft” you find in the word document is actually useful information for Mendeley to be able to allow multiple users to work on the same document if necessary. Keeping libraries consistent across users is something that is quite useful when working in collaboration.
3) The “needs review” folder that catches references that have incomplete document details is just that, letting you know that the details are incomplete or incorrect. Using simple DOI lookup should keep things organized and complete. To that extent, if you feel any document details are incorrect, the unique identifier lookup is always a great simple way to have information clean and correct.
Finally, I’d like to say that while there is plenty of space for improvement, I believe that you happened to pick up on some of the main features we are currently working on. During this year we should see many of your problemas sorted out and hopefully allow Mendeley to be a more integral part of your workflow.
PS: Mendeley can sync with CiteULike and Zotero. So that might be of help too.
Many thanks for taking the time to reply, Ricardo (although I suppose that’s your job). with respect to your comments, I appreciate that Mendeley is a work in progress and, like most of these complex systems, probably always will be.
I’m puzzled by your justification of the cruft. Once I decided that I did not want to use Mendeley to insert the citations, and deleted the inserted fields by hand, I would have expected ALL the inserted material to have gone. Instead, Mendeley left invisible droppings behind. I couldn’t find an “unscan” option or anything similar. And for formatting, there seemed to be no way to remove the URI from which the paper might (or might not) be obtained, but maybe I didn’t look hard enough.
Any word on the utf-8 issues?
I’m sure I will continue to use Mendeley for some things, and maybe in the future it will be my tool of choice, but right now, as I said, I’m not happy with relying on it alone.
Hi Jeremy,
As for the leftover data in the word file, I’m assuming it’s the metadata that Mendeley pops in there so that when you share that file with someone you may want to collaborate with in Mendeley, they don’t get any error messages if they happen to miss any of the references you’ve cited in their library. Our devs try their best to keep up to standards and avoid cruft as much as possible. The extra data in the files could also be compatibility data for use in other word processors. You’d have to share the file with one of our devs to let them tell you exactly what’s up (I’m sure they’d be more than happy to explain the what and the how).
The URI is perhaps an option you have not deselected when choosing your citation style. You will find a check box to only use URIs when citing a web page. This might solve your problem.
As for the utf-8 issues, it’s a known issue (I’ve spoken with one of our devs) and should be ironed out soon in one of our next releases.
Cheers!
Ricardo
Thanks for the offer to look into my files. Having cleaned them up, however, I didn’t bother to keep the originals. Maybe next time …
And maybe next time I’ll find that check box.
Hi Jeremy, glad you found that review useful, took me ages to write! Actually the wikipedia article comparing reference managers is pretty useful too, and it doesn’t go out of date like reviews do…
Thanks Duncan. You’re right, that article is useful, although I don’t know anyone capable of making a decision based on those tables alone.
Thanks for this blog. I am just reviewing Mendeley and I had used Bookends for a school paper a while back. I think I’ll stick with Bookends for now. One issue I had as I couldn’t figure out how to manually add a citation for some books I have. there didn’t seem to be any method to manually input a reference in Mendeley. could be me, but the website help turned up nothing.
thanks again.
Thanks for your comment; I’m glad this helped.
On both the desktop and online versions of Mendeley there is a button at the far left marked “Add Documents”. Click on that for the form where you can enter details by hand.
Jeremy