Mendeley vs Bookends: No Contest

by Jeremy on 4/1/2012

in Geeky, General

My take on the battle of bibliographic software

Time was when managing a reference bibliography required a stack of cards, either plain 3 x 5s or, if you were very technologically advanced, bigger ones with holes punched around the edge, and a secretary or, if you were technologically advanced but lower than pond-scum on the hierarchy, a knitting needle, a typewriter and a big bottle of correction fluid.

Time was when the worst part about having a paper rejected by Nature, and considering resubmission to Science, was the thought of having to reformat both the citations and the references themselves.

Today, though, these nightmares are all but forgotten.

There are several packages that will manage your sources and help you to create citations and references in the papers you are churning out. I’ve used one of them, Bookends, a paid-for option for the Mac, for a few years now, and would not be without it. Recently, though, I had need to corral a bunch of authors and their disparate systems into a smooth-reading whole. So I turned to Mendeley, which offers onlineness and social tools. With Mendeley, you can create groups (open or closed) and use them to gather references from the several authors. If they’ve heard of Mendeley. And if they know vaguely how to use it. It seemed, at first, like an ideal solution.

Problems

In theory, one of the great things about Mendeley is that you can search the papers others have inserted to find one you need, and then copy that to your own library. Unfortunately, there are often duplicates. Furthermore, the differences between two instances of what must be the same original source are not trivial; if you actually care about this sort of thing, Mendeley may add work, as it forces you to go elsewhere to get the “correct” details. These are my qualitative impressions — I have not backed them up with analysis as an old chum did a while back — but they are enough to make me wary of relying on Mendeley as a source of sources, ITSWIM.1

An even bigger problem, for me, came when I tried to use Mendeley to insert citations into a Word document and then produce the bibliography. In a nutshell, it was hopeless. There did not seem to be any kind of fine-grained control over the output, with author names, for example, being all over the shop and some of the formatting impossible to alter.

Bookends is completely different, offering extremely fine-grained control of output (You’ld like to use § as a delimiter? Certainly.) and formatting for citations and references. It also inserts no unwanted cruft into the document itself, something I noted only after switching from Mendeley to Bookends and wondering why Bookends kept barfing about non-existent citations that weren’t citations at all; they were Mendeley’s undigested pearls.

In the end, I used Mendeley to gather material from some of the other authors, and exported from there into Bookends for the final runs. And that showed up yet another weakness of Mendeley, the way it handles utf-8 stuff, including diacriticals. Øȟ ẙȅṩ indeed.

Solutions

With the document in question done and dusted, at least for now, I thought it might be worthwhile thinking about future efforts of the same kind. As I said, one of Mendeley’s great strengths is that it shares bibliographic information. The downside is the quality of that information, about which, to be fair, Mendeley makes no claims. Its other great weakness, at least in the free version I used, is that it offers almost no formatting abilities. Bookends has great and almost infinitely flexible formatting. Ironically, the one “social” aspect of Bookends is that users can share their formatting templates for specific publications and for importing from specific databases. That is a tremendous benefit.

What if Bookends allowed users to share bibliographic information?

Not the PDFs themselves because there would be rights issues. But the actual metadata. One advantage I can see is that because I do care about accuracy, I know the details I have are mostly correct. I could share with confidence. And I could hope that other people who have actually paid for the software might be similarly diligent. It would also be possible to do something better than Mendeley about disputed items. Mendeley currently flags some things as needing attention, but doesn’t actually tell me where to look. Anyway, that’s just a thought. A second thought is that maybe Bookends already allows this, and I have not discovered how. Given its many complexities, most of which I have not yet discovered, this is not beyond the realms of possibility.

I suppose another solution might be for Mendeley to start doing a better job of curating the accuracy of its entries, but somehow that doesn’t seem nearly as likely.

Finally

There are, of course, other solutions that allow sharing for the discovery of sources. Citeulike still has a lot going for it, although I have neglected it of late.2 It certainly offers an alternative for collecting references from a group of authors. I’ve no idea how it performs in generating citations and bibliographies, but it could easily replace Mendeley as the corral, with an easy export to Bookends. Others I haven’t used at all. For now, I’m sticking with Bookends. And paying for it. Happily.

Footnotes:
  1. The same chum is first author on Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web, which although it is now over three years old remains an excellent introduction to the costs and benefits of online libraries. []
  2. Maybe I should consider synchronizing Bookends and Citeulike on a regular basis. []

15 comments

Ricardo Vidal January 4, 2012 at 7:48 pm

Hi Jeremy,
Great post. As a community liaison with Mendeley, I’d like to comment on a couple things you mentioned in your post.
From what I gather, your main issues with Mendeley are: 1) Accuracy of metadata obtained through Mendeley’s article catalog, 2) Ability to produce customized citation formats, 3) Better user interface/experience with regards to metadata fields.
Assuming this is correct, let me touch on each of these.
1) The research catalog is generated from the aggregation of millions of documents being uploaded by Mendeley users. These data are not necessarily the easiest to consolidate. We know of many issues and are working hard to improve the quality of the massive database.
2) Your word processing issues are justified as regards to citation style editing. In fact, Mendeley has about a dozen built-in citation styles you can select from and another 1000+ you can select from our repository. If you need a specific and custom format, it is not yet possible to do so within our application. It’s a feature soon to be implemented. The extra “cruft” you find in the word document is actually useful information for Mendeley to be able to allow multiple users to work on the same document if necessary. Keeping libraries consistent across users is something that is quite useful when working in collaboration.
3) The “needs review” folder that catches references that have incomplete document details is just that, letting you know that the details are incomplete or incorrect. Using simple DOI lookup should keep things organized and complete. To that extent, if you feel any document details are incorrect, the unique identifier lookup is always a great simple way to have information clean and correct.

Finally, I’d like to say that while there is plenty of space for improvement, I believe that you happened to pick up on some of the main features we are currently working on. During this year we should see many of your problemas sorted out and hopefully allow Mendeley to be a more integral part of your workflow.

PS: Mendeley can sync with CiteULike and Zotero. So that might be of help too.

Reply

Jeremy January 5, 2012 at 8:38 am

Many thanks for taking the time to reply, Ricardo (although I suppose that’s your job). with respect to your comments, I appreciate that Mendeley is a work in progress and, like most of these complex systems, probably always will be.

I’m puzzled by your justification of the cruft. Once I decided that I did not want to use Mendeley to insert the citations, and deleted the inserted fields by hand, I would have expected ALL the inserted material to have gone. Instead, Mendeley left invisible droppings behind. I couldn’t find an “unscan” option or anything similar. And for formatting, there seemed to be no way to remove the URI from which the paper might (or might not) be obtained, but maybe I didn’t look hard enough.

Any word on the utf-8 issues?

I’m sure I will continue to use Mendeley for some things, and maybe in the future it will be my tool of choice, but right now, as I said, I’m not happy with relying on it alone.

Reply

Ricardo Vidal January 5, 2012 at 9:23 pm

Hi Jeremy,
As for the leftover data in the word file, I’m assuming it’s the metadata that Mendeley pops in there so that when you share that file with someone you may want to collaborate with in Mendeley, they don’t get any error messages if they happen to miss any of the references you’ve cited in their library. Our devs try their best to keep up to standards and avoid cruft as much as possible. The extra data in the files could also be compatibility data for use in other word processors. You’d have to share the file with one of our devs to let them tell you exactly what’s up (I’m sure they’d be more than happy to explain the what and the how).

The URI is perhaps an option you have not deselected when choosing your citation style. You will find a check box to only use URIs when citing a web page. This might solve your problem.

As for the utf-8 issues, it’s a known issue (I’ve spoken with one of our devs) and should be ironed out soon in one of our next releases.

Cheers!
Ricardo

Reply

Jeremy January 6, 2012 at 2:29 pm

Thanks for the offer to look into my files. Having cleaned them up, however, I didn’t bother to keep the originals. Maybe next time …

And maybe next time I’ll find that check box.

Reply

Duncan Hull January 4, 2012 at 11:24 pm

Hi Jeremy, glad you found that review useful, took me ages to write! Actually the wikipedia article comparing reference managers is pretty useful too, and it doesn’t go out of date like reviews do…

Reply

Jeremy January 5, 2012 at 8:40 am

Thanks Duncan. You’re right, that article is useful, although I don’t know anyone capable of making a decision based on those tables alone.

Reply

dave January 17, 2012 at 12:32 am

Thanks for this blog. I am just reviewing Mendeley and I had used Bookends for a school paper a while back. I think I’ll stick with Bookends for now. One issue I had as I couldn’t figure out how to manually add a citation for some books I have. there didn’t seem to be any method to manually input a reference in Mendeley. could be me, but the website help turned up nothing.

thanks again.

Reply

Jeremy January 17, 2012 at 10:32 am

Thanks for your comment; I’m glad this helped.

On both the desktop and online versions of Mendeley there is a button at the far left marked “Add Documents”. Click on that for the form where you can enter details by hand.

Jeremy

Reply

Alex February 27, 2012 at 7:26 pm

Hi,
Thank you for this blog post. I am currently using PC/Mendeley and am a new user of Mac/Bookends. You mentioned that “… used Mendeley to gather material from some of the other authors, and exported from there into Bookends for the final runs”. Could you share more in detail what is the best way to move an entire PC/Mendeley library and import it into Mac/Bookends? Thanks.

Reply

Jeremy February 27, 2012 at 8:16 pm

This is from memory, and I am traveling, so no guarantees …

Mendeley desktop will synchronize with your on-line library. When you have it synchronized, select all, or just the ones you want, and choose Export. Mendeley offers you a variety of formats. I think I chose RIS, but I cannot be certain. Export the file, and then go to Bookends. Open a new library. Import the file. If everything looks more or less OK, move on to checking the formatting of the imports. I had problems with UTF8 characters and other glitches. If it doesn’t look OK, delete that library in Bookends and try a different format for the export from Mendeley. The import and export take almost no time; it is the reformatting, where needed, that is a pain. And although Mendeley says its formatting is improved, I still prefer to do it in Bookends because it is so much more flexible. Eventually you may decide to copy all the imported references into a single mammoth library, or not.

Hope that helps.

Reply

Rebecca April 9, 2012 at 3:24 pm

I too came to the same conclusion regarding Bookends and Mendeley after a near disaster trying to write papers using Mendeley. My Word document got exceedingly slow and bloated. I’ve now moved to using Mendeley to store and organize my PDFs. I like the drag and drop functionally and the fact that I don’t need to add or check information and it is still searchable. When I write and I need to cite, I then migrate the necessary information into Bookends. Wouldn’t it be grand if Bookends would permit drag-and-drop and autodiscover of the reference information … I want the best of both worlds!
Thanks for the post.
Cheers,
Rebecca

Reply

Mark May 4, 2012 at 4:25 pm

Jeremy, you ask, “What if Bookends allowed users to share bibliographic information?” Bookends does indeed! Have you had a look at the server that is baked right into Bookends? The example code provided by the developer is very basic, but all of the tools are there to create a fantastic searchable web portal for your own Bookends library that you can give anyone access to.

Unfortunately, it requires some web design and coding savvy that a lot of people are not going to have in order to design something really nice, but I find it refreshing that the developer has given this ability to really expand how BookEnds may be used.

…now if they could just come up with a better way to link a users PDF files between their desktop and iOS application.

Reply

Jeremy May 4, 2012 at 4:35 pm

Thanks Mark. I did indeed look into that briefly, and it would give others access to my resources. I’m thinking more of the ability to share all the details of a reference in the way that Mendeley (and Citeulike) allow. If I were a coder I’d be thinking of how to use Bookends facilities to enable that via some centralized site.

As for links with iOS … try putting your attachments folder into Dropbox. Works for me!

Reply

Mark May 4, 2012 at 5:03 pm

Yes, I keep my entire PDF library and BookEnds database in dropbox, so I can access it from any Mac with ease. I was referring to their Bookends On Tap app. that unfortunately relies on wifi database/PDF file syncing back and forth from your Mac and iOS device. They really need to come up with a way to have database and PDF file linking via dropbox in iOS. If they ever do, I will be in nirvana.

Reply

Jeremy May 4, 2012 at 6:39 pm

Right. Misunderstood. If I need to, I use a browser to access, rather than the app.

Reply

Leave a Comment

Previous post:

Next post: