This seems to be an issue with networkx -- the nx.draw_networkx_edge_labels function is incompatible with MultiGraphs (the function expects a 2-tuple, but MultiGraph edges are 3-tuples).
See https://stackoverflow.com/questions/32905262/how-do-i-draw-edge-labels-for-multigraph-in-networkx for more info.
I am getting around this problem for now by not drawing the edge labels.