Releases: google-deepmind/mujoco
2.3.5
Bug fixes
-
Fix asset loading bug that prevented OBJ and PNG files from being read from disk when
mjVFSis used. -
Fix occasional segmentation faults on macOS when mouse perturbations are applied in the Python passive viewer.
Plugins
2.3.4
24 April 2023: This version is affected by an asset loading bug that prevents OBJ and PNG files from being read from disk when mjVFS is used. Users are advised to skip to version 2.3.5 instead.
General
- Removed the "global" setting of the compiler/coordinate attribute. This rarely-used setting complicates the compiler logic and is blocking future improvements. In order to convert older models which used this option, load and save them in MuJoCo 2.3.3 or older.
- Added
visual-globalflagellipsoidinertiato visualize equivalent body inertias with ellipsoids instead of the default boxes. - Added midphase and broadphase collision statistics to
mjData. - Added documentation for engine plugins.
- Added struct information to the
introspectmodule. - Added a new extension mechanism called "resource provider" . This extensible mechanism allows MuJoCo to read assets from data sources other than the local OS filesystem or the Virtual file system.
Python bindings
- Offscreen rendering on macOS is no longer restricted to the main thread. This is achieved by using the low-level Core OpenGL (CGL) API to create the OpenGL context, rather than going via GLFW which relies on Cocoa's NSOpenGL. The resulting context is not tied to a Cocoa window, and is therefore not tied to the main thread.
- Fixed a race condition in
viewer.launch_passiveandviewer.launch_repl. These functions could previously return before an internal call tomj_forward. This allows user code to continue and potentially modify physics state concurrently with the internalmj_forward, resulting in e.g. MuJoCo stack overflow error or segmentation fault. - The
viewer.launch_passivefunction now returns a handle which can be used to interact with the viewer. The passive viewer now also requires an explicit call tosyncon its handle to pick up any update to the physics state. This is to avoid race conditions that can result in visual artifacts. See documentation for details. - The
viewer.launch_replfunction has been removed since its functionality is superceded bylaunch_passive. - Added a small number of missing struct fields discovered through the new
introspectmetadata.
Bug fixes
- Fixed bug in the handling of ellipsoid-based fluid model forces in the new implicitfast integrator.
- Removed spurious whole-arena copying in
mj_copyData, which can considerably slow down the copying operation (#568). - Make
shellinertiaignoreexactmeshinertia, which is only used for legacy volume computations (#759).
2.3.3
General
-
Improvements to implicit integration:
- The derivatives of the RNE algorithm are now computed using sparse math, leading to significant speed improvements for large models when using the implicit integrator.
- A new integrator called
implicitfastwas added. It is similar to the existing implicit integrator, but skips the derivatives of Coriolis and centripetal forces. See the numerical integration section for a detailed motivation and discussion. The implicitfast integrator is recommended for all new models and will become the default integrator in a future version.
The table below shows the compute cost of the 627-DoF humanoid100 model using different integrators. "implicit (old)" uses dense RNE derivatives, "implicit (new)" is after the sparsification mentioned above. Timings were measured on a single core of an AMD 3995WX CPU.
| timing | Euler | implicitfast | implicit (new) | implicit (old) |
|---|---|---|---|---|
| one step (ms) | 0.5 | 0.53 | 0.77 | 5.0 |
| steps/second | 2000 | 1900 | 1300 | 200 |
- Added a collision mid-phase for pruning geoms in body pairs, see documentation for more details.
This is based on static AABB bounding volume hierarchy (a BVH binary tree) in the body inertial frame. The GIF on the right is cut from this longer video. - The
mjd_transitionFDfunction no longer triggers sensor calculation unless explicitly requested. - Corrected the spelling of the
intevalattribute tointervalin the mjLROpt struct. - Mesh texture and normal mappings are now 3-per-triangle rather than 1-per-vertex. Mesh vertices are no longer duplicated in order to circumvent this limitation as they previously were.
- The non-zeros for the sparse constraint Jacobian matrix are now precounted and used for matrix memory allocation.
For instance, the constraint Jacobian matrix from the humanoid100 model, which previously required ~500,000mjtNums, now only requires ~6000. Very large models can now load and run with the CG solver. - Modified
mju_errorandmju_warningto be variadic functions (support for printf-like arguments). The functionsmju_error_i,mju_error_s,mju_warning_i, andmju_warning_sare now deprecated. - Implemented a performant
mju_sqrMatTDSparsefunction that doesn't require dense memory allocation. - Added
mj_stackAllocIntto get correct size for allocating ints on mjData stack. Reducing stack memory usage by 10% - 15%.
Python bindings
- Fixed IPython history corruption when using
viewer.launch_repl. Thelaunch_replfunction now provides seamless continuation of an IPython interactive shell session, and is no longer considered experimental feature. - Added
viewer.launch_passivewhich launches the interactive viewer in a passive, non-blocking mode. Calls tolaunch_passivereturn immediately, allowing user code to continue execution, with the viewer automatically reflecting any changes to the physics state. (Note that this functionality is currently in experimental/beta stage, and is not yet described in our viewer documentation.) - Added the
mjpythonlauncher for macOS, which is required forviewer.launch_passiveto function there. - Removed
efc_fields from joint indexers. Since the introduction of arena memory, these fields now have dynamic sizes that change between time steps depending on the number of active constraints, breaking strict correspondence between joints andefc_rows. - Added a number of missing fields to the bindings of
mjVisualandmjvPerturbstructs.
Simulate
-
Implemented a workaround for broken VSync on macOS so that the frame rate is correctly capped when the Vertical Sync toggle is enabled.
-
Added optional labels to contact visualization, indicating which two geoms are contacting (names if defined, ids otherwise). This can be useful in cluttered scenes.
2.3.2
General
- A more performant mju_transposeSparse has been implemented that doesn't require dense memory allocation. For a constraint Jacobian matrix from the humanoid100.xml model, this function is 35% faster.
- The function
mj_name2idis now implemented using a hash function instead of a linear search for better performance. - Geom names are now parsed from URDF. Any duplicate names are ignored.
mj_printDataoutput now contains contacting geom names.
Bug fixes
- Fixed a bug that for
shellinertiaequal totruecaused the mesh orientation to be overwritten by the principal components of the shell inertia, while the vertex coordinates are rotated using the volumetric inertia. Now the volumetric inertia orientation is used also in the shell case. - Fixed misalignment bug in mesh-to-primitive fitting when using the bounding box fitting option
fitaabb. - The
launch_replfunctionality in the Python viewer has been fixed. - Set
timecorrectly inmjd_transitionFD, to support time-dependent user code. - Fixed sensor data dimension validation when
usertype sensors are present. - Fixed incorrect plugin error message when a null
nsensordatacallback is encountered during model compilation. - Correctly end the timer (
TM_END)mj_fwdConstraintreturns early. - Fixed an infinite loop in
mj_deleteFileVFS.
Simulate
- Increased precision of simulate sensor plot y-axis by 1 digit #719.
- Body labels are now drawn at the body frame rather than inertial frame, unless inertia is being visualised.
Plugins
- The
resetcallback now receives instance-specificplugin_stateandplugin_dataas arguments, rather than the entiremjData. Sinceresetis called insidemj_resetDatabefore any physics forwarding call has been made, it is an error to read anything frommjDataat this stage. - The
capabilitiesfield inmjpPluginis renamedcapabilityflagsto more clearly indicate that this is a bit field.
2.3.1
Python bindings
- The
simulateGUI is now available through themujocoPython package asmujoco.viewer. See documentation for details. (Contribution by Levi Burner.) - The
Rendererclass from the MuJoCo tutorial Colab is now available directly in the native Python bindings.
General
-
The tendon
springlengthattribute can now take two values. Given two non-decreasing values,springlengthspecifies a deadband range for spring stiffness. If the tendon length is between the two values, the force is 0. If length is outside this range, the force behaves like a regular spring, with the spring resting length corresponding to the nearestspringlengthvalue. This can be used to create tendons whose limits are enforced by springs rather than constraints, which are cheaper and easier to analyse. See tendon_springlength.xml example model. This is a minor breaking API change.mjModel.tendon_lengthspringnow has sizentendon x 2rather thanntendon x 1. -
Removed the requirement that stateless actuators come before stateful actuators.
-
Added mju_fill, mju_symmetrize and mju_eye utility functions.
-
Added
gravcompattribute to body implementing gravity compensation and buoyancy. See balloons.xml example model. -
Renamed the
cableplugin library toelasticity. -
Added
actdimattribute to general actuators. Values greater than 1 are only allowed foruser, as native activation dynamics are all scalar. Added example test implementing 2nd-order activation dynamics to engine_forward_test.cc. -
Improved particle composite type, which now permits a user-specified geometry and multiple joints. See the two new examples: particle_free.xml and particle_free2d.xml.
-
Performance improvements for non-AVX configurations:
- 14% faster
mj_solveLDusing restrict. See engine_core_smooth_benchmark_test. - 50% faster
mju_dotSparseusing manual loop unroll. See engine_util_sparse_benchmark_test.
- 14% faster
-
Added new
solidpassive force plugin.- This is new force field compatible with the composite particles.
- Generates a tetrahedral mesh having particles with mass concentrated at vertices.
- Uses a piecewise-constant strain model equivalent to finite elements but expressed in a coordinate-free
formulation. This implies that all quantities can be precomputed except edge elongation, as in a mass-spring model. - Only suitable for small strains (large displacements but small deformations). Tetrahedra may invert if subject to
large loads.
-
Added API functions mj_loadPluginLibrary and mj_loadAllPluginLibraries. The first function is identical to
dlopenon a POSIX system, and toLoadLibraryAon Windows. The second function scans a specified directory for all dynamic libraries file and loads each library found. Dynamic libraries opened by these functions are assumed to register one or more MuJoCo plugins on load. -
Added an optional
visualizecallback to plugins, which is called duringmjv_updateScene. This callback allows custom plugin visualizations. Enable stress visualization for the Cable plugin as an example. -
Sensors of type user no longer require
objtype,objnameandneedstage. If unspecified, the objtype is now mjOBJ_UNKNOWN.usersensorsdatatypedefault is nowreal,needstagedefault is nowacc. -
Added support for capsules in URDF import.
-
On macOS, issue an informative error message when run under Rosetta 2 translation on an Apple Silicon machine. Pre-built MuJoCo binaries make use of AVX instructions on x86-64 machines, which is not supported by Rosetta 2. (Before this version, users only get a cryptic "Illegal instruction" message.)
Bug fixes
- Fixed bug in
mj_addFileVFSthat was causing the file path to be ignored (introduced in 2.1.4).
Simulate
- Renamed the directory in which the
simulateapplication searches for plugins fromplugintomujoco_plugin. - Mouse force perturbations are now applied at the selection point rather than the body center of mass.
Python bindings 2.3.1.post1 (6 December 2022)
- Fix type annotations in
mujoco.viewerthat were causing errors in Python 3.7 and 3.8.
2.3.0
General
-
The
contactarray and arrays prefixed withefc_inmjDatawere moved out of thebufferinto a newarenamemory space. These arrays are no longer allocated with fixed sizes whenmjDatais created. Instead, the exact memory requirement is determined during each call tomj_forward(specifically, inmj_collisionandmj_makeConstraint) and the arrays are allocated from thearenaspace. Thestacknow also shares its available memory witharena. This change reduces the memory footprint ofmjDatain models that do not use the PGS solver, and will allow for significant memory reductions in the future. See the Memory allocation section for details. -
Added colab notebook tutorial showing how to balance the humanoid on one leg with a Linear Quadratic Regulator. The
notebook uses MuJoCo's native Python bindings, and includes a draftRendererclass, for easy rendering in Python. Try it yourself: -
Updates to humanoid model:
- Added two keyframes (stand-on-one-leg and squat).
- Increased maximum hip flexion angle.
- Added hamstring tendons which couple the hip and knee at high hip flexion angles.
- General cosmetic improvements, including improved use of defaults and better naming scheme.
-
Added
mju_boxQPand allocation functionmju_boxQPmallocfor solving the box-constrained Quadratic Program:$x^* = \text{argmin} ; \tfrac{1}{2} x^T H x + x^T g \quad \text{s.t.} \quad l \le x \le u$ The algorithm, introduced in Tassa et al. 2014, converges after 2-5 Cholesky factorisations, independent of problem size. -
Added
mju_mulVecMatVecto multiply a square matrix$M$ with vectors$x$ and$y$ on both sides. The function returns$x^TMy$ . -
Added new plugin API. Plugins allow developers to extend MuJoCo's capability without modifying core engine code. The plugin mechanism is intended to replace the existing callbacks, though these will remain for the time being as an option for simple use cases and backward compatibility. The new mechanism manages stateful plugins and supports multiple plugins from different sources, allowing MuJoCo extensions to be introduced in a modular fashion, rather than as global overrides. Note the new mechanism is currently undocumented except in code, as we test it internally. If you are interested in using the plugin mechanism, please get in touch first.
-
Added
assetdircompiler option, which sets the values of bothmeshdirandtexturedir. Values in the latter attributes take precedence overassetdir. -
Added
realtimeoption tovisualfor starting a simulation at a slower speed. -
Added new
cablecomposite type:- Cable elements are connected with ball joints.
- The
initialparameter specifies the joint at the starting boundary:free,ball, ornone. - The boundary bodies are exposed with the names
B_leftandB_right. - The vertex initial positions can be specified directly in the XML with the parameter
vertex. - The orientation of the body frame is the orientation of the material frame of the curve.
-
Added new
cablepassive force plugin:- Twist and bending stiffness can be set separately with the parameters
twistandbend. - The stress-free configuration can be set to be the initial one or flat with the flag
flat. - New cable.xml example showing the formation of plectoneme.
- New coil.xml example showing a curved equilibrium configuration.
- New belt.xml example showing interaction between twist and anisotropy.
- Added test using cantilever exact solution.
- Twist and bending stiffness can be set separately with the parameters
Python bindings
-
Added
idandnameproperties to named accessor objects. These provide more Pythonic API access tomj_name2idandmj_id2namerespectively. -
The length of
MjData.contactis nownconrather thannconmax, allowing it to be straightforwardly used as
an iterator without needing to checkncon. -
Fix a memory leak when a Python callable is installed as callback (#527).
2.2.2
General
-
Added adhesion actuators mimicking vacuum grippers and adhesive biomechanical appendages.
-
Added related example model and video.
-
Added
mj_jacSubtreeComfor computing the translational Jacobian of the center-of-mass of a subtree. -
Added
torquescaleandanchorattributes toweldconstraints.torquescalesets the torque-to-force ratio exerted by the constraint,anchorsets the point at which the weld wrench is applied. See weld for more details. -
Increased
mjNEQDATA, the row length of equality constraint parameters inmjModel.eq_data, from 7 to 11. -
Added visualisation of anchor points for both
connectandweldconstraints (activated by the 'N' key insimulate). -
Added weld.xml showing different uses of new weld attributes.
-
Cartesian 6D end-effector control is now possible by adding a reference site to actuators with
sitetransmission. See description of newrefsiteattribute in the actuator documentation and refsite.xml example model. Video -
Added
autolimitscompiler option. Iftrue, joint and tendonlimitedattributes and actuatorctrllimited,forcelimitedandactlimitedattributes will automatically be set totrueif the corresponding range is defined andfalseotherwise.If
autolimits="false"(the default) models where arangeattribute is specified without thelimitedattribute will fail to compile. A future release will change the default ofautolimitstotrue, and this compilation error allows users to catch this future change of behavior.This is a breaking change. In models where a range was defined but
limitedwas unspecified, explicitly set limited tofalseor remove the range to maintain the current behavior of your model. -
Added moment of inertia computation for all well-formed meshes. This option is activated by setting the compiler flag
exactmeshinertiatotrue(defaults tofalse). This default may change in the future. -
Added parameter
shellinertiatogeom, for locating the inferred inertia on the boundary (shell). Currently only meshes are supported. -
For meshes from which volumetric inertia is inferred, raise error if the orientation of mesh faces is not consistent. If this occurs, fix the mesh in e.g., MeshLab or Blender.
-
Added catenary visualisation for hanging tendons. The model seen in the video can be found here.
-
Added
azimuthandelevationattributes to visual/global, defining the initial orientation of the free camera at model load time. -
Added
mjv_defaultFreeCamerawhich sets the default free camera, respecting the above attributes. -
simulatenow supports taking a screenshot via a button in the File section or viaCtrl-P. -
Improvements to time synchronisation in
simulate, in particular report actual real-time factor if different from requested factor (if e.g., the timestep is so small that simulation cannot keep up with real-time). -
Added a disable flag for sensors.
-
mju_mulQuatandmju_mulQuatAxissupport in place computation. For examplemju_mulQuat(a, a, b);sets the quaternionaequal to the product ofaandb. -
Added sensor matrices to
mjd_transitionFD(note this is an API change).
Deleted/deprecated features
- Removed
distanceconstraints.
Bug fixes
- Fixed rendering of some transparent geoms in reflection.
- Fixed
intvelocitydefaults parsing.
2.2.1
General
- Added
mjd_transitionFDto compute efficient finite difference approximations of the state-transition and control-transition matrices, see here for more details. - Added derivatives for the ellipsoid fluid model.
- Added
ctrlattribute to keyframes. - Added
clocksensor which measures time. - Added visualisation groups to skins.
- Added actuator visualisation for
freeandballjoints and for actuators withsitetransmission. - Added visualisation for actuator activations.
- Added
<intvelocity>actuator shortcut for "integrated velocity" actuators, documented here. - Added
<damper>actuator shortcut for active-damping actuators, documented here. mju_rotVecMatandmju_rotVecMatTnow support in-place multiplication.mjData.ctrlvalues are no longer clamped in-place, remain untouched by the engine.- Arrays in mjData's buffer now align to 64-byte boundaries rather than 8-byte.
- Add memory poisoning when building with Address Sanitizer (ASAN) and Memory Sanitizer (MSAN). This allows ASAN to detect reads and writes to regions in
mjModel.bufferandmjData.bufferthat do not lie within an array, and for MSAN to detect reads from uninitialised fields inmjDatafollowingmj_resetData. - Add a slider-crank example to
model/.
Bug fixes
- Activation clamping was not being applied in the implicit integrator.
- Stricter parsing of orientation specifiers. Before this change, a specification that included both
quatand an alternative specifier e.g.,<geom ... quat=".1 .2 .3 .4" euler="10 20 30">, would lead to thequatbeing ignored and onlyeulerbeing used. After this change a parse error will be thrown. - Stricter parsing of XML attributes. Before this change an erroneous XML snippet like
<geom size="1/2 3 4">would have been parsed assize="1 0 0"and no error would have been thrown. Now throws an error. - Trying to load a
NaNvia XML like<geom size="1 NaN 4">, while allowed for debugging purposes, will now print a warning. - Fixed null pointer dereference in
mj_loadModel. - Fixed memory leaks when loading an invalid model from MJB.
- Integer overflows are now avoided when computing
mjModelbuffer sizes. - Added missing warning string for
mjWARN_BADCTRL.
Packaging
- Changed MacOS packaging so that the copy of
mujoco.frameworkembedded inMuJoCo.appcan be used to build applications externally.
2.2.0
Open Sourcing
-
MuJoCo is now fully open-source software. Newly available top level directories are:
src/: All source files. Subdirectories correspond to the modules described in the Programming chapter introduction:src/engine/: Core engine.src/xml/: XML parser.src/user/: Model compiler.src/visualize/: Abstract visualizer.src/ui/: UI framework.
test/: Tests and corresponding asset files.dist/: Files related to packaging and binary distribution.
-
Added contributor's guide and style guide.
General
-
Added analytic derivatives of smooth (unconstrained) dynamics forces, with respect to velocities:
- Centripetal and Coriolis forces computed by the Recursive Newton-Euler algorithm.
- Damping and fluid-drag passive forces.
- Actuation forces.
-
Added
implicitintegrator. Using the analytic derivatives above, a new implicit-in-velocity integrator was added. This integrator lies between the Euler and Runge Kutta integrators in terms of both stability and computational cost. It is most useful for models which use fluid drag (e.g. for flying or swimming) and for models which use velocity actuators. For more details, see the Numerical Integration section. -
Added
actlimitedandactrangeattributes to general actuators, for clamping actuator internal states (activations). This clamping is useful for integrated-velocity actuators, see the Activation clamping section for details. -
mjDatafieldsqfrc_unc(unconstrained forces) andqacc_unc(unconstrained accelerations) were renamedqfrc_smoothandqacc_smooth, respectively. While "unconstrained" is precise, "smooth" is more intelligible than "unc". -
Public headers have been moved from
/includeto/include/mujoco/, in line with the directory layout common in other open source projects. Developers are encouraged to include MuJoCo public headers in their own codebase via#include <mujoco/filename.h>. -
The default shadow resolution specified by the shadowsize attribute was increased from 1024 to 4096.
-
Saved XMLs now use 2-space indents.
Bug fixes
-
Antialiasing was disabled for segmentation rendering. Before this change, if the offsamples attribute was greater than 0 (the default value is 4), pixels that overlapped with multiple geoms would receive averaged segmentation IDs, leading to incorrect or non-existent IDs. After this change
offsamplesis ignored during segmentation rendering. -
The value of the enable flag for the experimental multiCCD feature was made sequential with other enable flags. Sequentiality is assumed in the
simulateUI and elsewhere. -
Fix issue of duplicated meshes when saving models with OBJ meshes using
mj_saveLastXML.
Update 1 (27 May 2022): Replaced Linux tarball to fix RPATH on the sample binaries. No change in functionality.
2.1.5
General
- Added an experimental feature: multi-contact convex collision detection, activated by an enable flag. See full
description here.
Bug fixes
-
GLAD initialization logic on Linux now calls
dlopento load a GL platform dynamic library if a*GetProcAddressfunction is not already present in the process' global symbol table. In particular, processes that use GLFW to set up a rendering context that are not explicitly linked againstlibGLX.so(this applies to the Python interpreter, for example) will now work correctly rather than fail with agladLoadGLerror whenmjr_makeContextis called. Fixes google-deepmind/dm_control#283. -
In the Python bindings, named indexers for scalar fields (e.g. the
ctrlfield for actuators) now return a NumPy array of shape(1,)rather than(). This allows values to be assigned to these fields more straightforwardly. Fixes #238.

