Changelog

Motor 3.6.0

  • Add support for MongoDB 8.0 and PyMongo 4.9.

  • The length parameter in MotorCursor.to_list() is now optional.

Note

This is the last planned minor version of Motor. We are sunsetting Motor in favor of native asyncio support in PyMongo 4.9+. We will continue to provide security releases and bug fixes for Motor, but it will not gain new features.

Motor 3.5.1

  • Fix runtime behavior of Motor generic class typing, e.g. client: AsyncIOMotorClient[Dict[str, Any]].

Motor 3.5.0

  • Drop support for Python 3.7.

  • Switch to using Hatchling as a build backend and remove setup.py.

  • Add Secure Software Development Life Cycle automation to release process. GitHub Releases for pymongocrypt now include a Software Bill of Materials, and signature files corresponding to the distribution files released on PyPI.

Motor 3.4.0

  • Type hint bug fixes and improvements. Added typings to classes in motor_tornado and motor_asyncio.

Motor 3.3.2

Motor 3.3.1

Motor 3.3.0

Motor 3.2.0

  • Add support for MongoDB 7.0 and PyMongo 4.4+.

  • Add support for Queryable Encryption helpers create_encrypted_collection() and encrypt_expression(). Backwards-breaking changes may be made before the final release.

  • pymongocrypt 1.6.0 or later is now required for Client Side Field Level Encryption (CSFLE) and Queryable Encryption (QE) support. MongoDB Server 7.0 introduced a backwards breaking change to the QE protocol. Users taking advantage of the QE must now upgrade to MongoDB 7.0+ and Motor 3.2+.

Motor 3.1.1

Motor 3.1.1 adds support for Python 3.11 and fixes a bug that caused an ImportError in Python 3.11.0.

Motor 3.1

Motor 3.1 adds support for PyMongo 4.2+ and the Queryable Encryption beta with MongoDB 6.0. Note that backwards-breaking changes may be made before the final release.

New features:

  • Support for MongoDB 6.0.

  • Added the following key management APIs to MotorClientEncryption: get_key() get_keys() delete_key() add_key_alt_name() get_key_by_alt_name() remove_key_alt_name() rewrap_many_data_key()

  • Change streams support for user-facing PIT pre- and post-images using the new full_document_before_change argument to watch() and watch().

  • Allow cursor to be used in async with-statement.

The new Queryable Encryption changes that are in beta are:

Issues Resolved

See the Motor 3.1 release notes in JIRA for the list of resolved issues in this release.

Motor 3.0

Motor 3.0 adds support for PyMongo 4.0+. It inherits a number of improvements and breaking API changes from PyMongo 4.0+. See Motor 3.0 Migration Guide for more information.

Breaking Changes

  • Requires PyMongo 4.0+.

  • Removed support for Python 3.5 and 3.6. Python 3.7+ is now required.

  • Removed the socketKeepAlive keyword argument to MotorClient.

  • Removed motor.motor_tornado.MotorClient.fsync(), motor.motor_tornado.MotorClient.unlock(), and motor.motor_tornado.MotorClient.is_locked.

  • Removed motor.motor_tornado.MotorClient.max_bson_size.

  • Removed motor.motor_tornado.MotorClient.max_message_size.

  • Removed motor.motor_tornado.MotorClient.max_write_batch_size.

  • Removed motor.motor_tornado.MotorClient.event_listeners.

  • Removed motor.motor_tornado.MotorClient.max_pool_size.

  • Removed motor.motor_tornado.MotorClient.max_idle_time_ms.

  • Removed motor.motor_tornado.MotorClient.local_threshold_ms.

  • Removed motor.motor_tornado.MotorClient.server_selection_timeout.

  • Removed motor.motor_tornado.MotorClient.retry_writes.

  • Removed motor.motor_tornado.MotorClient.retry_reads.

  • Removed support for database profiler helpers profiling_level(), set_profiling_level(), and profiling_info(). Instead, users should run the profile command with the command() helper directly.

  • Removed pymongo.OFF, pymongo.SLOW_ONLY, and pymongo.ALL.

  • Removed motor.motor_tornado.MotorCollection.map_reduce() and motor.motor_tornado.MotorCollection.inline_map_reduce().

  • Removed the useCursor option for aggregate().

  • Removed pymongo.son_manipulator, motor.motor_tornado.MotorDatabase.add_son_manipulator(), motor.motor_tornado.MotorDatabase.outgoing_copying_manipulators, motor.motor_tornado.MotorDatabase.outgoing_manipulators, motor.motor_tornado.MotorDatabase.incoming_copying_manipulators, and motor.motor_tornado.MotorDatabase.incoming_manipulators.

  • Removed the manipulate and modifiers parameters from find(), find_one(), find_raw_batches(), and MotorCursor().

  • directConnection URI option and keyword argument to MotorClient defaults to False instead of None, allowing for the automatic discovery of replica sets. This means that if you want a direct connection to a single server you must pass directConnection=True as a URI option or keyword argument.

  • The hint option is now required when using min or max queries with find().

  • When providing a “mongodb+srv://” URI to MotorClient constructor you can now use the srvServiceName URI option to specify your own SRV service name.

  • MotorCollection and motor.motor_tornado.MotorDatabase now raises an error upon evaluating as a Boolean, please use the syntax if collection is not None: or if database is not None: as opposed to the previous syntax which was simply if collection: or if database:. You must now explicitly compare with None.

  • MotorClient cannot execute any operations after being closed. The previous behavior would simply reconnect. However, now you must create a new instance.

  • Empty projections (eg {} or []) for find(), and find_one() are passed to the server as-is rather than the previous behavior which substituted in a projection of {"_id": 1}. This means that an empty projection will now return the entire document, not just the "_id" field.

  • MotorClient now raises a ConfigurationError when more than one URI is passed into the hosts argument.

  • MotorClient` now raises an InvalidURI exception when it encounters unescaped percent signs in username and password when parsing MongoDB URIs.

  • Comparing two MotorClient instances now uses a set of immutable properties rather than address which can change.

  • Removed the disable_md5 parameter for GridFSBucket and GridFS. See disable_md5 parameter is removed for details.

  • PyMongoCrypt 1.2.0 or later is now required for client side field level encryption support.

Notable improvements

Issues Resolved

See the Motor 3.0 release notes in JIRA for the list of resolved issues in this release.

Motor 2.5.1

Motor 2.5.1 fixes a bug where MotorCursor.to_list() could return more than length documents.

Issues Resolved

See the Motor 2.5.1 release notes in JIRA for the complete list of resolved issues in this release.

Motor 2.5

Motor 2.5 adds support for MongoDB 5.0. It depends on PyMongo 3.12 or later.

New features:

Deprecations:

  • Deprecated support for Python 3.5.

  • Deprecated profiling_info(), profiling_level(), and set_profiling_level().

Issues Resolved

See the Motor 2.5 release notes in JIRA for the complete list of resolved issues in this release.

Motor 2.4

Motor 2.4 adds support for client-side field-level encryption and Python 3.9.

New Features:

Issues Resolved

See the Motor 2.4 release notes in JIRA for the complete list of resolved issues in this release.

Motor 2.3.1

Motor 2.3.1 fixes two bugs related to change streams.

Bug-fixes:

Issues Resolved

See the Motor 2.3.1 release notes in JIRA for the complete list of resolved issues in this release.

Motor 2.3

Motor 2.3 adds support for contextvars.

New features:

  • Added supported for the contextvars module. Specifically, it is now possible to access context variables inside CommandListener callbacks.

Bug-fixes:

Issues Resolved

See the Motor 2.3 release notes in JIRA for the complete list of resolved issues in this release.

Motor 2.2

Motor 2.2 adds support for MongoDB 4.4 features. It depends on PyMongo 3.11 or later. Motor continues to support MongoDB 3.0 and later. Motor 2.2 also drops support for Python 2.7 and Python 3.4.

New features:

Bug-fixes:

Deprecations:

  • Deprecated AsyncIOMotorCursor method next_object() and property fetch_next. Applications should use async for to iterate over cursors instead.

  • Deprecated the fsync() method. Applications should run the fsync command directly with command() instead.

Issues Resolved

See the Motor 2.2 release notes in JIRA for the complete list of resolved issues in this release.

Motor 2.1

Motor 2.1 adds support for MongoDB 4.2 features. It depends on PyMongo 3.10 or later. Motor continues to support MongoDB 3.0 and later. Motor 2.1 also adds support for Python 3.8.

Motor now offers experimental support for Windows when it is using the asyncio event loop. This means it supports Windows exclusively with Python 3, either integrating with asyncio directly or with Tornado 5 or later: starting in version 5, Tornado uses the asyncio event loop on Python 3 by default.

Additional changes:

  • Support for MongoDB 4.2 sharded transactions. Sharded transactions have the same API as replica set transactions.

  • New method with_transaction() to support conveniently running a transaction in a session with automatic retries and at-most-once semantics.

  • Added the max_commit_time_ms parameter to start_transaction().

  • The retryWrites URI option now defaults to True. Supported write operations that fail with a retryable error will automatically be retried one time, with at-most-once semantics.

  • Support for retryable reads and the retryReads URI option which is enabled by default. See the MongoClient documentation for details. Now that supported operations are retried automatically and transparently, users should consider adjusting any custom retry logic to prevent an application from inadvertently retrying for too long.

  • Support zstandard for wire protocol compression.

  • Support for periodically polling DNS SRV records to update the mongos proxy list without having to change client configuration.

  • New method motor.motor_asyncio.AsyncIOMotorDatabase.aggregate() to support running database level aggregations.

  • Change stream enhancements for MongoDB 4.2:

  • New parameters bucket_name, chunk_size_bytes, write_concern, and read_preference for motor.motor_asyncio.AsyncIOMotorGridFSBucket.

Issues Resolved

See the Motor 2.1 release notes in JIRA for the complete list of resolved issues in this release.

Motor 2.0

Motor 2.0 drops support for MongoDB 2.6 and adds supports MongoDB 4.0 features, including multi-document transactions, and change stream notifications on entire databases or entire MongoDB servers. It adds support for Python 3.7. This version of Motor requires PyMongo 3.7 or later.

This is a major release that removes previously deprecated APIs.

To support multi-document transactions, Motor had to make breaking changes to the session API and release a major version bump. Since this is a major release it also deletes many helper methods and APIs that had been deprecated over the time since Motor 1.0, most notably the old CRUD methods insert, update, remove, and save, and the original callback-based API. Read the Motor 2.0 Migration Guide carefully to upgrade your existing Motor application.

Documentation is updated to warn about obsolete TLS versions, see Configuration. Motor is now tested on Travis in addition to MongoDB’s Evergreen system.

Added support for aiohttp 3.0 and later, and dropped older aiohttp versions. The aiohttp integration now requires Python 3.5+.

The MotorDatabase.add_user and MotorDatabase.remove_user methods are deleted. Manage user accounts with four database commands: createUser, usersInfo, updateUser, and dropUser. You can run any database command with the MotorDatabase.command() method.

The deprecated GridFS classes MotorGridFS and AsyncIOMotorGridFS are deleted in favor of MotorGridFSBucket and AsyncIOMotorGridFSBucket, which conform to driver specs for GridFS.

Additional changes:

Motor 1.3.1

Fix a Python 3.7 compatibility bug caused by importing “async”, which is a keyword in Python 3.7. Drop support for Python 3.4.3 and older.

Motor 1.3.0

Deprecate Motor’s old callback-based async API in preparation for removing it in Motor 2.0. Raise DeprecationWarning whenever a callback is passed.

See the Motor 2.0 Migration Guide.

Motor 1.2.5

Fix a Python 3.7 compatibility bug caused by importing “async”, which is a keyword in Python 3.7. Drop support for Python 3.4.3 and older.

Motor 1.2.4

Fix a Python 3.7 compatibility bug in the MotorChangeStream class returned by MotorCollection.watch(). It is now possible to use change streams in async for loops in Python 3.7.

Motor 1.2.3

Compatibility with latest Sphinx and document how to use the latest TLS protocols.

Motor 1.2.2

Motor 1.2.0 requires PyMongo 3.6 or later. The dependency was properly documented, but not enforced in setup.py. PyMongo 3.6 is now an install-time requirement; thanks to Shane Harvey for the fix.

Motor 1.2.1

An asyncio application that created a Change Stream with MotorCollection.watch() and shut down while the Change Stream was open would print several errors. I have rewritten MotorChangeStream.next() and some Motor internals to allow clean shutdown with asyncio.

Motor 1.2

Motor 1.2 drops support for MongoDB 2.4 and adds support for MongoDB 3.6 features. It depends on PyMongo 3.6 or later. Motor continues to support MongoDB 2.6 and later.

Dropped support for Python 2.6 and 3.3. Motor continues to support Python 2.7, and 3.4+.

Dropped support for Tornado 3. A recent version of Tornado 4 is required.

Dropped support for the Python 3.5.0 and Python 3.5.1 “async for” protocol. Motor allows “async for” with cursors in Python 3.5.2 and later.

See the Compatibility Matrix for the relationships among Motor, Python, Tornado, and MongoDB versions.

Added support for aiohttp 2.0 and later, and dropped older aiohttp versions.

Highlights include:

The maximum number of workers in the thread pool can be overridden with an environment variable, see Configuration.

MotorCollection accepts codec_options, read_preference, write_concern, and read_concern arguments. This is rarely needed; you typically create a MotorCollection from a MotorDatabase, not by calling its constructor directly.

Deleted obsolete class motor.Op.

Motor 1.1

Motor depends on PyMongo 3.4 or later. It wraps the latest PyMongo code which support the new server features introduced in MongoDB 3.4. (It is a coincidence that the latest MongoDB and PyMongo versions are the same number.)

Highlights include:

Warning

Starting in PyMongo 3.4, bson.code.Code.scope may return None, as the default scope is None instead of {}.

Note

PyMongo 3.4+ attempts to create sockets non-inheritable when possible (i.e. it sets the close-on-exec flag on socket file descriptors). Support is limited to a subset of POSIX operating systems (not including Windows) and the flag usually cannot be set in a single atomic operation. CPython 3.4+ implements PEP 446, creating all file descriptors non-inheritable by default. Users that require this behavior are encouraged to upgrade to CPython 3.4+.

Motor 1.0

Motor now depends on PyMongo 3.3 and later. The move from PyMongo 2 to 3 brings a large number of API changes, read the the PyMongo 3 changelog carefully.

MotorReplicaSetClient is removed

In Motor 1.0, MotorClient is the only class. Connect to a replica set with a “replicaSet” URI option or parameter:

MotorClient("mongodb://hostname/?replicaSet=my-rs")
MotorClient(host, port, replicaSet="my-rs")

New features

New classes MotorGridFSBucket and AsyncIOMotorGridFSBucket conform to the GridFS API Spec for MongoDB drivers. These classes supersede the old MotorGridFS and AsyncIOMotorGridFS. See GridFS changes below, especially note the breaking change in GridFSHandler.

Serve GridFS files over HTTP using aiohttp and AIOHTTPGridFS.

MotorClient changes

Removed:

  • MotorClient.open(); clients have opened themselves automatically on demand since version 0.2.

  • MotorClient.seeds, use pymongo.uri_parser.parse_uri() on your MongoDB URI.

  • MotorClient.alive

Added:

  • MotorClient.event_listeners

  • MotorClient.max_idle_time_ms

  • MotorClient.min_pool_size

Unix domain socket paths must be quoted with urllib.parse.quote_plus() (or urllib.quote_plus in Python 2) before they are included in a URI:

path = "/tmp/mongodb-27017.sock"
MotorClient("mongodb://%s" % urllib.parse.quote_plus(path))

MotorCollection changes

Added:

New bypass_document_validation parameter for initialize_ordered_bulk_op() and initialize_unordered_bulk_op().

Changes to find() and find_one()

The following find/find_one options have been renamed:

These renames only affect your code if you passed these as keyword arguments, like find(fields=['fieldname']). If you passed only positional parameters these changes are not significant for your application.

  • spec -> filter

  • fields -> projection

  • partial -> allow_partial_results

The following find/find_one options have been added:

  • cursor_type (see CursorType for values)

  • oplog_replay

  • modifiers

The following find/find_one options have been removed:

  • network_timeout (use max_time_ms() instead)

  • read_preference (use with_options() instead)

  • tag_sets (use one of the read preference classes from read_preferences and with_options() instead)

  • secondary_acceptable_latency_ms (use the localThresholdMS URI option instead)

  • max_scan (use the new modifiers option instead)

  • snapshot (use the new modifiers option instead)

  • tailable (use the new cursor_type option instead)

  • await_data (use the new cursor_type option instead)

  • exhaust (use the new cursor_type option instead)

  • as_class (use with_options() with CodecOptions instead)

  • compile_re (BSON regular expressions are always decoded to Regex)

The following find/find_one options are deprecated:

  • manipulate

The following renames need special handling.

  • timeout -> no_cursor_timeout - By default, MongoDB closes a cursor after 10 minutes of inactivity. In previous Motor versions, you disabled the timeout by passing timeout=False to MotorCollection.find() or MotorGridFS.find(). The timeout parameter has been renamed to no_cursor_timeout, it defaults to False, and you must now pass no_cursor_timeout=True to disable timeouts.

MotorCursor

Added:

Removed:

GridFS

The old GridFS classes MotorGridFS and AsyncIOMotorGridFS are deprecated in favor of MotorGridFSBucket and AsyncIOMotorGridFSBucket, which comply with MongoDB’s cross-language driver spec for GridFS.

The old classes are still supported, but will be removed in Motor 2.0.

BREAKING CHANGE: The overridable method get_gridfs_file of GridFSHandler now takes a MotorGridFSBucket, not a MotorGridFS. It also takes an additional request parameter.

MotorGridOutCursor

Added:

Removed:

  • MotorGridOutCursor.conn_id, use address

MotorGridIn

New method MotorGridIn.abort().

In a Python 3.5 native coroutine, the “async with” statement calls close() automatically:

async def upload():
    my_db = MotorClient().test
    fs = MotorGridFSBucket(my_db)
    async with await fs.open_upload_stream(
                "test_file", metadata={"contentType": "text/plain"}) as gridin:
        await gridin.write(b'First part\n')
        await gridin.write(b'Second part')

    # gridin is now closed automatically.

MotorGridOut

MotorGridOut is now an async iterable, so reading a chunk at a time is much simpler with a Python 3 native coroutine:

async def read_file(file_id):
    fs = motor.motor_tornado.MotorGridFS(db)
    gridout = await fs.get(file_id)

    async for chunk in gridout:
        sys.stdout.write(chunk)

    sys.stdout.flush()

Documentation

The Motor asyncio API is now fully documented, side by side with the Motor Tornado API.

New Developer Guide added.

Motor 0.7

For asynchronous I/O Motor now uses a thread pool, which is faster and simpler than the prior implementation with greenlets. It no longer requires the greenlet package, and now requires the futures backport package on Python 2.

This version updates the PyMongo dependency from 2.8.0 to 2.9.x, and wraps PyMongo 2.9’s new APIs.

Most of Motor 1.0’s API is now implemented, and APIs that will be removed in Motor 1.0 are now deprecated and raise warnings.

MotorClient changes

The get_database method is added for getting a MotorDatabase instance with its options configured differently than the MotorClient’s.

New read-only attributes:

MotorReplicaSetClient changes

The get_database() method is added for getting a MotorDatabase instance with its options configured differently than the MotorReplicaSetClient’s.

New read-only attributes:

  • codec_options

  • local_threshold_ms

MotorDatabase changes

The get_collection() method is added for getting a MotorCollection instance with its options configured differently than the MotorDatabase’s.

The connection property is deprecated in favor of a new read-only attribute client.

New read-only attribute:

MotorCollection changes

The with_options() method is added for getting a MotorCollection instance with its options configured differently than this MotorCollection’s.

New read-only attribute:

The following methods wrap PyMongo’s implementation of the standard CRUD API Spec for MongoDB Drivers:

These new methods do not apply SON Manipulators.

GridFS changes

New MotorGridOutCursor methods:

  • add_option()

  • remove_option()

  • clone()

Added MotorGridOut documentation:

Bugfix

MOTOR-124: an import deadlock in Python 2 and Tornado 3 led to an AutoReconnect exception with some replica sets.

Motor 0.6.2

Fix “from motor import *” for Python 3.

Motor 0.6.1

Fix source distribution, which hadn’t included the “frameworks” submodules.

Motor 0.6

This is a bugfix release. Fixing these bugs has introduced tiny API changes that may affect some programs.

motor_asyncio and motor_tornado submodules

These modules have been moved from:

  • motor_asyncio.py

  • motor_tornado.py

To:

  • motor_asyncio/__init__.py

  • motor_tornado/__init__.py

Motor had to make this change in order to omit the motor_asyncio submodule entirely and avoid a spurious SyntaxError being printed when installing in Python 2. The change should be invisible to application code.

Database and collection names with leading underscores

A database or collection whose name starts with an underscore can no longer be accessed as a property:

# Now raises AttributeError.
db = MotorClient()._mydatabase
collection = db._mycollection
subcollection = collection._subcollection

Such databases and collections can still be accessed dict-style:

# Continues to work the same as previous Motor versions.
db = MotorClient()['_mydatabase']
collection = db['_mycollection']

To ensure a “sub-collection” with a name that includes an underscore is accessible, Motor collections now allow dict-style access, the same as Motor clients and databases always have:

# New in Motor 0.6
subcollection = collection['_subcollection']

These changes solve problems with iPython code completion and the Python 3 ABC abstract base class.

Motor 0.5

asyncio

Motor can now integrate with asyncio, as an alternative to Tornado. My gratitude to Rémi Jolin, Andrew Svetlov, and Nikolay Novik for their huge contributions to Motor’s asyncio integration.

Python 3.5

Motor is now compatible with Python 3.5, which required some effort. Motor not only supports users’ coroutines, it uses coroutines to implement some of its own features, like open() and put(). There is no single way to return a value from a Python 3.5 native coroutine or a Python 2 generator-based coroutine, so Motor internal coroutines that return values were rewritten. (See commit message dc19418c for an explanation.)

async and await

Motor now supports Python 3.5 native coroutines, written with the async and await syntax:

async def f():
    await collection.insert({'_id': 1})

Cursors from find(), aggregate(), or find() can be iterated elegantly and very efficiently in native coroutines with async for:

async def f():
    async for doc in collection.find():
        do_something_with(doc)

aggregate()

MotorCollection.aggregate() now returns a cursor by default, and the cursor is returned immediately without a yield. The old syntax is no longer supported:

# Motor 0.4 and older, no longer supported.
cursor = yield collection.aggregate(pipeline, cursor={})
while (yield cursor.fetch_next):
    doc = cursor.next_object()
    print(doc)

In Motor 0.5, simply do:

# Motor 0.5: no "cursor={}", no "yield".
cursor = collection.aggregate(pipeline)
while (yield cursor.fetch_next):
    doc = cursor.next_object()
    print(doc)

Or with Python 3.5 and later:

# Motor 0.5, Python 3.5.
async for doc in collection.aggregate(pipeline):
    print(doc)

MongoDB versions 2.4 and older do not support aggregation cursors. For compatibility with older MongoDBs, aggregate() now takes an argument cursor=False, and returns a Future that you can yield to get all the results in one document:

# Motor 0.5 with MongoDB 2.4 and older.
reply = yield collection.aggregate(cursor=False)
for doc in reply['results']:
    print(doc)

Deprecations

Motor 0.5 deprecates a large number of APIs that will be removed in version 1.0:

MotorClient:

  • ~MotorClient.host

  • ~MotorClient.port

  • ~MotorClient.document_class

  • ~MotorClient.tz_aware

  • ~MotorClient.secondary_acceptable_latency_ms

  • ~MotorClient.tag_sets

  • ~MotorClient.uuid_subtype

  • ~MotorClient.disconnect

  • ~MotorClient.alive

MotorReplicaSetClient:

  • ~MotorReplicaSetClient.document_class

  • ~MotorReplicaSetClient.tz_aware

  • ~MotorReplicaSetClient.secondary_acceptable_latency_ms

  • ~MotorReplicaSetClient.tag_sets

  • ~MotorReplicaSetClient.uuid_subtype

  • ~MotorReplicaSetClient.alive

MotorDatabase:

  • ~MotorDatabase.secondary_acceptable_latency_ms

  • ~MotorDatabase.tag_sets

  • ~MotorDatabase.uuid_subtype

MotorCollection:

  • ~MotorCollection.secondary_acceptable_latency_ms

  • ~MotorCollection.tag_sets

  • ~MotorCollection.uuid_subtype

Cursor slicing

Cursors can no longer be indexed like cursor[n] or sliced like cursor[start:end], see MOTOR-84. If you wrote code like this:

cursor = collection.find()[i]
yield cursor.fetch_next
doc = cursor.next_object()

Then instead, write:

cursor = collection.find().skip(i).limit(-1)
yield cursor.fetch_next
doc = cursor.next_object()

The negative limit ensures the server closes the cursor after one result, saving Motor the work of closing it. See cursor.limit.

SSL hostname validation error

When you use Motor with Tornado and SSL hostname validation fails, Motor used to raise a ConnectionFailure with a useful message like “hostname ‘X’ doesn’t match ‘Y’”. The message is now empty and Tornado logs a warning instead.

Configuring uuid_subtype

You can now get and set uuid_subtype on MotorClient, MotorReplicaSetClient, and MotorDatabase instances, not just on MotorCollection.

Motor 0.4.1

Fix MOTOR-66, deadlock when initiating MotorReplicaSetClient connection from multiple operations at once.

Motor 0.4

Supports MongoDB 3.0. In particular, supports MongoDB 3.0’s new SCRAM-SHA-1 authentication mechanism and updates the implementations of MotorClient.database_names() and MotorDatabase.collection_names().

Updates PyMongo dependency from 2.7.1 to 2.8, therefore inheriting PyMongo 2.7.2’s bug fixes and PyMongo 2.8’s bug fixes and features.

Fixes a connection-pool timeout when waitQueueMultipleMS is set and two bugs in replica set monitoring.

The copy_database method has been removed. It was overly complex and no one used it, see MOTOR-56. You can still use the MotorDatabase.command() method directly. The only scenario not supported is copying a database from one host to another, if the remote host requires authentication. For this, use PyMongo’s copy_database method, or, since PyMongo’s copy_database will be removed in a future release too, use the mongo shell.

Motor 0.3.3

Fix MOTOR-45, a stack-context leak in domain name resolution that could lead to an infinite loop and rapid memory leak.

Document Motor’s Requirements in detail.

Motor 0.3.2

Fix MOTOR-44, a socket leak in MotorClient.copy_database and MotorReplicaSetClient.copy_database.

Motor 0.3.1

Fix MOTOR-43, a TypeError when using GridFSHandler with a timezone-aware MotorClient.

Fix GridFS examples that hadn’t been updated for Motor 0.2’s new syntax.

Fix a unittest that hadn’t been running.

Motor 0.3

No new features.

  • Updates PyMongo dependency from 2.7 to 2.7.1, therefore inheriting PyMongo 2.7.1’s bug fixes.

  • Motor continues to support Python 2.6, 2.7, 3.3, and 3.4, but now with single-source. 2to3 no longer runs during installation with Python 3.

  • nosetests is no longer required for regular Motor tests.

  • Fixes a mistake in the docstring for aggregate().

Motor 0.2.1

Fixes two bugs:

  • MOTOR-32: The documentation for MotorCursor.close() claimed it immediately halted execution of MotorCursor.each(), but it didn’t.

  • MOTOR-33: An incompletely iterated cursor’s __del__ method sometimes got stuck and cost 100% CPU forever, even though the application was still responsive.

Motor 0.2

This version includes API changes that break backward compatibility with applications written for Motor 0.1. For most applications, the migration chores will be minor. In exchange, Motor 0.2 offers a cleaner style, and it wraps the new and improved PyMongo 2.7 instead of 2.5.

Changes in Dependencies

Motor now requires PyMongo 2.7.0 exactly and Tornado 3 or later. It drops support for Python 2.5 since Tornado 3 has dropped it.

Motor continues to work with Python 2.6 through 3.4. It still requires Greenlet.

API Changes

open_sync

The open_sync method has been removed from MotorClient and MotorReplicaSetClient. Clients now connect to MongoDB automatically on first use. Simply delete the call to open_sync from your application.

If it’s important to test that MongoDB is available before continuing your application’s startup, use IOLoop.run_sync:

loop = tornado.ioloop.IOLoop.current()
client = motor.motor_tornado.MotorClient(host, port)
try:
    loop.run_sync(client.open)
except pymongo.errors.ConnectionFailure:
    print "Can't connect"

Similarly, calling MotorGridOut.open() is now optional. MotorGridIn and MotorGridFS no longer have an open method at all.

Futures

Motor 0.2 takes advantage of Tornado’s tidy new coroutine syntax:

# Old style:
document = yield motor.Op(collection.find_one, {'_id': my_id})

# New style:
document = yield collection.find_one({'_id': my_id})

To make this possible, Motor asynchronous methods (except MotorCursor.each()) now return a Future.

Using Motor with callbacks is still possible: If a callback is passed, it will be executed with the (result, error) of the operation, same as in Motor 0.1:

def callback(document, error):
    if error:
        logging.error("Oh no!")
    else:
        print document

collection.find_one({'_id': my_id}, callback=callback)

If no callback is passed, a Future is returned that resolves to the method’s result or error:

document = yield collection.find_one({'_id': my_id})

motor.Op works the same as before, but it’s deprecated.

WaitOp and WaitAllOps have been removed. Code that used them can now yield a Future or a list of them. Consider this function written for Tornado 2 and Motor 0.1:

@gen.engine
def get_some_documents():
    cursor = collection.find().sort('_id').limit(2)
    cursor.to_list(callback=(yield gen.Callback('key')))
    do_something_while_we_wait()
    try:
        documents = yield motor.WaitOp('key')
        print documents
    except Exception, e:
        print e

The function now becomes:

@gen.coroutine
def f():
    cursor = collection.find().sort('_id').limit(2)
    future = cursor.to_list(2)
    do_something_while_we_wait()
    try:
        documents = yield future
        print documents
    except Exception, e:
        print e

Similarly, a function written like so in the old style:

@gen.engine
def get_two_documents_in_parallel(collection):
    collection.find_one(
        {'_id': 1}, callback=(yield gen.Callback('one')))

    collection.find_one(
        {'_id': 2}, callback=(yield gen.Callback('two')))

    try:
        doc_one, doc_two = yield motor.WaitAllOps(['one', 'two'])
        print doc_one, doc_two
    except Exception, e:
        print e

Now becomes:

@gen.coroutine
def get_two_documents_in_parallel(collection):
    future_0 = collection.find_one({'_id': 1})
    future_1 = collection.find_one({'_id': 2})

    try:
        doc_one, doc_two = yield [future_0, future_1]
        print doc_one, doc_two
    except Exception, e:
        print e

to_list

Any calls to MotorCursor.to_list() that omitted the length argument must now include it:

result = yield collection.find().to_list(100)

None is acceptable, meaning “unlimited.” Use with caution.

Connection Pooling

MotorPool has been rewritten. It supports the new options introduced in PyMongo 2.6, and drops all Motor-specific options.

MotorClient and MotorReplicaSetClient have an option max_pool_size. It used to mean “minimum idle sockets to keep open”, but its meaning has changed to “maximum sockets open per host.” Once this limit is reached, operations will pause waiting for a socket to become available. Therefore the default has been raised from 10 to 100. If you pass a value for max_pool_size make sure it’s large enough for the expected load. (Sockets are only opened when needed, so there’s no cost to having a max_pool_size larger than necessary. Err towards a larger value.) If you’ve been accepting the default, continue to do so.

max_pool_size is now synonymous with Motor’s special max_concurrent option, so max_concurrent has been removed.

max_wait_time has been renamed waitQueueTimeoutMS for consistency with PyMongo. If you pass max_wait_time, rename it and multiply by 1000.

The MotorPoolTimeout exception is gone; catch PyMongo’s ConnectionFailure instead.

DNS

Motor can take advantage of Tornado 3’s asynchronous resolver interface. By default, Motor still uses blocking DNS, but you can enable non-blocking lookup with a threaded resolver:

Resolver.configure('tornado.netutil.ThreadedResolver')

Or install pycares and use the c-ares resolver:

Resolver.configure('tornado.platform.caresresolver.CaresResolver')

MotorCursor.tail

The MotorCursor.tail method has been removed. It was complex, diverged from PyMongo’s feature set, and encouraged overuse of MongoDB capped collections as message queues when a purpose-built message queue is more appropriate. An example of tailing a capped collection is provided instead: Motor Tailable Cursor Example.

MotorClient.is_locked

is_locked has been removed since calling it from Motor would be bizarre. If you called MotorClient.is_locked like:

locked = yield motor.Op(client.is_locked)

you should now do:

result = yield client.admin.current_op()
locked = bool(result.get('fsyncLock', None))

The result is True only if an administrator has called fsyncLock on the mongod. It is unlikely that you have any use for this.

GridFSHandler

get_gridfs_file() now returns a Future instead of accepting a callback.

New Features

The introduction of a Futures-based API is the most pervasive new feature. In addition Motor 0.2 includes new features from PyMongo 2.6 and 2.7:

Bugfixes

MotorReplicaSetClient.open threw an error if called without a callback.

MotorCursor.to_list ignored SON manipulators. (Thanks to Eren Güven for the report and the fix.)

The full list is in Jira.

Motor 0.1.2

Fixes innocuous unittest failures when running against Tornado 3.1.1.

Motor 0.1.1

Fixes issue MOTOR-12 by pinning its PyMongo dependency to PyMongo version 2.5.0 exactly.

Motor relies on some of PyMongo’s internal details, so changes to PyMongo can break Motor, and a change in PyMongo 2.5.1 did. Eventually PyMongo will expose stable hooks for Motor to use, but for now I changed Motor’s dependency from PyMongo>=2.4.2 to PyMongo==2.5.0.