Instead of pagination, it is possible to get a streaming response
by adding stream=true
to the URL query parameters.
This is more efficient than pagination because the server does not
generate the whole response before sending it to the client, so
memory consumption remains low even when the response is very large.
To take full advantage of the streaming response on the client side, it is recommended to use an iterative JSON parser such as ijson.
Notes: