I am creating an R wrapper for the API. The use case for this is for doing data analysis on the SO data.

As I am building it, it seems like I would need to iterate over many pages in order to get all the data that I would want for an analysis. For instance, let's say I wanted to pull all SO users. Then I can call the users method and step through every page.

Is that an appropriate way to do this, or should I be using the data dump instead? I read through "Conscientious use of the API", but in this case I would be making large one-off requests (not polling).

I am creating an R wrapper for the API. The use case for this is for doing data analysis on the SO data.

As I am building it, it seems like I would need to iterate over many pages in order to get all the data that I would want for an analysis. For instance, let's say I wanted to pull all SO users. Then I can call the users method and step through every page.

Is that an appropriate way to do this, or should I be using the data dump instead? I read through "Conscientious use of the API", but in this case I would be making large one-off requests (not polling).

I am creating an R wrapper for the API. The use case for this is for doing data analysis on the SO data.

As I am building it, it seems like I would need to iterate over many pages in order to get all the data that I would want for an analysis. For instance, let's say I wanted to pull all SO users. Then I can call the users method and step through every page.

Is that an appropriate way to do this, or should I be using the data dump instead?

I am creating an R wrapper for the API. The use case for this is for doing data analysis on the SO data.

As I am building it, it seems like I would need to iterate over many pages in order to get all the data that I would want for an analysis. For instance, let's say I wanted to pull all SO users. Then I can call the users method and step through every page.

Is that an appropriate way to do this, or should I be using the data dump instead? I read through "Conscientious use of the API", but in this case I would be making large one-off requests (not polling).