The Movie Database Support
Support → API Support
Is there any way to get more than 500 pages of content for tv shows/movies?
posted by nicklandi4STAFFMOD on August 28, 2023 at 10:54 AM
Hi all, I'm currently building out an application that iterates over and sequentially pulls 1000 movies and tv shows per day from the following end points (api_key is my own personal key and movie_page_number/show_page_number are read in/updated after each run:)
- https://api.themoviedb.org/3/discover/movie?api_key={api_key}&page={movie_page_number}
- https://api.themoviedb.org/3/discover/tv?api_key={api_key}&page={show_page_number}
However, it seems the number of pages for both movies and tv shows is capped at 500. Is this true, and if so, are there any other movie/show databases that don't face this issue. If it isn't the case and we can extract more data, how can we do so? The goal of this project is to continually pull in new titles with the associated genre and ratings for recommendation model purposes.
Reply by Travis Bell
on August 28, 2023 at 11:43 AM
If you're trying to bring that much data in house your best option is to restrict your searches. I would think dates are you best friend here, so something like:
As an example/
Reply by nicklandi4
on August 28, 2023 at 1:29 PM
Thanks for the quick response - do you happen to know what's the complete lookback window movies/tv shows? Also will rate limits apply when extracting data for eg a year period at once?
Reply by Travis Bell
on August 28, 2023 at 1:32 PM
Each response will contain the total results. If you are curious about the DB as a whole, you can look at the daily ID exports.