The Movie Database Support
Support → API Support
Need to scrape info faster than 40 requests using proxies
posted by GetMovieInfoSTAFFMOD on October 21, 2019 at 4:52 AM
I know about the request limits, but I'm working on a big project and they require multi threading with requests more than 40 per 10 second range. Would like to know if using multiple non abusive IPs are allowed or is there anything else that I can implement to code well for my project. I know there is no paid API so looking for "legal" or "allowed" solutions.
Reply by talestalker
on October 22, 2019 at 3:40 AM
It is on @travisbell to tell you whether using multiple IPs for your project is OK. However, if your project is that big, maybe you should use your own cache server instead. Downloading all necessary TMDB data using current request limit is a matter of few days and then you could just keep it updated using Changes API method. We have 3-4 k changed records a day, so the current API limit should be more than enough.
Reply by Travis Bell
on October 22, 2019 at 10:44 AM
There's nothing I can do to stop you from making requests from multiple IPs, but I definitely encourage you to create your own local database. That way you can build a custom schema to match your app's requirements.
Reply by GetMovieInfo
on October 23, 2019 at 4:20 AM
Thanks for the replies, I can't invest in local cache server atm, let's see what comes up. Thanks again