The Movie Database Support Forum
Support → API-Support
Need to scrape info faster than 40 requests using proxies
Verfasst von GetMovieInfoSTAFFMOD am 21. Oktober 2019 um 04:52
I know about the request limits, but I'm working on a big project and they require multi threading with requests more than 40 per 10 second range. Would like to know if using multiple non abusive IPs are allowed or is there anything else that I can implement to code well for my project. I know there is no paid API so looking for "legal" or "allowed" solutions.
Antwort von talestalker
am 22. Oktober 2019 um 03:40
It is on @travisbell to tell you whether using multiple IPs for your project is OK. However, if your project is that big, maybe you should use your own cache server instead. Downloading all necessary TMDB data using current request limit is a matter of few days and then you could just keep it updated using Changes API method. We have 3-4 k changed records a day, so the current API limit should be more than enough.
Antwort von Travis Bell
am 22. Oktober 2019 um 10:44
There's nothing I can do to stop you from making requests from multiple IPs, but I definitely encourage you to create your own local database. That way you can build a custom schema to match your app's requirements.
Antwort von GetMovieInfo
am 23. Oktober 2019 um 04:20
Thanks for the replies, I can't invest in local cache server atm, let's see what comes up. Thanks again