Content
Virgin API Consumer JSON Fears HTML Limited to the what the API can do Has to identify himself even for read-only APIs API Provider takes away his endpoint 429 Too Many Requests data is 10 minutes behind Has to worry about quota Thinks that he is making his life easier begs his users for auth API keys has to verify his email, phone, driver’s license, ssn, dna sample has to agree to Terms of Service and follow the the rules Tokens Chad third-party scraper follows no rules, doesn’t agree to any terms of service 1 Luminati Business prozy networ scrapes so fast the backend crashes POP3 Se has no limitations can access any data he wants entire industries are dedicated to stopping him website thinks his user agent is a phone Doesn’t care about changes in policies Even Javascript can’t stop him pays laborers to solve captchas doesn’t even have a phone number Reguests- TAI can work anonymously parses HTML with regex MULLVAD SMSPVA 2Captcha his business is profitable Can do whatever he wants millions of engineer hours, still can’t stop him from scraping promising career at high-frequency trading firm (just scrapes in his spare time