RESCRAPE IF LIMIT WAS NOT HIT #64
Description
Why doesnt the scrapper scrap 25 profiles, and if they are hidden scrap until it finds the visible profiles and then output the log that says:
25 total, 22 hidden, 3 visible
these are the logs:
2025-01-15 08:52:50,762 [INFO] Scraping for Rolls Royce (675c2978e34de3a8c7dbf81f): search term: ceo, location: us, max_results: 25
2025-01-15 08:52:51,124 - StaffSpy - INFO - Failed to directly use company 'Rolls Royce' as company id, now searching for the company
2025-01-15 08:52:51,782 - StaffSpy - INFO - Searched company Rolls Royce on LinkedIn and were 307 results, using first result with company name - 'Rolls-Royce' and company id - 'rolls-royce'
2025-01-15 08:52:52,779 - StaffSpy - INFO - Found company 'rolls-royce' with 28670 staff
2025-01-15 08:52:55,277 - StaffSpy - INFO - 1) Search results for company: 'Rolls Royce', location: 'us' - 71 staff
2025-01-15 08:52:55,277 - StaffSpy - INFO - 2) Total results collected for company: 'Rolls Royce', location: ', location: 'us'' - 3 results
2025-01-15 08:52:55,277 - StaffSpy - INFO - Fetching data for account ACoAADhyfwgBN0qG7RzaWAZJ-pkTialSLoADf5Q 1 / 25 - https://www.linkedin.com/in/mohamed-mohamed-5481a8225
2025-01-15 08:52:57,670 - StaffSpy - INFO - Fetching data for account ACoAADbc50IBMaUze2gzoxKsVjpSFHqWgy0JLhw 2 / 25 - https://www.linkedin.com/in/thomas-todd-b6a309218
2025-01-15 08:52:58,849 - StaffSpy - INFO - Fetching data for account ACoAAEVcywYBOZz7M3hviPrvnjwQp8WWOASfdb4 3 / 25 - https://www.linkedin.com/in/jamill-crenshaw-99a882285
2025-01-15 08:53:00,373 - StaffSpy - INFO - 3) Staff from Rolls Royce: 3 total, 0 hidden, 3 visible