Interactive Map Scraper

This project automates the extraction of map-based location data from a dynamic, JavaScript-heavy web application using Playwright with async Python. Unlike static scrapers, it simulates real user interactions to reliably capture structured data.

How it works:

1. Launch Chromium via Playwright and navigate to a map-based explore page.

2. Handle UI modals gracefully (e.g. dismiss login or popups if they appear).

3. Wait for map tiles and markers to fully render.

4. Iteratively pan the map horizontally and vertically to cover all regions.

5. For each marker:

   • Extract latitude, longitude, and label from the popup.

   • Store in a result set while avoiding duplicates.

6. Save results to CSV, ensuring clean and reusable datasets.

The scraper is designed with robust error handling: retries when markers are missing, screenshots for debugging, and deduplication to prevent redundant entries.

This project demonstrates how headless browser automation can extract structured data from modern, highly dynamic web applications.