Maintain and improve the SwingPlanit scraper and ingestion workflow in R. Use when editing scrape_swing_planit.R, updating selectors, changing daily snapshot schema, or debugging scraping failures and missing festival rows.
Use this workflow when changing the scraper in scrape_swing_planit.R.
daily_parse_data/.Daily CSV snapshots must include:
monthstarting_dateviewsnamecountrycitiestagswebsitesswingplanit_linkobservation_dateWhen introducing new columns, append them without removing existing ones unless user asks for a breaking change.
If page structure changes:
NA or empty string instead of crashingAfter any scraper change, validate:
swingplanit_link within a runviews is numeric and mostly non-missingobservation_date is today for all rowscities or name: normalize strings consistently..viewsplease changed"