Scraping other sites for metadata

From Internet Archive Unoffical Wiki
Jump to: navigation, search

This is a quick placeholder page for an upcoming series of tutorials on scraping sites using javascript & python to speed up the process of adding metadata to large numbers of items. For example, let's say you have a collection of 30,000 C64 demos, and you want to link them with individual pages on CSDB and pull across the metadata into the archive. How would you achieve something like that without going insane? I'm gonna tell you soon, unless I die of Coronavirus!