I wanted to save one of my co-workers a bunch of monkey work, so I wrote this screen scraper to get the html he needed.
Please use this sample at your own risk. It worked on my box and that is all I know. I stole, err, borrowed heavily from others. The three main victims are:
To run the sample you will need 2 tables created in a SQL database. I used SQL 2008 and my database name is SandBox.
The scripts to create the tables are in the SQL folder along with one to insert data into the SourceURLs table.
The SSIS package and SQL can be downloaded from my SkyDrive.