HappyTuesday Week 1 – Scraping the Web continues
Notes from my first ever HappyTuesdays. I couldn’t get to sit at HappyBelly Cafe, it seems they open only at 10am. Instead I went to french loaf. I sat outside under the green, I really liked it, weather was awesome.
I continued my work on earlier scraping projects
- Fixed bugs and updated the data for reservoir project. Now its in a good shape to deploy for auto updating and publishing.
- I had not updated e-procurement data in a long time. I ran the scraper today and scheduled it on one of my servers
- Also started coding new scraping project to scrape coimbatore city municipal data. Half of it done, I am struggling with a weird form submission error. But it shouldn’t take more than couple of hours to get it running.
Well that took three hours. I spent about 30 mins in ordering, paying etc. May be next time I will end up getting more things done.