GeekTechStuff

So far I have used Python with the requests library and beautifulsoup library. This had allowed me to GET and POST requests to web servers, and to parse results back in a more friendly way. Now I’m going to introduce Selenium. Selenium allows Python to interact with webpages by opening…

So far I have been scraping my website for a list of the divs, links and pictures that it contains, however I also want to interact with my site. Back in part 1 I briefly wrote about the GET command that is used when asking for data from a web…

Continuing on from Web Scraping Part 1. In this part I’m going to look at collecting the hyperlinks on a page. I have uploaded my work in Python to my GitHub, so that code examples are easier to follow: https://github.com/geektechdude/Python_Web_Scrapper def find_links(URL_INPUT):     # returns all the hyperlink destinations…

Web scraping can be a very useful way to extract data from websites but for anyone that has only viewed the web with a browser they can seem like magic. For example, here is http://www.geektechstuff.com viewed via a web browser: And here is http://www.geektechstuff.com when the HTML is read by…

Today I received a phone call and SMS text message that a flood alert had become active for the area I live in. After making preparations incase the alert severity increased I got to thinking; is there a better way to be warned about potential floods? One (quick) Google search…

I take it for granted that when I look at a picture I can identify what the items in the picture are. However, as a baby I could not and as a young child I would probably struggle with non-every day objects in a picture. Computers are at a point…

Yesterday I outputted sensor readings into a CSV file, today I’m going to look at what I can do with that CSV file in Python. Pandas I originally looked at Pandas back in December 2018 when I used it to open an Excel spreadsheet. A CSV is open in a similar…