A site where a tech geek writes about stuff
Continuing on from Web Scrapping Part 1. In this part I'm going to look at collecting the hyperlinks on a page. I have uploaded my work in Python to my GitHub, so that code examples are easier to follow: https://github.com/geektechdude/Python_Web_Scrapper def find_links(URL_INPUT): # returns all the hyperlink destinations on a page … Continue reading Web Scrapping Part 2 (Python)
Web scrapping can be a very useful way to extract data from websites but for anyone that has only viewed the web with a browser they can seem like magic. For example, here is http://www.geektechstuff.com viewed via a web browser: And here is http://www.geektechstuff.com when the HTML is read by Python: The majority of people … Continue reading Web Scrapping Part 1 (Python)
Today I received a phone call and SMS text message that a flood alert had become active for the area I live in. After making preparations incase the alert severity increased I got to thinking; is there a better way to be warned about potential floods? One (quick) Google search later and I found that … Continue reading UK Flood Alert / Flood Data (Python)
I take it for granted that when I look at a picture I can identify what the items in the picture are. However, as a baby I could not and as a young child I would probably struggle with non-every day objects in a picture. Computers are at a point in their development where they … Continue reading Cognitive Computer Vision (Azure / Python)
Yesterday I outputted sensor readings into a CSV file, today I'm going to look at what I can do with that CSV file in Python. Pandas I originally looked at Pandas back in December 2018 when I used it to open an Excel spreadsheet. A CSV is open in a similar way: import pandas rf = … Continue reading Doing More With CSV Data (Python)
So far I have looked at outputting the data from my sensors to Flask, Twitter and Azure. However, a simpler option could be to output the date to a CSV (Comma Seperated Value) file that could be used by various programs later on. I've placed the Python code to capture data from the Pi sensors … Continue reading Saving Sensor Readings To CSV (Python / Raspberry Pi)
I was watching The Martian last night and realised that the displays of pressure for the space suites/ habitat in the film were all in psi (Pound force per Square Inch), which today has driven me today to see how see what the pressure force in my home is in psi rather than hectopascal. The … Continue reading Hectopascal to psi (Python)
Last month I added a Pimoroni breakout garden with a temperature/pressure sensor to my Raspberry Pi, and built a whole project around it. As the breakout garden has 2 additional slots that were empty I have decided to use one for the LTR-559 (sadly to my knowledge not a droid in Star Wars) Light & … Continue reading Lux Twitter Tweet Bot (Python / Raspberry Pi)
With the Python program (see part 1 and part 2) collecting Tweets from Twitter and then analysing the data via Azure to see if the sentiment is positive, neutral or negative it only means I am one step away from being able to retweet positive tweets. I've reused some of the code from my earlier … Continue reading Retweeting Positive Tweets, Or Part 3 Of Analysing Tweet Sentiment with Azure (Python / Raspberry Pi)
Building on the work I did yesterday using Azure to analyse Twitter tweet sentiment I have amended the function of the code so that it now marks the tweet as positive, neutral or negative. This is building up so that I can (hopefully) get my Twitter bot to retweet positive tweets about a subject of … Continue reading Analysing Tweet Sentiment with Azure -Part 2 (Python)
