Agricultural engineering is a combination of engineering technology and biological science applied to the field of agriculture. World population will exceed 9.6 billion by 2050 and we need to increase agricultural production by 70 percent to meet demand.
Agricultural Engineers will be one of the main problem solvers. They will be a bridge between technology and agriculture and it will be one leg of the solution.
Get Code To:
- Get Agriculture Engineer job posts summaries from indeed.com
- Save all summaries in one python list
- Create WordCloud based on this list
Libraries Used:
- requests to request an HTML page and return content
- BeautifulSoup4 to easily navigate in an HTML doc
- wordcloud to create a word cloud based on word frequency
- matplotlib to visualize word cloud
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
"""
Created on Sat Oct 18 02:43:37 2017
@author: erayonler
"""
#Importing libraries
import requests
import matplotlib.pyplot as plt
from bs4 import BeautifulSoup
from wordcloud import WordCloud, STOPWORDS
#Scraping text data from indeed.com
text = []
for index in range(0,1000,10):
page = "https://www.indeed.com/jobs?q=agricultural+engineer&start="+str(index)
web_result = requests.get(page).text
soup = BeautifulSoup(web_result)
for listing in soup.findAll("span", {"class": "summary"}):
text.append(listing.text)
texts = " ".join(text)
stopwords = set(STOPWORDS)
#Creating and visualizing word cloud
wordcloud = WordCloud(width = 1000, height = 500, stopwords = stopwords).generate(texts)
plt.figure(figsize=(15,8))
plt.imshow(wordcloud)
plt.axis("off")
plt.show()
This word cloud can give us an intuition about what, companies demand from agricultural engineers.
For example from the first view, I notice that System Engineer, Test Engineer, Electrical Controls, Project Engineer, Agricultural Production, Software Engineer, Design Engineer have a higher frequency of agricultural engineer job posts.
Why don’t you copy/modify the code and try for different job search keywords?