A Complete Guide to Web Scraping LinkedIn Job Postings

Using ‘Selenium’ for LinkedIn job postings scraping

Viola Mao
5 min readMar 1, 2021
Photo by Ian Schneider on Unsplash

When you are in the job market and look for your next assignment, what would you do? Browse the different websites, check LinkedIn, Indeed, Glassdoor, refresh your email box day by day to ensure you won’t miss any opportunities.

Another creative way is to build a job scraper tool. You can collect all the information by clicking a button or you can simply schedule the running job to have a refreshed job posting lists every morning (Overall, you are a data scientist, right?)

Work smarter than work harder

Here, I would like to share one way using web scraping to explore data science jobs on Linkedin and hope this can help with your job hunting or any kind of initiative you are working on!

Selenium Procedure

The library I am using is ‘selenium’ as there are some actions requested on the website, such as ‘click’, ‘move mouse’.

Image by Author

Above is a simple procedure to understand the usage of ‘selenium’.

--

--