{"id":185,"date":"2023-09-03T14:33:13","date_gmt":"2023-09-03T14:33:13","guid":{"rendered":"https:\/\/editor.mediahack.co.za\/databites\/?p=185"},"modified":"2025-11-17T17:41:35","modified_gmt":"2025-11-17T17:41:35","slug":"a-simple-guide-to-scraping-data-from-pdfs","status":"publish","type":"post","link":"https:\/\/outliereditor.co.za\/index.php\/2023\/09\/03\/a-simple-guide-to-scraping-data-from-pdfs\/","title":{"rendered":"Simple guide to scraping data from PDFs"},"content":{"rendered":"\n

Papers, PDFs and poorly scanned documents. This is the not-so-glamorous way most data journalism projects begin. Luckily, we don\u2019t have to manually type out the data into a new spreadsheet to work with it. Instead, at The Outlier, we often use Adobe Acrobat DC<\/a> to do all the hard work for us.<\/p>\n\n\n\n

In this example, we\u2019re going to scrape South Africa\u2019s School Performance Report<\/a> \u2014 a report that contains data about all the schools in the country and how their grade 12 cohort performed in the final exams over three years. The entire 226-page document comes as a PDF. But our aim is to extract all of the school subject data for one particular province, the Northern Cape, and all five of its districts.<\/p>\n\n\n\n

Let\u2019s get to it.<\/p>\n\n\n\n

If your document is a hard copy, scan it onto your desktop to create a readable soft copy. Upload\u00a0the PDF and open it with Adobe Acrobat.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Once opened, select the \u2018Organize Pages\u2019 option in the right-hand panel. This will allow you to select the pages you want to extract into a workable copy.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Scroll down to the pages you want to select. Hold down CTRL on your keyboard to select multiple pages at once. Now select \u2018Extract\u2019. This option will open a new window with only the pages you selected.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Now select \u2018Export PDF\u2019 from the right-hand panel.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

A new window will open asking you in which format you would like to export your data. Usually, I select \u2018Spreadsheet\u2019 and \u2018Microsoft Excel Workbook\u2019, and then \u2018Export\u2019.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Choose the download destination for your scraped data, and then open that file. An Excel spreadsheet will appear with four different tabs of data because you have extracted four pages. (If you extracted 80 pages, this file would have 80 tabs.)<\/p>\n\n\n\n

At this stage, technically you are done scraping your data. But having the data on different tabs makes it difficult to work with as a whole. This is when I open the Excel file in Google Sheets to make the next set of changes. Of course, you can do the same thing directly in Excel.<\/p>\n\n\n\n

Carefully copy-and-paste the data from the rest of the tabs under the data in the first tab, minus the column headings. Once that\u2019s done, delete the other tabs. Now you should have one tab with all your scraped district data under the same column headings.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Voila! You now have a format that\u2019s easy to filter and sort through.<\/p>\n\n\n\n

Notebook<\/h2>\n\n\n\n