Data Cleaning

home |   Check Your Lot Number (Latest data)  |   Vaers-Aware Lot Number Dashboard  |   Moderna 2021 Data  |   Pfizer 2021 Data  |   Janssen 2021 Data  |   Moderna (outside USA) 2021 Data  |   Pfizer (outside USA) 2021 Data  |   Janssen (outside USA) 2021 Data  |   International Deadly Lots  |   Severe  |   Lethal  |   Size Matters  |   Lot Sizes  |   Time till onset  |   Second Peak  |   Lot Expiry Dates  |   RNA Degradation  |   Causality  |   All or Nothing  |   Clusters  |   Symptom  |   Paralysis |  Children  |   Gender  |   States  |   Geography  |   Japan  |   Case Reports  |   Whistle Blowers  |   EMA Leaks  |   Video Library  |   Treatment  |   Background  |   Download Source Code  |   Data Cleaning  |   Partner  |   Advertisements  |   Donate  |   Shop  |  


Total Visitors for HowBad.info and HowBadisMyBatch.com since December 2021 : 111,526,346 (last updated January 12th 2023)


Please consider donating to support my efforts to carry on researching and providing information. This site is receiving many visitors. Please help me raise £300 to pay for the extra bandwidth needed

Craig Paardekooper

.


Method of obtaining data from VAERS

  1. Data tables are downloaded from VAERS by going to this site - https://vaers.hhs.gov/data/datasets.html? I usually download the zip file which contains all the other files

  2. I extract the files

  3. I open the main table (the largest one that contains the DIED, LIFE THREAT, and DISABLED COLUMNS)

  4. I click on data --> Get Data --> From File --> From Text/CSV, and I choose the batches table (the small one containing all the lot numbers)

  5. I make sure that both the main table and the batches table are in table format

  6. I import the lot numbers from column 4 of the batches table to an empty column of the main table using "=vLookup(A2m,BatchesTable, 4, FALSE)"

  7. I import the manufacturer from column 8 of the batches table to an empty column of the main table using "=vLookup(A2m,BatchesTable, 8, FALSE)"

  8. Then I filter the manufacturer column for a particular manufactuer e.g. Pfizer

  9. Then I copy the following columns from the main table LOT NUMBER, DIED, LIFE THREATENING, DISABLED using Ctrl C and paste all columns into a new workbook.

  10. Then I select all of the LOT column using Ctrl Space

  11. Then I replace all spaces in the LOT column using Ctrl H. I alo remove any # characters and hyphens. Note that VAERS counts EN 6200 and EN6200 as two different batches, so this procedure increases the count for EN6200. Thats why VAERS CDC wonder gives a slightly lower count. My count is much more accurate. Further cleaning can be done by removing any lots that are not in the format of two letters followed by 4 digits (which is the standard format)

  12. Once that data is cleaner, I create a pivot table for the purpose of counting the number of adverse reactions (ADRs), deaths, disabilities and life threatening illnesses for each batch


Please note that by cleaning the data I obtain higher counts than if I don't clean the data. CDC WONDER DOES NOT clean the data. My figures are therefore more accurate. However, CDC WONDER will still agree approximately with my figures, especially with regard to the general order of "toxicity" of the lots

To double check that the vLookup transfer was accurate, I take just the batches table on its own and filter for the manufacturer. Then create a pivot table from just the LOTS column. This will give me the number of adverse reactions for each batch. This should agree exactly with the number of adverse reactions after using the above procedure with vLookup.

I hope the above clarifies my procedure, and enables others to replicate my results. Later, I will create a more comprehensive method of cleaning the data, and outline each of the steps involved in cleaning


VIDEO : Extracting non-domestic data from VAERS - the steps I took

Click to download spreadsheet



Contact

covidscienceteam@protonmail.com



"Please support our work - we have 100,000 visitors every day. Changing minds - saving lives."


Created by Craig Paardekooper ©2022