Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mfebrizio authored Jul 12, 2021
1 parent eb2879f commit 08b258f
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,12 @@

*Data & Methods:*

Using the [Federal Register API](https://www.federalregister.gov/developers/documentation/api/v1), we searched final rules from the beginning of each president’s first term for keywords that indicate a rule’s effective date or compliance date was delayed. Specifically, if a rule contained the words “delay” and either “effective date” or “compliance date,” we flagged it as a regulatory suspension. Searching the full text of documents proved to be overly inclusive (i.e., picking up many false positives), so instead we focused on searching three particular fields from the Federal Register API -- title, action, and dates -- for those terms. We limited our timeframe to roughly the first 100 days of each president’s first term -- January 20 to April 30 -- because this would capture a substantial chunk of the initial regulatory activity of a new administration and ensured that we had enough data for Joe Biden’s first year in office. Since document-level data from the Federal Register only date back to 1994, we stop our search for regulatory suspensions at the George W. Bush administration.
Using the [Federal Register API](https://www.federalregister.gov/developers/documentation/api/v1), we searched final rules from the beginning of each president’s first term for keywords that indicate a rule’s effective date or compliance date was delayed. Specifically, if a rule contained the words "delay" and either "effective date" or "compliance date," we flagged it as a regulatory suspension. Searching the full text of documents proved to be overly inclusive (i.e., picking up many false positives), so instead we focused on searching three particular fields from the Federal Register API -- *title*, *action*, and *dates* -- for those terms. We limited our timeframe to roughly the first 100 days of each president’s first term -- January 20 to April 30 -- because this would capture a substantial chunk of the initial regulatory activity of a new administration and ensured that we had enough data for Joe Biden’s first year in office. Since document-level data from the Federal Register only date back to 1994, we stop our search for regulatory suspensions at the George W. Bush administration.

We conducted three robustness checks to verify the accuracy of our search method for regulatory suspensions. First, we sampled 50 percent of the identified suspensions from each president (115 out of 227 rules), which had an accuracy rate of 95.7 percent (110/115 with 5 false positives). Second, we sampled 5 percent of the total rules published in the time period from each president (171 out of 3375 rules), producing an accuracy rate of 97.7 percent (167/171 with 1 false positive and 3 false negatives). Third, we sampled 5 percent of the rules from each President identified as non-suspensions via the search method (159 out of 3148 rules). The accuracy rate was 99.4 percent (158/159 with 1 false negative). Each check had an accuracy rate greater than 95 percent, suggesting that our method is sufficiently accurate to reliably establish the broader trends and magnitudes of how presidents use regulatory suspensions.

While conducting accuracy checks, we noticed that some regulatory actions delayed the effective date for multiple rules. In the *action* and *dates* columns, the multiple-rule suspensions would typically say "delay of effective dates" rather than "delay of effective date," as well as refer to "each regulation." To identify multiple-rule suspensions, we searched the 227 regulatory actions containing suspensions using a regex search for "\bdates\b|\beach\b" (i.e., "dates" or "each" with word boundaries at the beginning and end) in either the *dates* or *action* columns. We manually read the flagged regulatory actions, determined how many suspensions each included, and revised the data accordingly.

*Repository Contents:*

TBD

0 comments on commit 08b258f

Please sign in to comment.