Department of Defense
Justification Books

“Hey, can I get that data?”

Download

#DataReuse #CommonOperatingData

Brought to you by FedAPI

Version 1.0 | GitHub Project | Created by 540.co

Tweet Follow @540co

What is this?

JBooks is an extract of the public DoD Procurement (P-1) and RDTE (R-1) justification book exhibits submitted by the US DoD Military Departments and Defense Agencies into multiple data formats to allow analysts / users to use their tool of choice when analyzing and/or merging with other data sources.

Where does it come from?

The extract includes:

  • 2013 base budget
  • 2014 base / amended budget
  • 2015 base / amended budget
  • 2016 base budget
  • 2017 base budget

Why was this done?

Two major reasons:

  1. Many people don't even know that this data exists in a machine readable format, and
  2. The people who do are spending too much time downloading and extracting only the data they need.

Since we had already done the heavy lifting of downloading / parsing the Justification Books into resources for FedAPI - and not all analysts know how to consume APIs (yet) - we figured it was a good idea to also publish in other formats to minimize time harvesting / parsing the data and maximize analysis time.

Wow, you guys are smart. How did you do it?

  • Each PDF was downloaded and the XML files attached to the PDF were extracted
  • Each XML file was parsed to pull out procurement line items / rdte program elements from the various exhibits and each item / element was converted into individual unique JSON objects
  • Each JSON object was uploaded to our FedAPI platform to expose via an API
  • Each JSON object was converted to CSV and SQL (coming soon)
  • The SQL was loaded into Amazon RDS (coming soon)

Show me the data!

API

Want to consume an API or build one? Awesome!

GET /data

XML

Just want the XML files?
Done.

GET /data

CSV

Want a collection of CSVs to load into your tool of choice?

GET /data

JSON

Want to consume an API or build one? 
YAY!

GET /data

SQL

Want to spin your own data warehouse? Just download the SQL and have fun.

GET /data

DBW

Want to connect to your DW, but don’t want to set up your own DB? Use our AMAZON RDS Instance!

GET /data

PDF

If you really want these, click below and go grab a cup of coffee
(You're gonna need it)

GET /data

OTHER

Want your data some other way that we haven't thought of yet?
Let us know!

GET /data

Tableau

Want it as a Tableau-ready file? No problem! We've got it all ready for you right here.

GET /data

Qlikview

Want to upload it into Qlikview. Here's the CSV you need. (Qlikview-ready not yet available)

GET /data

Feedback

Maybe you just want to tell us something else