911 emergency incident data are sent in nation wide in realtime so that we can provide better analytics to improve fire department operations and public safety.
Design a cloud based system for ingesting, enriching, and storing 911 incident data so that they can be used for analytics.
- In an effort to keep this simple, while providing the greatest flexibility for data schema, a NoSQL approach was used.
- The service was deployed using AWS Lambda and API Gateway, while persisting ingested data in DynamoDB.
- The individual deploying this application would need CentOS 7.3, git, sudo access, and basic unix knowledge for permissions. They also need to have an AWS Key/Secret pair and know their ARN.
- Instead of a script, something like this could be deploymed/managed using CodeDeploy or part of a larger infrastructure using CloudFormationTemplate.
- In the real world, there would be substantially more data validation on in code for ingest. This API assumes that event_id and a create date-time-group (DTG) exist in the presented data object. We would also not dynamically create storage on the initial call, but again for simplicity (and assuming the user has no DevOps or AWS knowledge), this approach might be easier to implement.
- CloudWatch is utilized for API monitoring
- Ensure git is installed and pull the project:
$ git clone https://github.com/mbrinkg8tr/PEProject.git$ cd PEProject
- Update executable permissions on the deployment script:
$ chmod 755 ./deploy.sh
- Launch the deployment script:
$ ./deploy.sh
Postman is recommended for testing this API. Submit a POST to the URL provided in the return of the API Gateway creation statement. The body simply needs to contain the event data.