RESIN-pipeline

RESIN: Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System

Instructions

1. Run git clone https://github.com/RESIN-KAIROS/RESIN-pipeline-public

2. Run cd RESIN-pipeline-public

3. Setup ${KAIROS_LIB} dir:

   • https://github.com/RESIN-KAIROS/RESIN-pipeline-public/blob/api/docker-compose.yaml#L8;

   • Uncompress data package (e.g, LDC2020E33) and put everything under ${KAIROS_LIB}/resin/resin/input/task1;

     e.g., ${KAIROS_LIB}/resin/resin/input/task1/{data,docs,tools}

   • Put schemas library under ${KAIROS_LIB}/resin/resin/schemas

4. Download and uncompress external data http://159.89.180.81/demo/resources/edl_data.tar.gz;

   Set up dirs:

   • https://github.com/RESIN-KAIROS/RESIN-pipeline-public/blob/api/docker-compose.yaml#L14
   • https://github.com/RESIN-KAIROS/RESIN-pipeline-public/blob/api/docker-compose.yaml#L20

5. Set up device number for each GPU-based component, e.g.,

   https://github.com/RESIN-KAIROS/RESIN-pipeline-public/blob/api/docker-compose.yaml#L44

6. Start APIs using: docker-compose up

7. Send the following POST message to the main API (https://github.com/RESIN-KAIROS/entrypoint) to start processing:

   curl -X POST --header "Content-Type: application/json" -d '{"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6", "runId": "my_run_id", "sender": "string", "time": "2020-11-25T03:34:48.008Z", "content": {"data": "Example source document content here."}, "contentUri": "s3://kairos-experiment-data/performera/"}' http://0.0.0.0:10100/kairos/entrypoint
   

   • Output will be in this dir: ${KAIROS_LIB}/resin/resin/persist/${my_run_id}

8. Send the following GET message to check the status:

   curl -X GET  http://0.0.0.0:10100/kairos/status
   

Source code

Please view source code of each docker component in the docker-compose file.

Reference

@article{wen2021resin,
  author    = {Haoyang Wen and Ying Lin and Tuan M. Lai and Xiaoman Pan and Sha Li and Xudong Lin and Ben Zhou and Manling Li and Haoyu Wang and Hongming Zhang and Xiaodong Yu and Alexander Dong and Zhenhailong Wang and Yi R. Fung and Piyush Mishra and Qing Lyu and Dídac Surís and Brian Chen and Susan W. Brown and Martha Palmer and Chris Callison-Burch and Carl Vondrick and Jiawei Han and Dan Roth and Shih-Fu Chang and Heng Ji},
  title     = {RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System},
  journal   = {NAACL Demo Track},
  year      = {2021}
}