Edit Document Cleasing and everything

document/scrpion/proposed_model_scorpion_document.json

@@ -1,14 +1,14 @@
 [
   {
-    "hyp": "'In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper.', 'I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog.', 'It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing.', 'I didn't see people eating cooked scorpions until I went to Beijing... which is a bit unexpected.', 'In fact, the United States has only one type of scorpion that is considered deadly to humans.', 'I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing.', 'It’s very easy to find on market and food street.', 'It was quite expensive, 30 RMB ($4.36) for a big scorpion.'",
+    "hyp": "In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper., I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog., It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing., I didnt see people eating cooked scorpions until I went to Beijing... which is a bit unexpected., In fact, the United States has only one type of scorpion that is considered deadly to humans., I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing., It’s very easy to find on market and food street., It was quite expensive, 30 RMB ($4.36) for a big scorpion.",
     "ref": "It is quiet surprise that some of people eat the scorpion while other feel that it is so scary. Most of the people worry about the venom of it. But in some country they even used the scorpion as the medicine."
   },
   {
-    "hyp": "'In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper.', 'I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog.', 'It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing.', 'I didn't see people eating cooked scorpions until I went to Beijing... which is a bit unexpected.', 'In fact, the United States has only one type of scorpion that is considered deadly to humans.', 'I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing.', 'It’s very easy to find on market and food street.', 'It was quite expensive, 30 RMB ($4.36) for a big scorpion.', 'Fried insects can be a very good snack and it is addictive.', 'The taste was unique, not in a good way, to be honest.', 'People usually add salt and soy sauce on them.', 'I just really want to taste it right now.', 'Scorpion!'",
+    "hyp": "In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper., I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog., It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing., I didnt see people eating cooked scorpions until I went to Beijing... which is a bit unexpected., In fact, the United States has only one type of scorpion that is considered deadly to humans., I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing., It’s very easy to find on market and food street., It was quite expensive, 30 RMB ($4.36) for a big scorpion., Fried insects can be a very good snack and it is addictive., The taste was unique, not in a good way, to be honest., People usually add salt and soy sauce on them., I just really want to taste it right now., Scorpion!",
     "ref": "It is quiet surprise that some of people eat the scorpion while other feel that it is so scary. Most of the people worry about the venom of it. But in some country they even used the scorpion as the medicine."
   },
   {
-    "hyp": "'In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper.', 'I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog.', 'It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing.', 'I didn't see people eating cooked scorpions until I went to Beijing... which is a bit unexpected.', 'In fact, the United States has only one type of scorpion that is considered deadly to humans.', 'I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing.', 'It’s very easy to find on market and food street.', 'It was quite expensive, 30 RMB ($4.36) for a big scorpion.', 'Fried insects can be a very good snack and it is addictive.', 'The taste was unique, not in a good way, to be honest.', 'People usually add salt and soy sauce on them.', 'I just really want to taste it right now.', 'Scorpion!', 'The price is very cheap around 20 bath.', 'But once in a lifetime, why not right?', 'That's okay.'",
+    "hyp": "In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper., I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog., It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing., I didnt see people eating cooked scorpions until I went to Beijing... which is a bit unexpected., In fact, the United States has only one type of scorpion that is considered deadly to humans., I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing., It’s very easy to find on market and food street., It was quite expensive, 30 RMB ($4.36) for a big scorpion., Fried insects can be a very good snack and it is addictive., The taste was unique, not in a good way, to be honest., People usually add salt and soy sauce on them., I just really want to taste it right now., Scorpion!, The price is very cheap around 20 bath., But once in a lifetime, why not right?, Thats okay.",
     "ref": "It is quiet surprise that some of people eat the scorpion while other feel that it is so scary. Most of the people worry about the venom of it. But in some country they even used the scorpion as the medicine."
   }
 

document/scrpion/simple_model_scorpion_document.json

@@ -1,14 +1,14 @@
 [
   {
-    "hyp": "'In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper.', 'I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog.', 'It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing.', 'I didn't see people eating cooked scorpions until I went to Beijing... which is a bit unexpected.', 'In fact, the United States has only one type of scorpion that is considered deadly to humans.', 'I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions.I tried eating one in Wangfujing street, Beijing.', 'It’s very easy to find on market and food street.', 'It was quite expensive, 30 RMB ($4.36) for a big scorpion.'",
+    "hyp": "In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper., I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog., It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing., I didnt see people eating cooked scorpions until I went to Beijing... which is a bit unexpected., In fact, the United States has only one type of scorpion that is considered deadly to humans., I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions.I tried eating one in Wangfujing street, Beijing., It’s very easy to find on market and food street., It was quite expensive, 30 RMB ($4.36) for a big scorpion.",
     "ref": "It is quiet surprise that some of people eat the scorpion while other feel that it is so scary. Most of the people worry about the venom of it. But in some country they even used the scorpion as the medicine."
   },
   {
-    "hyp": "'In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper.', 'I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog.', 'It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing.', 'I didn't see people eating cooked scorpions until I went to Beijing... which is a bit unexpected.', 'In fact, the United States has only one type of scorpion that is considered deadly to humans.', 'I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing.', 'It’s very easy to find on market and food street.', 'It was quite expensive, 30 RMB ($4.36) for a big scorpion.', 'The taste was unique, not in a good way, to be honest.', 'Fried insects can be a very good snack and it is addictive.', 'People usually add salt and soy sauce on them.', 'I just really want to taste it right now.', 'Scorpion!'",
+    "hyp": "In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper., I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog., It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing., I didnt see people eating cooked scorpions until I went to Beijing... which is a bit unexpected., In fact, the United States has only one type of scorpion that is considered deadly to humans., I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing., It’s very easy to find on market and food street., It was quite expensive, 30 RMB ($4.36) for a big scorpion., The taste was unique, not in a good way, to be honest., Fried insects can be a very good snack and it is addictive., People usually add salt and soy sauce on them., I just really want to taste it right now., Scorpion!",
     "ref": "It is quiet surprise that some of people eat the scorpion while other feel that it is so scary. Most of the people worry about the venom of it. But in some country they even used the scorpion as the medicine."
   },
   {
-    "hyp": "'In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper.', 'I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog.', 'It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing.', 'I didn't see people eating cooked scorpions until I went to Beijing... which is a bit unexpected.', 'In fact, the United States has only one type of scorpion that is considered deadly to humans.', 'I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing.', 'It’s very easy to find on market and food street.', 'It was quite expensive, 30 RMB ($4.36) for a big scorpion.', 'The taste was unique, not in a good way, to be honest.', 'Fried insects can be a very good snack and it is addictive.', 'People usually add salt and soy sauce on them.', 'I just really want to taste it right now.', 'Scorpion!', 'The price is very cheap around 20 bath.', 'But once in a lifetime, why not right?', 'That's okay.'",
+    "hyp": "In Thailand we do not eat only scorpion but we also eat many kind of insects such as bamboo worm, cricket, and grass hopper., I could not stand just stare at it, while on the other part of the world could eat it on the sticks just like a hotdog., It was hard to tell if it is actually a ‘normal food’ or a ‘exotic food’ in the big city like Beijing., I didnt see people eating cooked scorpions until I went to Beijing... which is a bit unexpected., In fact, the United States has only one type of scorpion that is considered deadly to humans., I just had Mcdonalds yesterday and studies have proven it to be more dangerous than scorpions. I tried eating one in Wangfujing street, Beijing., It’s very easy to find on market and food street., It was quite expensive, 30 RMB ($4.36) for a big scorpion., The taste was unique, not in a good way, to be honest., Fried insects can be a very good snack and it is addictive., People usually add salt and soy sauce on them., I just really want to taste it right now., Scorpion!, The price is very cheap around 20 bath., But once in a lifetime, why not right?, Thats okay.",
     "ref": "It is quiet surprise that some of people eat the scorpion while other feel that it is so scary. Most of the people worry about the venom of it. But in some country they even used the scorpion as the medicine."
   }
 ]