The GDELT Project

LLM Translation Instability & Embedding-Based Ranking Of LLM & NMT Machine Translation: Part 2

Kalev Leetaru

Following in our series of LLM translation experiments and embedding-based quality rankings, let's look at another example of a Chinese language news article, comparing human, NMT and LLM translations. Like our example from earlier this week, ChatGPT randomly truncated our passage: in 9 of 12 runs (75%) it output just the second half of the text, completely deleting the first paragraph from its translation as if it never existed. This is highly problematic in real-world pipelines, as it means that even production systems that attempt to translate a passage multiple times, there is a reasonable chance that all of the outputs will be truncated.

We rank all 12 ChatGPT translations, our human translation and the Google Translate and Bing Translator NMT translations via the Vertex API, USE Multilingual, USE Multilingual Large and LaBSE embedding models. Vertex's underlying Gecko LLM is not officially a multilingual embedding model yet and this is clearly visible in the results below in which it ranked the human translation second to last and was unable to robustly separate the truncated and complete translations.

Overall, USE Multilingual ranked the human translation as best, followed by Google Translate, while USE Multilingual Large ranked Bing Translator best, with the human translation just above the middle of the pack and LaBSE ranked Google Translate as 4th best and the human translation around the middle of the pack as well. These results are remarkably similar to our earlier experiments in which NMT models Google Translate and Bing Translator are systematically ranked as more faithful and accurate to the original text than the LLM translations, despite the LLM translations often exhibiting higher fluency. Importantly, the human translations in all of our experiments to date have typically been ranked below many of the machine translations, raising key questions about whether multilingual embedding models may encode biases towards the more stilted writing of machine translation or whether NMT renditions of text are simply more faithful and literal, while human translations reach too far beyond the literal confines of the text (which would also negatively impact the LLM translations as well).

Let's take two paragraphs from this news article from this past May and ask ChatGPT to translate them into English:

Translate the following sentence into English and output only the final English: 工作人員當時正在調配染髮劑，發現後上前阻止已經來不及，女客則是覺得有異樣，轉頭一看發現自己被剪掉一大磋頭髮，氣得當場報警處理，最終三方達成和解，母親賠償女客人11500人民幣，美容院則是未盡管理責任，必須免費提供8次共12000人民幣的美髮服務。 不少大陸網友也搖頭：「這種熊孩子不管以後還得了」、「熊孩子的罪，家長必須承擔」、「媽媽顧著滑手機完全不理女兒也是奇葩」、「一刀1萬，好貴的學費」、「其實美容院應該才是主責方」、「是我不會要錢，我會直接把熊孩子剃光頭」。

This passage contains the Chinese phrase "熊孩子" which translates literally to "bear child" that does not have a direct counterpart in English, but which is often translated in terms like "mischievous", "naughty" or "troublemaker", adding a bit of complexity to test how the translation engines handle terms without direct counterparts.

For comparison, a human translator translated the passage as:

The staff was preparing the hair dye and when he realized what was happening, it was already too late for him to stop it. The female customer felt there was something weird and turned her head to find that a bunch of her hair was cut off. She was so angry that she called the police immediately. Eventually, the three parties reached a settlement: the mother compensated the female customer 11,500 yuan and the beauty salon was found negligent in its management and required to provide 8 free hairdressing services worth a total of 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of mischievous kid has to be disciplined before getting out of control', 'Parents must take responsibility for their mischievous kids' actions', 'it's ridiculous that the mom was playing on her cell phone while completely ignoring her daughter', '10000 yuan for a hair cut, that's an expensive lesson', 'Really, the beauty salon should be the main one responsible', 'If it was me, I would not take the money, I would just shave the mischievous child's head'.

To compare with classical NMT models, Google Translate offers:

The staff was preparing the hair dye at the time, and it was too late to stop it after discovering it. The female customer felt that there was something strange. She turned her head and saw that a large amount of her hair had been cut off. She was so angry that she called the police on the spot. Finally, the three parties reached a settlement. Compensation of 11,500 RMB for female customers, while the beauty parlor has not fulfilled its management responsibilities and must provide 8 free hairdressing services totaling 12,000 RMB. Many mainland netizens also shook their heads: 'This kind of bad boy will get it no matter what in the future', 'Parents must bear the crime of the bad boy', 'It's weird for a mother to ignore her daughter while swiping her phone', 'A knife of 10,000 is so expensive tuition fees', 'Actually, the beauty parlor should be the responsible party', 'I will not ask for money, I will directly shave the bear's head'.

While Bing Translator provides:

The staff was dispensing hair dye at the time, and after finding that it was too late to stop it, the female customer felt something different, turned her head and found that she had been cut off a large amount of hair, so angry that she called the police on the spot, and finally the three parties reached a settlement, the mother compensated the female guest for 11,500 yuan, and the beauty salon did not fulfill its management responsibilities, and must provide 8 free hairdressing services totaling 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of bear child will not be repaid in the future', 'The sin of the bear child, parents must bear it', 'It is strange for the mother to ignore her daughter completely by taking care of the mobile phone', '10,000 by knife, expensive tuition', 'In fact, the beauty salon should be the responsible party', 'I will not ask for money, I will directly shave the bear child's head'.

The ChatGPT prompt above was run 12 times, each time in a fresh session. Surprisingly, despite its simplistic style and content, 9 of 12 runs (75%) yielded truncated translations that only translated the second paragraph. As usual, ChatGPT provided no error or warning of the truncation. This instability is one of the great challenges of LLM-based translation. Here are the final translations:

Here are their respective rankings:

Vertex API

***(1.000) (ID 0) (Len: 233): 工作人員當時正在調配染髮劑，發現後上前阻止已經來不及，女客則是覺得有異樣，轉頭一看發現自己被剪掉一大磋頭髮，氣得當場報警處理，最終三方達成和解，母親賠償女客人11500人民幣，美容院則是未盡管理責任，必須免費提供8次共12000人民幣的美髮服務。 不少大陸網友也搖頭：「這種熊孩子不管以後還得了」、「熊孩子的罪，家長必須承擔」、「媽媽顧著滑手機完全不理女兒也是奇葩」、「一刀1萬，好貴的學費」、「其實美容院應該才是主責方」、「是我不會要錢，我會直接把熊孩子剃光頭」。
   (0.588) (ID 8) (Len: 523): Not a few mainland netizens also shook their heads: 'No matter what, this bear-like child will have a difficult future,' 'Parents must bear the responsibility for the bear-like child's wrongdoing,' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd,' 'Charging 10,000 RMB for a single cut, what an expensive lesson,' 'Actually, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money; I would just shave the bear-like child's head directly.'
   (0.587) (ID 2) (Len: 947): The staff was preparing the hair dye at the time, and it was too late to stop it after discovering it. The female customer felt that there was something strange. She turned her head and saw that a large amount of her hair had been cut off. She was so angry that she called the police on the spot. Finally, the three parties reached a settlement. Compensation of 11,500 RMB for female customers, while the beauty parlor has not fulfilled its management responsibilities and must provide 8 free hairdressing services totaling 12,000 RMB. Many mainland netizens also shook their heads: 'This kind of bad boy will get it no matter what in the future', 'Parents must bear the crime of the bad boy', 'It's weird for a mother to ignore her daughter while swiping her phone', 'A knife of 10,000 is so expensive tuition fees', 'Actually, the beauty parlor should be the responsible party', 'I will not ask for money, I will directly shave the bear's head'.
   (0.578) (ID 7) (Len: 555): Many mainland netizens also shook their heads: 'No matter what happens in the future, this kind of misbehaving child cannot be tolerated,' 'The parents must bear the responsibility for the misbehaving child's actions,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for one cut, what an expensive lesson,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head.''
   (0.576) (ID 14) (Len: 512): Many mainland netizens also shook their heads: 'No matter how this naughty child grows up, the parents must bear the responsibility for the child's misdeeds.' 'The mother was too engrossed in using her cellphone and completely ignored her daughter, which is absurd.' 'Cutting off such a large amount of hair costs 11,500 RMB, it's an expensive lesson.' 'In fact, the beauty salon should be the one held responsible.' 'If it were me, I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.575) (ID 6) (Len: 974): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong and turned her head to find that a lot of her hair had been cut off. Outraged, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with ¥11,500, and the beauty salon, acknowledging their negligence, had to provide 8 free hair services worth ¥12,000. Many mainland Chinese netizens also shook their heads, saying, 'Such misbehaving children won't turn out well in the future,' 'Parents must take responsibility for the misdeeds of their children,' 'The mother was totally absorbed in her phone and completely ignored her daughter, which is ridiculous,' 'A fee of 10,000 for a single cut, that's expensive tuition,' 'Actually, the beauty salon should be held more accountable,' 'If it were me, I wouldn't ask for money; I'd just shave the misbehaving child's head.'
   (0.574) (ID 10) (Len: 939): After the staff was mixing hair dye, they discovered it too late to stop it. The female customer felt something was wrong and turned her head to find a large chunk of her hair had been cut off. Furious, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with 11,500 RMB, while the beauty salon, acknowledging its partial responsibility, agreed to provide 8 free hairdressing services worth 12,000 RMB in total. Many Chinese netizens shook their heads and commented: 'This misbehaving child won't end up well in the future,' 'Parents must bear the responsibility for the misdeeds of their children,' 'The mother was completely neglecting her daughter while playing with her phone,' 'The haircut costs a whopping 10,000 RMB,' 'Actually, the beauty salon should be held more accountable,' 'I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.573) (ID 4) (Len: 536): Not a few mainland netizens shook their heads: 'No matter what, this naughty child will suffer in the future'; 'Parents must bear the responsibility for the misbehavior of their naughty children'; 'The mother was completely ignoring her daughter while playing with her phone, which is also strange'; 'Cutting off a large chunk of hair for 10,000 yuan, such an expensive lesson'; 'Actually, the beauty salon should be the one held responsible'; 'If it were me, I wouldn't ask for money, I would just shave the naughty child's head bald'.
   (0.571) (ID 15) (Len: 514): Many mainland netizens also shook their heads and commented: 'No matter how this mischievous child turns out in the future,' 'Parents must bear the responsibility for the mischievous child's actions,' 'The mother was completely ignoring her daughter while playing on her phone, which is ridiculous,' 'Charging 10,000 yuan for one cut, such an expensive lesson fee,' 'In fact, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money, I'd just shave the mischievous child's head.'
   (0.570) (ID 13) (Len: 1064): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong, turned around, and found a large chunk of her hair had been cut off. She was so angry that she immediately called the police. Eventually, the three parties reached a settlement, with the mother compensating the female customer 11,500 RMB, and the beauty salon, acknowledging their failure in management responsibility, had to provide 8 free hair services worth a total of 12,000 RMB. Many mainland Chinese netizens also shook their heads: 'This kind of misbehaving child will be a problem in the future,' 'Parents must bear the responsibility for the misbehavior of their children,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is bizarre,' 'Charging 10,000 RMB for a single cut, such an expensive lesson fee,' 'In fact, the beauty salon should be the one mainly responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head bald.'
   (0.569) (ID 9) (Len: 528): Not a few mainland netizens shook their heads: 'No matter what, this mischievous child will not have a good future,' 'The parents must bear the responsibility for the mischievous child's actions,' 'The mother was so focused on using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for a single cut, that's an expensive lesson,' 'Actually, the beauty salon should be the one held responsible,' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head.'
   (0.569) (ID 3) (Len: 946): The staff was dispensing hair dye at the time, and after finding that it was too late to stop it, the female customer felt something different, turned her head and found that she had been cut off a large amount of hair, so angry that she called the police on the spot, and finally the three parties reached a settlement, the mother compensated the female guest for 11,500 yuan, and the beauty salon did not fulfill its management responsibilities, and must provide 8 free hairdressing services totaling 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of bear child will not be repaid in the future', 'The sin of the bear child, parents must bear it', 'It is strange for the mother to ignore her daughter completely by taking care of the mobile phone', '10,000 by knife, expensive tuition', 'In fact, the beauty salon should be the responsible party', 'I will not ask for money, I will directly shave the bear child's head'.
   (0.568) (ID 12) (Len: 456): Many mainland netizens also shook their heads: 'No matter how they grow up, such mischievous kids must be held responsible by their parents.' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd.' 'One cut costs 10,000; that's an expensive lesson.' 'In fact, the beauty salon should be the one primarily responsible.' 'If it were me, I wouldn't ask for money; I'd just shave the mischievous kid's head directly.'
   (0.567) (ID 11) (Len: 540): Many mainland netizens also shook their heads: 'No matter what happens in the future, such naughty children will not be disciplined. The parents must bear the responsibility for the misbehavior of the child.' 'The mother was completely ignoring her daughter while playing with her phone, which is absurd.' 'A charge of 10,000 for a single cut, that's an expensive lesson.' 'Actually, the beauty salon should be held primarily responsible.' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head directly.'
   (0.562) (ID 1) (Len: 1060): The staff was preparing the hair dye and when he realized what was happening, it was already too late for him to stop it. The female customer felt there was something weird and turned her head to find that a bunch of her hair was cut off. She was so angry that she called the police immediately. Eventually, the three parties reached a settlement: the mother compensated the female customer 11,500 yuan and the beauty salon was found negligent in its management and required to provide 8 free hairdressing services worth a total of 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of mischievous kid has to be disciplined before getting out of control', 'Parents must take responsibility for their mischievous kids' actions', 'it's ridiculous that the mom was playing on her cell phone while completely ignoring her daughter', '10000 yuan for a hair cut, thats an expensive lesson', 'Really, the beauty salon should be the main one responsible', 'If it was me, I would not take the money, I would just shave the mischievous child's head'.
   (0.558) (ID 5) (Len: 521): Not a few mainland netizens also shook their heads: 'No matter what, this little brat is going to suffer in the future,' 'Parents must bear the responsibility for the misdeeds of their unruly children,' 'The mom was too busy playing with her phone and completely ignored her daughter, which is absurd,' 'It costs 10,000 yuan for one cut, such an expensive tuition,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I'd just shave the little brat's head.'

USE Multilingual

***(1.000) (ID 0) (Len: 233): 工作人員當時正在調配染髮劑，發現後上前阻止已經來不及，女客則是覺得有異樣，轉頭一看發現自己被剪掉一大磋頭髮，氣得當場報警處理，最終三方達成和解，母親賠償女客人11500人民幣，美容院則是未盡管理責任，必須免費提供8次共12000人民幣的美髮服務。 不少大陸網友也搖頭：「這種熊孩子不管以後還得了」、「熊孩子的罪，家長必須承擔」、「媽媽顧著滑手機完全不理女兒也是奇葩」、「一刀1萬，好貴的學費」、「其實美容院應該才是主責方」、「是我不會要錢，我會直接把熊孩子剃光頭」。
   (0.682) (ID 1) (Len: 1060): The staff was preparing the hair dye and when he realized what was happening, it was already too late for him to stop it. The female customer felt there was something weird and turned her head to find that a bunch of her hair was cut off. She was so angry that she called the police immediately. Eventually, the three parties reached a settlement: the mother compensated the female customer 11,500 yuan and the beauty salon was found negligent in its management and required to provide 8 free hairdressing services worth a total of 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of mischievous kid has to be disciplined before getting out of control', 'Parents must take responsibility for their mischievous kids' actions', 'it's ridiculous that the mom was playing on her cell phone while completely ignoring her daughter', '10000 yuan for a hair cut, thats an expensive lesson', 'Really, the beauty salon should be the main one responsible', 'If it was me, I would not take the money, I would just shave the mischievous child's head'.
   (0.680) (ID 13) (Len: 1064): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong, turned around, and found a large chunk of her hair had been cut off. She was so angry that she immediately called the police. Eventually, the three parties reached a settlement, with the mother compensating the female customer 11,500 RMB, and the beauty salon, acknowledging their failure in management responsibility, had to provide 8 free hair services worth a total of 12,000 RMB. Many mainland Chinese netizens also shook their heads: 'This kind of misbehaving child will be a problem in the future,' 'Parents must bear the responsibility for the misbehavior of their children,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is bizarre,' 'Charging 10,000 RMB for a single cut, such an expensive lesson fee,' 'In fact, the beauty salon should be the one mainly responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head bald.'
   (0.671) (ID 2) (Len: 947): The staff was preparing the hair dye at the time, and it was too late to stop it after discovering it. The female customer felt that there was something strange. She turned her head and saw that a large amount of her hair had been cut off. She was so angry that she called the police on the spot. Finally, the three parties reached a settlement. Compensation of 11,500 RMB for female customers, while the beauty parlor has not fulfilled its management responsibilities and must provide 8 free hairdressing services totaling 12,000 RMB. Many mainland netizens also shook their heads: 'This kind of bad boy will get it no matter what in the future', 'Parents must bear the crime of the bad boy', 'It's weird for a mother to ignore her daughter while swiping her phone', 'A knife of 10,000 is so expensive tuition fees', 'Actually, the beauty parlor should be the responsible party', 'I will not ask for money, I will directly shave the bear's head'.
   (0.665) (ID 6) (Len: 974): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong and turned her head to find that a lot of her hair had been cut off. Outraged, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with ¥11,500, and the beauty salon, acknowledging their negligence, had to provide 8 free hair services worth ¥12,000. Many mainland Chinese netizens also shook their heads, saying, 'Such misbehaving children won't turn out well in the future,' 'Parents must take responsibility for the misdeeds of their children,' 'The mother was totally absorbed in her phone and completely ignored her daughter, which is ridiculous,' 'A fee of 10,000 for a single cut, that's expensive tuition,' 'Actually, the beauty salon should be held more accountable,' 'If it were me, I wouldn't ask for money; I'd just shave the misbehaving child's head.'
   (0.657) (ID 10) (Len: 939): After the staff was mixing hair dye, they discovered it too late to stop it. The female customer felt something was wrong and turned her head to find a large chunk of her hair had been cut off. Furious, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with 11,500 RMB, while the beauty salon, acknowledging its partial responsibility, agreed to provide 8 free hairdressing services worth 12,000 RMB in total. Many Chinese netizens shook their heads and commented: 'This misbehaving child won't end up well in the future,' 'Parents must bear the responsibility for the misdeeds of their children,' 'The mother was completely neglecting her daughter while playing with her phone,' 'The haircut costs a whopping 10,000 RMB,' 'Actually, the beauty salon should be held more accountable,' 'I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.639) (ID 3) (Len: 946): The staff was dispensing hair dye at the time, and after finding that it was too late to stop it, the female customer felt something different, turned her head and found that she had been cut off a large amount of hair, so angry that she called the police on the spot, and finally the three parties reached a settlement, the mother compensated the female guest for 11,500 yuan, and the beauty salon did not fulfill its management responsibilities, and must provide 8 free hairdressing services totaling 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of bear child will not be repaid in the future', 'The sin of the bear child, parents must bear it', 'It is strange for the mother to ignore her daughter completely by taking care of the mobile phone', '10,000 by knife, expensive tuition', 'In fact, the beauty salon should be the responsible party', 'I will not ask for money, I will directly shave the bear child's head'.
   (0.617) (ID 8) (Len: 523): Not a few mainland netizens also shook their heads: 'No matter what, this bear-like child will have a difficult future,' 'Parents must bear the responsibility for the bear-like child's wrongdoing,' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd,' 'Charging 10,000 RMB for a single cut, what an expensive lesson,' 'Actually, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money; I would just shave the bear-like child's head directly.'
   (0.615) (ID 14) (Len: 512): Many mainland netizens also shook their heads: 'No matter how this naughty child grows up, the parents must bear the responsibility for the child's misdeeds.' 'The mother was too engrossed in using her cellphone and completely ignored her daughter, which is absurd.' 'Cutting off such a large amount of hair costs 11,500 RMB, it's an expensive lesson.' 'In fact, the beauty salon should be the one held responsible.' 'If it were me, I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.610) (ID 4) (Len: 536): Not a few mainland netizens shook their heads: 'No matter what, this naughty child will suffer in the future'; 'Parents must bear the responsibility for the misbehavior of their naughty children'; 'The mother was completely ignoring her daughter while playing with her phone, which is also strange'; 'Cutting off a large chunk of hair for 10,000 yuan, such an expensive lesson'; 'Actually, the beauty salon should be the one held responsible'; 'If it were me, I wouldn't ask for money, I would just shave the naughty child's head bald'.
   (0.602) (ID 12) (Len: 456): Many mainland netizens also shook their heads: 'No matter how they grow up, such mischievous kids must be held responsible by their parents.' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd.' 'One cut costs 10,000; that's an expensive lesson.' 'In fact, the beauty salon should be the one primarily responsible.' 'If it were me, I wouldn't ask for money; I'd just shave the mischievous kid's head directly.'
   (0.592) (ID 11) (Len: 540): Many mainland netizens also shook their heads: 'No matter what happens in the future, such naughty children will not be disciplined. The parents must bear the responsibility for the misbehavior of the child.' 'The mother was completely ignoring her daughter while playing with her phone, which is absurd.' 'A charge of 10,000 for a single cut, that's an expensive lesson.' 'Actually, the beauty salon should be held primarily responsible.' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head directly.'
   (0.589) (ID 7) (Len: 555): Many mainland netizens also shook their heads: 'No matter what happens in the future, this kind of misbehaving child cannot be tolerated,' 'The parents must bear the responsibility for the misbehaving child's actions,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for one cut, what an expensive lesson,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head.''
   (0.581) (ID 9) (Len: 528): Not a few mainland netizens shook their heads: 'No matter what, this mischievous child will not have a good future,' 'The parents must bear the responsibility for the mischievous child's actions,' 'The mother was so focused on using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for a single cut, that's an expensive lesson,' 'Actually, the beauty salon should be the one held responsible,' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head.'
   (0.574) (ID 5) (Len: 521): Not a few mainland netizens also shook their heads: 'No matter what, this little brat is going to suffer in the future,' 'Parents must bear the responsibility for the misdeeds of their unruly children,' 'The mom was too busy playing with her phone and completely ignored her daughter, which is absurd,' 'It costs 10,000 yuan for one cut, such an expensive tuition,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I'd just shave the little brat's head.'
   (0.564) (ID 15) (Len: 514): Many mainland netizens also shook their heads and commented: 'No matter how this mischievous child turns out in the future,' 'Parents must bear the responsibility for the mischievous child's actions,' 'The mother was completely ignoring her daughter while playing on her phone, which is ridiculous,' 'Charging 10,000 yuan for one cut, such an expensive lesson fee,' 'In fact, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money, I'd just shave the mischievous child's head.'

USE Multilingual Large

***(1.000) (ID 0) (Len: 233): 工作人員當時正在調配染髮劑，發現後上前阻止已經來不及，女客則是覺得有異樣，轉頭一看發現自己被剪掉一大磋頭髮，氣得當場報警處理，最終三方達成和解，母親賠償女客人11500人民幣，美容院則是未盡管理責任，必須免費提供8次共12000人民幣的美髮服務。 不少大陸網友也搖頭：「這種熊孩子不管以後還得了」、「熊孩子的罪，家長必須承擔」、「媽媽顧著滑手機完全不理女兒也是奇葩」、「一刀1萬，好貴的學費」、「其實美容院應該才是主責方」、「是我不會要錢，我會直接把熊孩子剃光頭」。
   (0.768) (ID 3) (Len: 946): The staff was dispensing hair dye at the time, and after finding that it was too late to stop it, the female customer felt something different, turned her head and found that she had been cut off a large amount of hair, so angry that she called the police on the spot, and finally the three parties reached a settlement, the mother compensated the female guest for 11,500 yuan, and the beauty salon did not fulfill its management responsibilities, and must provide 8 free hairdressing services totaling 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of bear child will not be repaid in the future', 'The sin of the bear child, parents must bear it', 'It is strange for the mother to ignore her daughter completely by taking care of the mobile phone', '10,000 by knife, expensive tuition', 'In fact, the beauty salon should be the responsible party', 'I will not ask for money, I will directly shave the bear child's head'.
   (0.766) (ID 6) (Len: 974): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong and turned her head to find that a lot of her hair had been cut off. Outraged, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with ¥11,500, and the beauty salon, acknowledging their negligence, had to provide 8 free hair services worth ¥12,000. Many mainland Chinese netizens also shook their heads, saying, 'Such misbehaving children won't turn out well in the future,' 'Parents must take responsibility for the misdeeds of their children,' 'The mother was totally absorbed in her phone and completely ignored her daughter, which is ridiculous,' 'A fee of 10,000 for a single cut, that's expensive tuition,' 'Actually, the beauty salon should be held more accountable,' 'If it were me, I wouldn't ask for money; I'd just shave the misbehaving child's head.'
   (0.762) (ID 10) (Len: 939): After the staff was mixing hair dye, they discovered it too late to stop it. The female customer felt something was wrong and turned her head to find a large chunk of her hair had been cut off. Furious, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with 11,500 RMB, while the beauty salon, acknowledging its partial responsibility, agreed to provide 8 free hairdressing services worth 12,000 RMB in total. Many Chinese netizens shook their heads and commented: 'This misbehaving child won't end up well in the future,' 'Parents must bear the responsibility for the misdeeds of their children,' 'The mother was completely neglecting her daughter while playing with her phone,' 'The haircut costs a whopping 10,000 RMB,' 'Actually, the beauty salon should be held more accountable,' 'I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.756) (ID 13) (Len: 1064): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong, turned around, and found a large chunk of her hair had been cut off. She was so angry that she immediately called the police. Eventually, the three parties reached a settlement, with the mother compensating the female customer 11,500 RMB, and the beauty salon, acknowledging their failure in management responsibility, had to provide 8 free hair services worth a total of 12,000 RMB. Many mainland Chinese netizens also shook their heads: 'This kind of misbehaving child will be a problem in the future,' 'Parents must bear the responsibility for the misbehavior of their children,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is bizarre,' 'Charging 10,000 RMB for a single cut, such an expensive lesson fee,' 'In fact, the beauty salon should be the one mainly responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head bald.'
   (0.735) (ID 1) (Len: 1060): The staff was preparing the hair dye and when he realized what was happening, it was already too late for him to stop it. The female customer felt there was something weird and turned her head to find that a bunch of her hair was cut off. She was so angry that she called the police immediately. Eventually, the three parties reached a settlement: the mother compensated the female customer 11,500 yuan and the beauty salon was found negligent in its management and required to provide 8 free hairdressing services worth a total of 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of mischievous kid has to be disciplined before getting out of control', 'Parents must take responsibility for their mischievous kids' actions', 'it's ridiculous that the mom was playing on her cell phone while completely ignoring her daughter', '10000 yuan for a hair cut, thats an expensive lesson', 'Really, the beauty salon should be the main one responsible', 'If it was me, I would not take the money, I would just shave the mischievous child's head'.
   (0.713) (ID 2) (Len: 947): The staff was preparing the hair dye at the time, and it was too late to stop it after discovering it. The female customer felt that there was something strange. She turned her head and saw that a large amount of her hair had been cut off. She was so angry that she called the police on the spot. Finally, the three parties reached a settlement. Compensation of 11,500 RMB for female customers, while the beauty parlor has not fulfilled its management responsibilities and must provide 8 free hairdressing services totaling 12,000 RMB. Many mainland netizens also shook their heads: 'This kind of bad boy will get it no matter what in the future', 'Parents must bear the crime of the bad boy', 'It's weird for a mother to ignore her daughter while swiping her phone', 'A knife of 10,000 is so expensive tuition fees', 'Actually, the beauty parlor should be the responsible party', 'I will not ask for money, I will directly shave the bear's head'.
   (0.648) (ID 14) (Len: 512): Many mainland netizens also shook their heads: 'No matter how this naughty child grows up, the parents must bear the responsibility for the child's misdeeds.' 'The mother was too engrossed in using her cellphone and completely ignored her daughter, which is absurd.' 'Cutting off such a large amount of hair costs 11,500 RMB, it's an expensive lesson.' 'In fact, the beauty salon should be the one held responsible.' 'If it were me, I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.628) (ID 15) (Len: 514): Many mainland netizens also shook their heads and commented: 'No matter how this mischievous child turns out in the future,' 'Parents must bear the responsibility for the mischievous child's actions,' 'The mother was completely ignoring her daughter while playing on her phone, which is ridiculous,' 'Charging 10,000 yuan for one cut, such an expensive lesson fee,' 'In fact, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money, I'd just shave the mischievous child's head.'
   (0.610) (ID 11) (Len: 540): Many mainland netizens also shook their heads: 'No matter what happens in the future, such naughty children will not be disciplined. The parents must bear the responsibility for the misbehavior of the child.' 'The mother was completely ignoring her daughter while playing with her phone, which is absurd.' 'A charge of 10,000 for a single cut, that's an expensive lesson.' 'Actually, the beauty salon should be held primarily responsible.' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head directly.'
   (0.600) (ID 8) (Len: 523): Not a few mainland netizens also shook their heads: 'No matter what, this bear-like child will have a difficult future,' 'Parents must bear the responsibility for the bear-like child's wrongdoing,' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd,' 'Charging 10,000 RMB for a single cut, what an expensive lesson,' 'Actually, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money; I would just shave the bear-like child's head directly.'
   (0.567) (ID 12) (Len: 456): Many mainland netizens also shook their heads: 'No matter how they grow up, such mischievous kids must be held responsible by their parents.' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd.' 'One cut costs 10,000; that's an expensive lesson.' 'In fact, the beauty salon should be the one primarily responsible.' 'If it were me, I wouldn't ask for money; I'd just shave the mischievous kid's head directly.'
   (0.563) (ID 7) (Len: 555): Many mainland netizens also shook their heads: 'No matter what happens in the future, this kind of misbehaving child cannot be tolerated,' 'The parents must bear the responsibility for the misbehaving child's actions,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for one cut, what an expensive lesson,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head.''
   (0.549) (ID 9) (Len: 528): Not a few mainland netizens shook their heads: 'No matter what, this mischievous child will not have a good future,' 'The parents must bear the responsibility for the mischievous child's actions,' 'The mother was so focused on using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for a single cut, that's an expensive lesson,' 'Actually, the beauty salon should be the one held responsible,' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head.'
   (0.542) (ID 5) (Len: 521): Not a few mainland netizens also shook their heads: 'No matter what, this little brat is going to suffer in the future,' 'Parents must bear the responsibility for the misdeeds of their unruly children,' 'The mom was too busy playing with her phone and completely ignored her daughter, which is absurd,' 'It costs 10,000 yuan for one cut, such an expensive tuition,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I'd just shave the little brat's head.'
   (0.528) (ID 4) (Len: 536): Not a few mainland netizens shook their heads: 'No matter what, this naughty child will suffer in the future'; 'Parents must bear the responsibility for the misbehavior of their naughty children'; 'The mother was completely ignoring her daughter while playing with her phone, which is also strange'; 'Cutting off a large chunk of hair for 10,000 yuan, such an expensive lesson'; 'Actually, the beauty salon should be the one held responsible'; 'If it were me, I wouldn't ask for money, I would just shave the naughty child's head bald'.

LaBSE

***(1.000) (ID 0) (Len: 233): 工作人員當時正在調配染髮劑，發現後上前阻止已經來不及，女客則是覺得有異樣，轉頭一看發現自己被剪掉一大磋頭髮，氣得當場報警處理，最終三方達成和解，母親賠償女客人11500人民幣，美容院則是未盡管理責任，必須免費提供8次共12000人民幣的美髮服務。 不少大陸網友也搖頭：「這種熊孩子不管以後還得了」、「熊孩子的罪，家長必須承擔」、「媽媽顧著滑手機完全不理女兒也是奇葩」、「一刀1萬，好貴的學費」、「其實美容院應該才是主責方」、「是我不會要錢，我會直接把熊孩子剃光頭」。
   (0.875) (ID 6) (Len: 974): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong and turned her head to find that a lot of her hair had been cut off. Outraged, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with ¥11,500, and the beauty salon, acknowledging their negligence, had to provide 8 free hair services worth ¥12,000. Many mainland Chinese netizens also shook their heads, saying, 'Such misbehaving children won't turn out well in the future,' 'Parents must take responsibility for the misdeeds of their children,' 'The mother was totally absorbed in her phone and completely ignored her daughter, which is ridiculous,' 'A fee of 10,000 for a single cut, that's expensive tuition,' 'Actually, the beauty salon should be held more accountable,' 'If it were me, I wouldn't ask for money; I'd just shave the misbehaving child's head.'
   (0.868) (ID 10) (Len: 939): After the staff was mixing hair dye, they discovered it too late to stop it. The female customer felt something was wrong and turned her head to find a large chunk of her hair had been cut off. Furious, she immediately called the police. Eventually, all parties reached a settlement. The mother compensated the female customer with 11,500 RMB, while the beauty salon, acknowledging its partial responsibility, agreed to provide 8 free hairdressing services worth 12,000 RMB in total. Many Chinese netizens shook their heads and commented: 'This misbehaving child won't end up well in the future,' 'Parents must bear the responsibility for the misdeeds of their children,' 'The mother was completely neglecting her daughter while playing with her phone,' 'The haircut costs a whopping 10,000 RMB,' 'Actually, the beauty salon should be held more accountable,' 'I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.865) (ID 13) (Len: 1064): The staff were mixing hair dye at the time. When they discovered it, it was too late to stop. The female customer felt something was wrong, turned around, and found a large chunk of her hair had been cut off. She was so angry that she immediately called the police. Eventually, the three parties reached a settlement, with the mother compensating the female customer 11,500 RMB, and the beauty salon, acknowledging their failure in management responsibility, had to provide 8 free hair services worth a total of 12,000 RMB. Many mainland Chinese netizens also shook their heads: 'This kind of misbehaving child will be a problem in the future,' 'Parents must bear the responsibility for the misbehavior of their children,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is bizarre,' 'Charging 10,000 RMB for a single cut, such an expensive lesson fee,' 'In fact, the beauty salon should be the one mainly responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head bald.'
   (0.860) (ID 2) (Len: 947): The staff was preparing the hair dye at the time, and it was too late to stop it after discovering it. The female customer felt that there was something strange. She turned her head and saw that a large amount of her hair had been cut off. She was so angry that she called the police on the spot. Finally, the three parties reached a settlement. Compensation of 11,500 RMB for female customers, while the beauty parlor has not fulfilled its management responsibilities and must provide 8 free hairdressing services totaling 12,000 RMB. Many mainland netizens also shook their heads: 'This kind of bad boy will get it no matter what in the future', 'Parents must bear the crime of the bad boy', 'It's weird for a mother to ignore her daughter while swiping her phone', 'A knife of 10,000 is so expensive tuition fees', 'Actually, the beauty parlor should be the responsible party', 'I will not ask for money, I will directly shave the bear's head'.
   (0.852) (ID 3) (Len: 946): The staff was dispensing hair dye at the time, and after finding that it was too late to stop it, the female customer felt something different, turned her head and found that she had been cut off a large amount of hair, so angry that she called the police on the spot, and finally the three parties reached a settlement, the mother compensated the female guest for 11,500 yuan, and the beauty salon did not fulfill its management responsibilities, and must provide 8 free hairdressing services totaling 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of bear child will not be repaid in the future', 'The sin of the bear child, parents must bear it', 'It is strange for the mother to ignore her daughter completely by taking care of the mobile phone', '10,000 by knife, expensive tuition', 'In fact, the beauty salon should be the responsible party', 'I will not ask for money, I will directly shave the bear child's head'.
   (0.847) (ID 1) (Len: 1060): The staff was preparing the hair dye and when he realized what was happening, it was already too late for him to stop it. The female customer felt there was something weird and turned her head to find that a bunch of her hair was cut off. She was so angry that she called the police immediately. Eventually, the three parties reached a settlement: the mother compensated the female customer 11,500 yuan and the beauty salon was found negligent in its management and required to provide 8 free hairdressing services worth a total of 12,000 yuan. Many mainland netizens also shook their heads: 'This kind of mischievous kid has to be disciplined before getting out of control', 'Parents must take responsibility for their mischievous kids' actions', 'it's ridiculous that the mom was playing on her cell phone while completely ignoring her daughter', '10000 yuan for a hair cut, thats an expensive lesson', 'Really, the beauty salon should be the main one responsible', 'If it was me, I would not take the money, I would just shave the mischievous child's head'.
   (0.742) (ID 7) (Len: 555): Many mainland netizens also shook their heads: 'No matter what happens in the future, this kind of misbehaving child cannot be tolerated,' 'The parents must bear the responsibility for the misbehaving child's actions,' 'The mother was so engrossed in using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for one cut, what an expensive lesson,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I would just shave the misbehaving child's head.''
   (0.740) (ID 8) (Len: 523): Not a few mainland netizens also shook their heads: 'No matter what, this bear-like child will have a difficult future,' 'Parents must bear the responsibility for the bear-like child's wrongdoing,' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd,' 'Charging 10,000 RMB for a single cut, what an expensive lesson,' 'Actually, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money; I would just shave the bear-like child's head directly.'
   (0.739) (ID 14) (Len: 512): Many mainland netizens also shook their heads: 'No matter how this naughty child grows up, the parents must bear the responsibility for the child's misdeeds.' 'The mother was too engrossed in using her cellphone and completely ignored her daughter, which is absurd.' 'Cutting off such a large amount of hair costs 11,500 RMB, it's an expensive lesson.' 'In fact, the beauty salon should be the one held responsible.' 'If it were me, I wouldn't ask for money; I would directly shave the misbehaving child's head.'
   (0.738) (ID 5) (Len: 521): Not a few mainland netizens also shook their heads: 'No matter what, this little brat is going to suffer in the future,' 'Parents must bear the responsibility for the misdeeds of their unruly children,' 'The mom was too busy playing with her phone and completely ignored her daughter, which is absurd,' 'It costs 10,000 yuan for one cut, such an expensive tuition,' 'In fact, the beauty salon should be the one held primarily responsible,' 'If it were me, I wouldn't ask for money; I'd just shave the little brat's head.'
   (0.733) (ID 9) (Len: 528): Not a few mainland netizens shook their heads: 'No matter what, this mischievous child will not have a good future,' 'The parents must bear the responsibility for the mischievous child's actions,' 'The mother was so focused on using her phone that she completely ignored her daughter, which is absurd,' 'Charging 10,000 yuan for a single cut, that's an expensive lesson,' 'Actually, the beauty salon should be the one held responsible,' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head.'
   (0.729) (ID 4) (Len: 536): Not a few mainland netizens shook their heads: 'No matter what, this naughty child will suffer in the future'; 'Parents must bear the responsibility for the misbehavior of their naughty children'; 'The mother was completely ignoring her daughter while playing with her phone, which is also strange'; 'Cutting off a large chunk of hair for 10,000 yuan, such an expensive lesson'; 'Actually, the beauty salon should be the one held responsible'; 'If it were me, I wouldn't ask for money, I would just shave the naughty child's head bald'.
   (0.718) (ID 12) (Len: 456): Many mainland netizens also shook their heads: 'No matter how they grow up, such mischievous kids must be held responsible by their parents.' 'The mother, engrossed in using her phone, completely ignored her daughter, which is also absurd.' 'One cut costs 10,000; that's an expensive lesson.' 'In fact, the beauty salon should be the one primarily responsible.' 'If it were me, I wouldn't ask for money; I'd just shave the mischievous kid's head directly.'
   (0.715) (ID 15) (Len: 514): Many mainland netizens also shook their heads and commented: 'No matter how this mischievous child turns out in the future,' 'Parents must bear the responsibility for the mischievous child's actions,' 'The mother was completely ignoring her daughter while playing on her phone, which is ridiculous,' 'Charging 10,000 yuan for one cut, such an expensive lesson fee,' 'In fact, the beauty salon should be held more responsible,' 'If it were me, I wouldn't ask for money, I'd just shave the mischievous child's head.'
   (0.701) (ID 11) (Len: 540): Many mainland netizens also shook their heads: 'No matter what happens in the future, such naughty children will not be disciplined. The parents must bear the responsibility for the misbehavior of the child.' 'The mother was completely ignoring her daughter while playing with her phone, which is absurd.' 'A charge of 10,000 for a single cut, that's an expensive lesson.' 'Actually, the beauty salon should be held primarily responsible.' 'If it were me, I wouldn't ask for money; I would just shave the mischievous child's head directly.'