将UTF-8字符序列转换为实际的UTF-8字节

问题描述：

我有一个纯文本文件（.yml），其中包含这样的UTF-8字符序列：

I have a plain text-file (.yml) that contains UTF-8 character sequences like this:

foo： Dette er en \xC3\ xB8

foo: "Dette er en \xC3\xB8 "

问题出在\xC3\xB8-这些不是真实的 UTF-8字节，因为它们以8个实际的形式保存在文本文件中字符：\ x C 3 \ x B 8

The problem lies in \xC3\xB8 - These are not "real" UTF-8 bytes, since they are saved in the text file as 8 actual characters: \ x C 3 \ x B 8

有没有办法将这些转换成真正的2字节UTF-8序列？

Is there a way to get these converted into the real 2-bytes UTF-8 sequence?

可以使用任何操作系统/语言/ Shell工具：-）

Any OS / Language / Shell-tool may be used :-)

/ Carsten

答

使用以下perl脚本转换文件：

Use this perl script to convert your file:

#!/usr/bin/perl
while (<STDIN>) {
  $_ =~ s/\\x([0-9A-F][0-9A-F])/chr(hex($1))/eg;
  print $_;
}

让我们假设您使用 bogusutf命名了一个脚本文件，然后使用以下命令进行转换：

Let's assume you named a file with script as bogusutf, then do the conversion with this command:

$ perl bogusutf < inputfile> outputfile