新聞財經娛樂♬資訊 News Economy

Thanks for your pt

Have a nice working day

Duncan

Just try those command I posted

such as  tr, sed, vi    

or send us your issue file if it is not too big

Otherwise, I have no more idea or room for your issue
and I will quit this thread

have a nice day

Duncan

I found the solution through browsing. Thank for you very much.

I see ^M character as well and it certainly is not printable. <92> is a non-printable character for apostrophe. How do I search for it is my issue.

if you actually see the <92> that is printable char

so why not just

:s/<92>/x/  to replace to x  or delete it

DUncan

I tried, after vi-ing the file:
:s/x92/ /

It tells me:
Pattern not found: x92

whereas I clearly see the <92> in the file.

Dear soccerplayer,

On linux shell , you can dos2unix command covert the fle from dos to unix format
On vi editor, you can convert the file from dos to unix format by command

:set fileformat=unix

If those don't help at all,

-try it in VI to detele ^M

:s/^M/x /   ###that will convert ^M to x or other char you like. you can type ctrl-v to
get "^"

-for<92>,  <93>, I believe that is extended ascill code in Hex
http://www.ascii-code.com/, and that are  ’  and  “ respectively

-try it in VI to replace or delete

:s/x92/x/   ###-replace hex92 to x
:s/x93/x/   ###-repace hex93 to x

If you send us the file, that will be easier for us to help

Duncan

Can you tell me if I have a non-printable character such as <92>, <93> or ^M., how do I search for it using vi? That's all I need to know.

Could you send your issue file to us so that we can  solve it ?

After sending your file, please download the file you send to us and
test it at your side again to cehck whether it is issue file you're talking about
that action is helping we will receive the correct issue file you sent for cross-check
If not repeat your issue at our side , it might be related to unix and dos format file issue


Duncan

Two questions:

1) How do I search after getting into vi? I tried doing:
/<92>
It didn't work.

2) How do I find out what the values of these characters are?

Thanks.

you can try 92 as 33 in my example  if it is non-printable.

And please review those post I wrote in this thread.


Duncan

<92> is not a string. It is a non-printable character in my file just like ^M. My biggest problem is, I have them in my file but how do I search for them?

When I did a vi file_name, I found some characters such as <92> and <93>. I am trying to find out how I can search for them and replace them if needed.

To remove ^M, you can do this as follows , what your mean <90> ?  you mean 90 in DEC
at http://www.asciitable.com/

Duncan

How we can solve it then?
To Solve ^M at last in each line we can do following things:
1-Linux Command shell
     dos2unix file-name new-file-name
     (dos2unix is a Linux utility tool which can convert windows oriented file to Linux compatible, so it will remove ^M        automatically from the end of each line
 
2-By setting vim configuration file i.e. .vimrc
        Open .vimrc which will be at your home location i.e. /home/aliencoders/.vimrc
        And save this line
        set ffs=unix,dos
 
3-By editing the file manually . Open test.txt in vim editor and use the following command to substitute in command mode i.e after pressing esc button.
       :1,$s/^M//g or :%s/^M//g     (Actually ctrl+v and ctrl+ M will show you ^M)
 
4-By using strings command in Linux. This command can omit all non-printable characters from the file.
       strings file-name > new-file-name
      Now, this new-file-name will not contain those non-printable characters.

Taken from www.aliencoders.com/content/how-remove-m-and-other-non-printable-characters-file-linux?page=1

duncanb7, your link allows me to remove characters. What if I want to replace them? For example, I came across characters such as ^M and <92> or <93>. Questions:

1) What are the actual characters for <92> and <93> in Unix?
2) How do I replace them with a space or some printable character?

Please try this tr command,
tr -cd '11121540-176'  yourfile.txt(with non-printable char)  outputfile.txt(take out all non-printable char)


Please take a look at this article that might help
http://alvinalexander.com/blog/post/linux-unix/how-remove-non-printable-ascii-characters-file-unix
http://www.asciitable.com/


Hope understand your question completely, if not please point it out


Duncan