Article View: pl.comp.programming
Article #216735Re: Detekcja strony kodowej (Bayes?)
From: M.M.
Date: Thu, 09 Jan 2020 08:45
Date: Thu, 09 Jan 2020 08:45
25 lines
2615 bytes
2615 bytes
On Saturday, December 28, 2019 at 9:15:02 AM UTC+1, Borneq wrote: > W dniu 2019-12-27 o 20:34, Mateusz Viste pisze: > > To może dałoby się załatwić oba problemy jednym podejściem? Wygenerować > > sobie dla każdego języka zestaw tablic częstotliwości - po jednej na > > każde dopuszczalne kodowanie, i sprawdzać swój plik na tej podstawie - > > jeśli szczęście dopisze, to mamy wykrywanie język+strona. Tylko do > > tego, jeśli to w ogóle ma statystyczną szansę zadziałać, trzeba mieć > > sporą próbkę materiału. > > > > Mateusz > > > > sprawdze czy zadziala Zobacz jeszcze to: https://softwareengineering.stackexchange.com/questions/187169/how-to-detect-the-encoding-of-a-file Cytat: [ Files generally indicate their encoding with a file header. There are many examples here. However, even reading the header you can never be sure what encoding a file is really using. For example, a file with the first three bytes 0xEF,0xBB,0xBF is probably a UTF-8 encoded file. However, it might be an ISO-8859-1 file which happens to start with the characters . Or it might be a different file type entirely. ] Pozdrawiam
Technical Details
Message-ID:
<2044874e-9745-4bcb-bb2a-b47e637f1747@googlegroups.com>Path:
mbox-mo1.pugleaf.net!news-archive.icm.edu.pl!news.icm.edu.pl!newsfeed.pionier.net.pl!feeder.erje.net!2.eu.feeder.erje.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!g89no2698445qtd.0!news-out.google.com!w29ni380qtc.0!nntp.google.com!g89no2698427qtd.0!postnews.google.com!google-groups.googlegroups.com!not-for-mailReferences:
<5e060cd2$0$511$65785112@news.neostrada.pl> <20191227152725.50c0c2f8@mateusz> <5e06316a$0$17346$65785112@news.neostrada.pl> <20191227203426.75e401f5@mateusz> <5e070e04$0$17363$65785112@news.neostrada.pl>Show Full Headers
Complete Article Headers
X-Received: by 2002:a05:620a:10a7:: with SMTP id h7mr8297335qkk.423.1578559544885; Thu, 09 Jan 2020 00:45:44 -0800 (PST) X-Received: by 2002:a05:620a:13fa:: with SMTP id h26mr8314871qkl.150.1578559544260; Thu, 09 Jan 2020 00:45:44 -0800 (PST) Path: mbox-mo1.pugleaf.net!news-archive.icm.edu.pl!news.icm.edu.pl!newsfeed.pionier.net.pl!feeder.erje.net!2.eu.feeder.erje.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!g89no2698445qtd.0!news-out.google.com!w29ni380qtc.0!nntp.google.com!g89no2698427qtd.0!postnews.google.com!google-groups.googlegroups.com!not-for-mail Newsgroups: pl.comp.programming Date: Thu, 9 Jan 2020 00:45:43 -0800 (PST) In-Reply-To: <5e070e04$0$17363$65785112@news.neostrada.pl> Complaints-To: groups-abuse@google.com Injection-Info: google-groups.googlegroups.com; posting-host=159.205.34.176; posting-account=xjvq9QoAAAATMPC2X3btlHd_LkaJo_rj NNTP-Posting-Host: 159.205.34.176 References: <5e060cd2$0$511$65785112@news.neostrada.pl> <20191227152725.50c0c2f8@mateusz> <5e06316a$0$17346$65785112@news.neostrada.pl> <20191227203426.75e401f5@mateusz> <5e070e04$0$17363$65785112@news.neostrada.pl> User-Agent: G2/1.0 MIME-Version: 1.0 Message-ID: <2044874e-9745-4bcb-bb2a-b47e637f1747@googlegroups.com> Subject: Re: Detekcja strony kodowej (Bayes?) From: "M.M." <mmarszik@gmail.com> Injection-Date: Thu, 09 Jan 2020 08:45:44 +0000 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit