Thomas Goyne
|
983ffc1e83
|
Add some dumb heuristics to detect binary files in the charset detector to avoid taking forever feeding hundreds of MB through it. Closes #1438.
Originally committed to SVN as r6405.
|
2012-01-31 04:03:55 +00:00 |
|
Thomas Goyne
|
d68a395499
|
Open files in binary mode for charset detection
Originally committed to SVN as r6404.
|
2012-01-31 04:03:50 +00:00 |
|
Amar Takhar
|
c2a81a5dd7
|
Add a cast to make x64 build on windows happy.
Originally committed to SVN as r5155.
|
2011-01-09 02:49:49 +00:00 |
|
Niels Martin Hansen
|
a13e0ddedf
|
Clear out some warnings emitted by Visual C++ 2010.
On 32 bit VC 2010, std::streamsize is 64 bit while size_t is 32 bit.
Originally committed to SVN as r5151.
|
2011-01-08 21:58:48 +00:00 |
|
Amar Takhar
|
944eaa535e
|
Remove universalchardet headers from the precompiled header. For some reason this was causing issues with compliation on FreeBSD, rather than investigate why I removed it since it's used by exactly 1 file (charset_ucd.cpp). If it's going to cause one problem now it may cause another later that we may not notice.
Originally committed to SVN as r4919.
|
2010-12-08 14:32:30 +00:00 |
|
Thomas Goyne
|
2b47f34e76
|
Fix a pile of actual memory leaks
Originally committed to SVN as r4575.
|
2010-06-24 01:24:09 +00:00 |
|
Thomas Goyne
|
75bd20a6dd
|
Fix the rest of the build errors when not using precompiled headers
Originally committed to SVN as r4530.
|
2010-06-17 00:23:44 +00:00 |
|
Amar Takhar
|
340cc1d7f1
|
Fix compilation with precompiled headers disabled.
Originally committed to SVN as r4504.
|
2010-06-14 18:02:58 +00:00 |
|
Amar Takhar
|
9d854b69f3
|
Don't bother storing storing a single charset into an std::string, instead insert it into the std::map and fix Single() to return the first element. This keeps things simple and also ensures that DetectAll() will always return atleast one element which wasn't being done before.
Originally committed to SVN as r4369.
|
2010-05-28 13:08:00 +00:00 |
|
Amar Takhar
|
6736f5e292
|
Add a change that was missed in r4367.
Originally committed to SVN as r4368.
|
2010-05-28 08:04:55 +00:00 |
|
Amar Takhar
|
e408fe49c9
|
Add support for detecting character sets using UniversalChardet -- this superceeds character_detect.cpp.
Originally committed to SVN as r4367.
|
2010-05-28 07:40:21 +00:00 |