<head>
<title>What's New in this Release</title>
<meta name="GENERATOR" content="Modular DocBook HTML Stylesheet Version 1.79">
- <link rel="HOME" title="Privoxy 3.0.27 User Manual" href="index.html">
+ <link rel="HOME" title="Privoxy 3.0.33 User Manual" href="index.html">
<link rel="PREVIOUS" title="Installation" href="installation.html">
<link rel="NEXT" title="Quickstart to Using Privoxy" href="quickstart.html">
<link rel="STYLESHEET" type="text/css" href="../p_doc.css">
- <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
+ <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<link rel="STYLESHEET" type="text/css" href="p_doc.css">
</head>
<body class="SECT1" bgcolor="#EEEEEE" text="#000000" link="#0000FF" vlink="#840084" alink="#0000FF">
<div class="NAVHEADER">
<table summary="Header navigation table" width="100%" border="0" cellpadding="0" cellspacing="0">
<tr>
- <th colspan="3" align="center">Privoxy 3.0.27 User Manual</th>
+ <th colspan="3" align="center">Privoxy 3.0.33 User Manual</th>
</tr>
<tr>
<td width="10%" align="left" valign="bottom"><a href="installation.html" accesskey="P">Prev</a></td>
</div>
<div class="SECT1">
<h1 class="SECT1"><a name="WHATSNEW" id="WHATSNEW">3. What's New in this Release</a></h1>
- <p><span class="APPLICATION">Privoxy 3.0.26</span> stable is a bug-fix release for the previously released 3.0.25
- beta which introduced client-specific tags and included a couple of minor improvements.</p>
+ <p><span class="APPLICATION">Privoxy 3.0.33</span> fixes an XSS issue and multiple DoS issues and a couple of other
+ bugs. The issues also affect earlier Privoxy releases. <span class="APPLICATION">Privoxy 3.0.33</span> also comes
+ with a couple of general improvements and new features.</p>
+ <p>Changes in <span class="APPLICATION">Privoxy 3.0.33</span> stable:</p>
<ul>
<li>
- <p>Bug fixes:</p>
+ <p>Security/Reliability:</p>
<ul>
<li>
- <p>Fixed crashes with "listen-addr :8118" (SF Bug #902). The regression was introduced in 3.0.25 beta and
- reported by Marvin Renich in Debian bug #834941.</p>
+ <p>cgi_error_no_template(): Encode the template name to prevent XSS (cross-site scripting) when Privoxy is
+ configured to servce the user-manual itself. Commit 0e668e9409c. OVE-20211102-0001. CVE-2021-44543.
+ Reported by: Artem Ivanov</p>
+ </li>
+ <li>
+ <p>get_url_spec_param(): Free memory of compiled pattern spec before bailing. Reported by Joshua Rogers
+ (Opera) who also provided the fix. Commit 652b4b7cb0. OVE-20211201-0003. CVE-2021-44540.</p>
+ </li>
+ <li>
+ <p>process_encrypted_request_headers(): Free header memory when failing to get the request destination.
+ Reported by Joshua Rogers (Opera) who also provided the fix. Commit 0509c58045. OVE-20211201-0002.
+ CVE-2021-44541.</p>
+ </li>
+ <li>
+ <p>send_http_request(): Prevent memory leaks when handling errors Reported by Joshua Rogers (Opera) who
+ also provided the fix. Commit c48d1d6d08. OVE-20211201-0001. CVE-2021-44542.</p>
</li>
</ul>
</li>
<li>
- <p>General improvements:</p>
+ <p>Bug fixes:</p>
<ul>
<li>
- <p>Log when privoxy is toggled on or off via cgi interface.</p>
+ <p>handle_established_connection(): Skip the poll()/select() calls if TLS data is pending on the server
+ socket. The TLS library may have already consumed all the data from the server response in which case
+ poll() and select() will not detect that data is available to be read. Fixes SF bug #926 reported by Wen
+ Yue.</p>
+ </li>
+ <li>
+ <p>continue_https_chat(): Update csp->server_connection.request_sent after sending the request to make
+ sure the latency is calculated correctly. Previously https connections were not reused after timeout
+ seconds after the first request made on the connection.</p>
+ </li>
+ <li>
+ <p>free_pattern_spec(): Don't try to free an invalid pointer when unloading an action file with a TAG
+ pattern while Privoxy has been compiled without FEATURE_PCRE_HOST_PATTERNS. Closes: SF patch request #147.
+ Patch by Maxim Antonov.</p>
+ </li>
+ <li>
+ <p>Adjust build_request_line() to create a CONNECT request line when https-inspecting and forwarding to a
+ HTTP proxy. Fixes SF bug #925 reported by Wen Yue.</p>
</li>
<li>
- <p>Highlight the "Info: Now toggled " on/off log message in the Windows log viewer.</p>
+ <p>load_config(): Add a space that was missing in a log message.</p>
</li>
<li>
- <p>Highlight the loading actions/filter file log message in the Windows log viewer.</p>
+ <p>read_http_request_body(): Fix two error messages that used an incorrect variable.</p>
</li>
<li>
- <p>Mention client-specific tags on the toggle page as a potentionally more appropriate alternative.</p>
+ <p>If the the response is chunk-encoded, ignore the Content-Length header sent by the server. Allows to
+ load https://redmine.lighttpd.net/ with filtering enabled.</p>
</li>
</ul>
</li>
<li>
- <p>Documentation improvements:</p>
+ <p>General improvements:</p>
<ul>
<li>
- <p>Update download section on the homepage. The downloads are available from the website now.</p>
+ <p>Allow to edit the add-header action through the CGI editor by generalizing the code that got added with
+ the suppress-tag action. Closes SF patch request #146. Patch by Maxim Antonov.</p>
</li>
<li>
- <p>Add sponsor FAQ.</p>
+ <p>Add a CGI handler for /wpad.dat that returns a Proxy Auto-Configuration (PAC) file. Among other things,
+ it can be used to instruct clients through DHCP to use Privoxy as proxy. For example with the dnsmasq
+ option: dhcp-option=252,http://config.privoxy.org/wpad.dat Initial patch by Richard Schneidt.</p>
</li>
<li>
- <p>Remove obsolete reference to mailing lists hosted at SourceForge.</p>
+ <p>Don't log the applied actions in process_encrypted_request() Log them in continue_https_chat() instead
+ to mirror chat(). Prevents the applied actions from getting logged twice for the first request on an
+ https-inspected connection.</p>
</li>
<li>
- <p>Update the "Before the Release" section of the developer manual.</p>
+ <p>OpenSSL generate_host_certificate(): Use config.privoxy.org as Common Name Org and Org Unit if the real
+ host name is too long to get accepted by OpenSSL. Clients should only care about the Subject Alternative
+ Name anyway and we can continue to use the real host name for it. Reported by Miles Wen on
+ privoxy-users@.</p>
</li>
- </ul>
- </li>
- <li>
- <p>Infrastructure improvements:</p>
- <ul>
<li>
- <p>Add perl script to generate an RSS feed for the packages Submitted by "Unknown".</p>
+ <p>Establish the TLS connection with the client earlier and decide how to route the request afterwards.
+ This allows to change the forwarding settings based on information from the https-inspected request, for
+ example the path.</p>
</li>
- </ul>
- </li>
- <li>
- <p>Build system improvements:</p>
- <ul>
<li>
- <p>strptime.h: fix a compiler warning about ambiguous else.</p>
+ <p>listen_loop(): When shutting down gracefully, close listening ports before waiting for the threads to
+ exit. Allows to start a second Privoxy with the same config file while the first Privoxy is still
+ running.</p>
</li>
<li>
- <p>configure.in: Check for Docbook goo on the BSDs as well.</p>
+ <p>serve(): Close the client socket as well if the server socket for an inspected connection has been
+ closed. Privoxy currently can't establish a new server connection when the client socket is reused and
+ would drop the connection in continue_https_chat() anyway.</p>
</li>
<li>
- <p>GNUMakefile.in: Let the dok-user target remove temporary files.</p>
+ <p>Don't disable redirect checkers in redirect_url(). Disable them in handle_established_connection()
+ instead. Doing it in redirect_url() prevented the +redirect{} and +fast-redirects{} actions from being
+ logged with LOG_LEVEL_ACTIONS.</p>
</li>
- </ul>
- </li>
- </ul>
- <p>Changes between <span class="APPLICATION">Privoxy 3.0.25 beta</span> and the previous release:</p>
- <ul>
- <li>
- <p>Bug fixes:</p>
- <ul>
<li>
- <p>Always use the current toggle state for new requests. Previously new requests on reused connections
- inherited the toggle state from the previous request even though the toggle state could have changed.
- Reported by Robert Klemme.</p>
+ <p>handle_established_connection(): Slightly improve a comment.</p>
</li>
<li>
- <p>Fixed two buffer-overflows in the (deprecated) static pcre code. These bugs are not considered security
- issues as the input is trusted. Found with afl-fuzz and ASAN.</p>
+ <p>handle_established_connection(): Fix a comment.</p>
</li>
- </ul>
- </li>
- <li>
- <p>General improvements:</p>
- <ul>
<li>
- <p>Added support for client-specific tags which allow Privoxy admins to pre-define tags that are set for
- all requests from clients that previously opted in through the CGI interface. They are useful in multi-user
- setups where admins may want to allow users to disable certain actions and filters for themselves without
- affecting others. In single-user setups they are useful to allow more fine-grained toggling. For example to
- disable request blocking while still crunching cookies, or to disable experimental filters only. This is an
- experimental feature, the syntax and behaviour may change in future versions. Sponsored by Robert
- Klemme.</p>
+ <p>socks5_connect(): Fix indentation.</p>
</li>
<li>
- <p>Dynamic filters and taggers now support a $listen-address variable which contains the address the
- request came in on. For external filters the variable is called $PRIVOXY_LISTEN_ADDRESS. Original patch
- contributed by pursievro.</p>
+ <p>handle_established_connection(): Improve an error message.</p>
</li>
<li>
- <p>Add client-header-tagger 'listen-address'.</p>
+ <p>create_pattern_spec(): Fix ifdef indentation.</p>
</li>
<li>
- <p>Include the listen-address in the log message when logging new requests. Patch contributed by
- pursievro.</p>
+ <p>Fix comment typos.</p>
</li>
<li>
- <p>Turn invalid max-client-connections values into fatal errors.</p>
+ <p>process_encrypted_request(): Improve a log message. The function only processes request headers and
+ there may still be unread request body data left to process.</p>
</li>
<li>
- <p>The show-status page now shows whether or not dates before 1970 and after 2038 are expected to be
- handled properly. This is mainly useful for Privoxy-Regression-Test but could also come handy when dealing
- with time-related support requests.</p>
+ <p>chat(): Log the applied actions before deciding how to forward the request.</p>
</li>
<li>
- <p>On Mac OS X the thread id in log messages are more likely to be unique now.</p>
+ <p>parse_time_header(): Silence a coverity complaint when building without assertions.</p>
</li>
<li>
- <p>When complaining about missing filters, the filter type is logged as well.</p>
+ <p>receive_encrypted_request_headers(): Improve a log message.</p>
</li>
<li>
- <p>A couple of harmless coverity warnings were silenced (CID #161202, CID #161203, CID #161211).</p>
+ <p>mbedTLS get_ciphersuites_from_string(): Use strlcpy() instead of strncpy(). Previously the terminating
+ NUL wasn't copied which resulted in a compiler warning. This didn't cause actual problems as the target
+ buffer was initialized by zalloc_or_die() so the last byte of the target buffer was NUL already. Actually
+ copying the terminating NUL seems clearer, though.</p>
+ </li>
+ <li>
+ <p>Remove compiler warnings. "log_error(LOG_LEVEL_FATAL, ..." doesn't return but apparently the compiler
+ doesn't know that. Get rid of several "this statement may fall through [-Wimplicit-fallthrough=]"
+ warnings.</p>
+ </li>
+ <li>
+ <p>Store the PEM certificate in a dynamically allocated buffer when https-inspecting. Should prevent errors
+ like: 2021-03-16 22:36:19.148 7f47bbfff700 Error: X509 PEM cert len 16694 is larger than buffer len 16383
+ As a bonus it should slightly reduce the memory usage as most certificates are smaller than the previously
+ used fixed buffer. Reported by: Wen Yue</p>
+ </li>
+ <li>
+ <p>OpenSSL generate_host_certificate(): Fix two error messsages.</p>
</li>
- </ul>
- </li>
- <li>
- <p>Action file improvements:</p>
- <ul>
<li>
- <p>Filtering is disabled for Range requests to let download resumption and Windows updates work with the
- default configuration.</p>
+ <p>Improve description of handle_established_connection()</p>
</li>
<li>
- <p>Unblock ".ardmediathek.de/". Reported by ThTomate in #932.</p>
+ <p>OpenSSL ssl_store_cert(): Translate EVP_PKEY_EC to a string.</p>
+ </li>
+ <li>
+ <p>OpenSSL ssl_store_cert(): Remove pointless variable initialization.</p>
+ </li>
+ <li>
+ <p>OpenSSL ssl_store_cert(): Initialize pointer with NULL instead of 0.</p>
</li>
</ul>
</li>
<li>
- <p>Documentation improvements:</p>
+ <p>Action file improvements:</p>
<ul>
<li>
- <p>Add FAQ entry for crashes caused by memory limits.</p>
+ <p>Disable fast-redirects for .microsoftonline.com/.</p>
+ </li>
+ <li>
+ <p>Disable fast-redirects for idp.springer.com/.</p>
</li>
<li>
- <p>Remove obsolete FAQ entry about a bug in PHP 4.2.3.</p>
+ <p>Disable fast-redirects for .zeit.de/zustimmung.</p>
</li>
<li>
- <p>Mention the new mailing lists were appropriate. As the archives have not been migrated, continue to
- mention the archives at SF in the contacting section for now.</p>
+ <p>Unblock adv-archiv.dfn-cert.de/.</p>
</li>
<li>
- <p>Note that the templates should be adjusted if Privoxy is running as intercepting proxy without getting
- all requests.</p>
+ <p>Block requests to eu-tlp01.kameleoon.eu/.</p>
</li>
<li>
- <p>A bunch of links were converted to https://.</p>
+ <p>Block requests to fpa-events.arstechnica.com/.</p>
</li>
<li>
- <p>Rephrase onion service paragraph to make it more obvious that Tor is involved and that the whole website
- (and not just the homepage) is available as onion service.</p>
+ <p>Unblock nlnet.nl/.</p>
</li>
<li>
- <p>Streamline the "More information" section on the homepage further by additionally ditching the link to
- the 'See also' section of the user manual. The section contains mostly links that are directly reachable
- from the homepage already and the rest is not significant enough to get a link from the homepage.</p>
+ <p>Unblock adguard.com/.</p>
</li>
+ </ul>
+ </li>
+ <li>
+ <p>Privoxy-Log-Parser:</p>
+ <ul>
<li>
- <p>Change the add-header{} example to set the DNT header and use a complete section to make copy and
- pasting more convenient. Add a comment to make it obvious that adding the header is not recommended for
- obvious reasons. Using the DNT header as example was suggested by Leo Wzukw.</p>
+ <p>Highlight 'Socket timeout 3 reached: http://127.0.0.1:20000/no-filter/chunked-content/36'.</p>
</li>
<li>
- <p>Streamline the support-and-service template Instead of linking to the various support trackers (whose
- URLs hopefully change soon), link to the contact section of the user manual to increase the chances that
- users actually read it.</p>
+ <p>Improve documentation for inactivity-detection mode.</p>
</li>
<li>
- <p>Add a FAQ entry for tainted sockets.</p>
+ <p>Detect date changes when looking for inactivity.</p>
</li>
<li>
- <p>More sections in the documentation have stable URLs now.</p>
+ <p>Add a --passed-request-statistics-threshold option that can be set to get statistics for requests that
+ were passed.</p>
</li>
<li>
- <p>FAQ: Explain why 'ping config.privoxy.org' is not expected to reach a local Privoxy installation.</p>
+ <p>Add a "inactivity detection" mode which can be useful for debugging purposes.</p>
</li>
<li>
- <p>Note that donations done through Zwiebelfreunde e.V. currently can't be checked automatically.</p>
+ <p>Bump version to 0.9.4.</p>
</li>
<li>
- <p>Updated section regarding starting Privoxy under OS X.</p>
+ <p>Only run print_intro() and print_outro() when syntax highlighting.</p>
</li>
<li>
- <p>Use dedicated start instructions for FreeBSD and ElectroBSD.</p>
+ <p>Rephrase a sentence in the documentation.</p>
</li>
<li>
- <p>Removed release instructions for AIX. They haven't been working for years and unsurprisingly nobody
- seems to care.</p>
+ <p>Highlight 'Client socket 7 is no longer usable. The server socket has been closed.'.</p>
</li>
<li>
- <p>Removed obsolete reference to the solaris-dist target.</p>
+ <p>Clarify --statistics output by explicitly mentioning that the status codes sent by the server may differ
+ from the ones in "debug 512" messages.</p>
</li>
<li>
- <p>Updated the release instructions for FreeBSD.</p>
+ <p>Fix typo in the --statistics output.</p>
</li>
<li>
- <p>Removed unfinished release instructions for Amiga OS and HP-UX 11.</p>
+ <p>Remove an unused variable.</p>
</li>
<li>
- <p>Added a pointer to the Cygwin Time Machine for getting the last release of Cygwin version 1.5 to use for
- building Privoxy on Windows.</p>
+ <p>Highlight 'The peer notified us that the connection on socket 11 is going to be closed'.</p>
</li>
+ </ul>
+ </li>
+ <li>
+ <p>Privoxy-Regression-Test:</p>
+ <ul>
<li>
- <p>Various typos have been fixed.</p>
+ <p>Remove duplicated word in a comment.</p>
</li>
</ul>
</li>
<li>
- <p>Infrastructure improvements:</p>
+ <p>regression-tests.action:</p>
<ul>
<li>
- <p>The website is no longer hosted at SourceForge and can be reached through https now.</p>
+ <p>Add fetch test for http://p.p/wpad.dat.</p>
+ </li>
+ <li>
+ <p>Bump for-privoxy-version to 3.0.33 which introduced the wpad.dat support.</p>
</li>
<li>
- <p>The mailing lists at SourceForge have been deprecated, you can subscribe to the new ones at:
- https://lists.privoxy.org/</p>
+ <p>Add more tests for the '/send-banner' code.</p>
</li>
<li>
- <p>Migrating the remaining services from SourceForge is work in progress (TODO list item #53).</p>
+ <p>Add test for OVE-20210203-0001.</p>
+ </li>
+ <li>
+ <p>Add a test for CVE-2021-20217.</p>
</li>
</ul>
</li>
<li>
- <p>Build system improvements:</p>
+ <p>uagen:</p>
<ul>
<li>
- <p>Add configure argument to optimistically redefine FD_SETSIZE with the intent to change the maximum
- number of client connections Privoxy can handle. Only works with some libcs. Sponsored by Robert
- Klemme.</p>
+ <p>Bump generated Firefox version to 91 (ESR).</p>
</li>
<li>
- <p>Let the tarball-dist target skip files in ".git".</p>
+ <p>Bump version to 1.2.3.</p>
</li>
<li>
- <p>Let the tarball-dist target work in cwds other than current.</p>
+ <p>Bump copyright.</p>
</li>
+ </ul>
+ </li>
+ <li>
+ <p>Build system:</p>
+ <ul>
<li>
- <p>Make the 'clean' target faster when run from a git repository.</p>
+ <p>configure: Bump SOURCE_DATE_EPOCH.</p>
</li>
<li>
- <p>Include tools in the generic distribution.</p>
+ <p>GNUmakefile.in: Fix typo.</p>
</li>
<li>
- <p>Let the gen-dist target work in cwds other than current.</p>
+ <p>configure: Add another warning in case --disable-pthread is used while POSIX threads are available.
+ Various features don't even compile when not using threads.</p>
</li>
<li>
- <p>Sort find output that is used for distribution tarballs to get reproducible results.</p>
+ <p>Add configure option to enable MemorySanitizer.</p>
</li>
<li>
- <p>Don't add '-src' to the name of the tar ball generated by the gen-dist target. The package isn't a
- source distribution but a binary package. While at it, use a variable for the name to reduce the chances
- that the various references get out of sync and fix the gen-upload target which was looking in the wrong
- directory.</p>
+ <p>Add configure option to enable UndefinedBehaviorSanitizer.</p>
</li>
<li>
- <p>Add regression-tests.action to the files that are distributed.</p>
+ <p>Add configure option to enable AddressSanitizer.</p>
</li>
<li>
- <p>The gen-dist target which was broken since 2002 (r1.92) has been fixed.</p>
+ <p>Bump copyright.</p>
</li>
<li>
- <p>Remove genclspec.sh which has been obsolete since 2009.</p>
+ <p>Add a configure option to disable pcre JIT compilation. While JIT compilation makes filtering faster it
+ can cause false-positive valgrind complaints. As reported by Gwyn Ciesla in SF bug 924 it also can cause
+ problems when the SELinux policy does not grant Privoxy "execmem" privileges.</p>
</li>
<li>
- <p>Remove obsolete reference to Redhat spec file.</p>
+ <p>configure: Remove obsolete RPM_BASE check.</p>
+ </li>
+ </ul>
+ </li>
+ <li>
+ <p>Windows build system:</p>
+ <ul>
+ <li>
+ <p>Update the build script to use mbed tls version 2.6.11.</p>
</li>
<li>
- <p>Remove the obsolete announce target which has been commented out years ago.</p>
+ <p>Update build script to use the final 8.45 pcre library.</p>
</li>
<li>
- <p>Let rsync skip files if the checksums match.</p>
+ <p>Put all the '--enable-xxx' options in the configure call together.</p>
</li>
</ul>
</li>
<li>
- <p>Privoxy-Regression-Test:</p>
+ <p>macOS build system:</p>
<ul>
<li>
- <p>Add a "Default level offset" directive which can be used to change the default level by a given value.
- This directive affects all tests located after it until the end of the file or a another "Default level
- offset" directive is reached. The purpose of this directive is to make it more convenient to skip similar
- tests in a given file without having to remove or disable the tests completely.</p>
+ <p>The OSXPackageBuilder repository has been updated and can be used to create macOS packages again.</p>
+ </li>
+ </ul>
+ </li>
+ <li>
+ <p>Documentation:</p>
+ <ul>
+ <li>
+ <p>contacting: Remove obsolete reference to announce.sgml.</p>
+ </li>
+ <li>
+ <p>contacting: Request that the browser cache is cleared before producing a log file for submission.</p>
+ </li>
+ <li>
+ <p>Sponsor FAQ: Note that Privoxy users may follow sponsor links without Referer header set.</p>
+ </li>
+ <li>
+ <p>newfeatures: Clarify that https inspection also allows to filter https responses.</p>
+ </li>
+ <li>
+ <p>developer-manual: Mention that announce.txt should be updated when doing a release.</p>
+ </li>
+ <li>
+ <p>config: Explicitly mention that the CGI pages disclosing the ca-password can be blocked and upgrade the
+ disclosure paragraphs to a warning.</p>
</li>
<li>
- <p>Let test level 17 depend on FEATURE_64_BIT_TIME_T instead of FEATURE_PTHREAD which has no direct
- connection to the time_t size.</p>
+ <p>Put all the requested debug options in the config file. Section 11.1 of the Privoxy user manual lists
+ all the debug options that should be enabled when reporting problems or requesting support. Make it easier
+ for users to do the right thing by having all those options present in the config.</p>
</li>
<li>
- <p>Fix indentation in perldoc examples.</p>
+ <p>Update TODO list item #184 to note that WolfSSL support will (hopefully) appear after the 3.0.34
+ release.</p>
</li>
<li>
- <p>Don't overlook directives in the first line of the action file.</p>
+ <p>Update max-client-connections's description. On modern systems other than Windows Privoxy should use
+ poll() in which case the FD_SETSIZE value isn't releveant.</p>
</li>
<li>
- <p>Bump version to 0.7.</p>
+ <p>Add a warning that the socket-timeout does not apply to operations done by TLS libraries.</p>
</li>
<li>
- <p>Fix detection of the Privoxy version now that https:// is used for the website.</p>
+ <p>Make documentation slightly less "offensive" for some people by avoiding the word "hell".</p>
</li>
</ul>
</li>
projects / privoxy.git / blobdiff