Difference between revisions of "OpenSSL 3.0"
(172 intermediate revisions by 10 users not shown) | |||
Line 1: | Line 1: | ||
− | + | __NUMBEREDHEADINGS__ <!-- https://www.mediawiki.org/wiki/Extension:NumberedHeadings --> | |
− | OpenSSL 3.0 | + | '''READ ME FIRST:''' |
+ | |||
+ | This page is no longer being maintained. Refer instead to the OpenSSL 3.0 [https://www.openssl.org/docs/man3.0/man7/migration_guide.html migration guide] for the most up to date information. | ||
== Main Changes in OpenSSL 3.0 from OpenSSL 1.1.1 == | == Main Changes in OpenSSL 3.0 from OpenSSL 1.1.1 == | ||
Line 8: | Line 10: | ||
OpenSSL 3.0 is a major release and consequently any application that currently uses an older version of OpenSSL will at the very least need to be recompiled in order to work with the new version. It is the intention that the large majority of applications will work unchanged with OpenSSL 3.0 if those applications previously worked with OpenSSL 1.1.1. However this is not guaranteed and some changes may be required in some cases. Changes may also be required if applications need to take advantage of some of the new features available in OpenSSL 3.0 such as the availability of the FIPS module. | OpenSSL 3.0 is a major release and consequently any application that currently uses an older version of OpenSSL will at the very least need to be recompiled in order to work with the new version. It is the intention that the large majority of applications will work unchanged with OpenSSL 3.0 if those applications previously worked with OpenSSL 1.1.1. However this is not guaranteed and some changes may be required in some cases. Changes may also be required if applications need to take advantage of some of the new features available in OpenSSL 3.0 such as the availability of the FIPS module. | ||
+ | |||
+ | === License Change === | ||
+ | |||
+ | In previous versions, OpenSSL was licensed under the dual [https://www.openssl.org/source/license-openssl-ssleay.txt OpenSSL and SSLeay licenses] (both licenses apply). From OpenSSL 3.0 this is replaced by the [https://www.openssl.org/source/apache-license-2.0.txt Apache License v2]. | ||
=== Providers and FIPS support === | === Providers and FIPS support === | ||
− | One of the key changes from OpenSSL 1.1.1 is the introduction of the Provider concept. Providers collect together and make available algorithm implementations. With OpenSSL 3.0 it is possible to specify, either programmatically or via a config file, which providers you want to use for any given application. OpenSSL 3.0 comes with | + | One of the key changes from OpenSSL 1.1.1 is the introduction of the Provider concept. Providers collect together and make available algorithm implementations. With OpenSSL 3.0 it is possible to specify, either programmatically or via a config file, which providers you want to use for any given application. OpenSSL 3.0 comes with 5 different providers as standard. Over time third parties may distribute additional providers that can be plugged into OpenSSL. All algorithm implementations available via providers are accessed through the "high" level APIs (for example those functions prefixed with "EVP"). They cannot be accessed using the "low level" APIs (see below). |
+ | |||
+ | One of the standard providers available is the FIPS provider. This makes available FIPS validated cryptographic algorithms. | ||
=== Low Level APIs === | === Low Level APIs === | ||
− | OpenSSL has historically provided two sets of APIs for invoking cryptographic algorithms: the "EVP" APIs and the "low level" APIs. The | + | OpenSSL has historically provided two sets of APIs for invoking cryptographic algorithms: the "high level" APIs (such as the "EVP" APIs) and the "low level" APIs. The high level APIs are typically designed to work across all algorithm types. The "low level" APIs are targeted at a specific algorithm implementation. For example, the EVP APIs provide the functions `EVP_EncryptInit_ex`, `EVP_EncryptUpdate` and `EVP_EncryptFinal` to perform symmetric encryption. Those functions can be used with the algorithms AES, CHACHA, 3DES etc. On the other hand to do AES encryption using the low level APIs you would have to call AES specific functions such as `AES_set_encrypt_key`, `AES_encrypt`, and so on. The functions for 3DES are different. |
− | Use of the low level APIs has been informally discouraged by the OpenSSL development team for a long time. However in OpenSSL 3.0 this is made more formal. All such low level APIs have been deprecated. You may still ''use'' them in your applications, but you may start to see deprecation warnings during compilation (dependent on compiler support for this). Deprecated APIs may be removed from future versions of OpenSSL so you are strongly encouraged to update your code to use the | + | Use of the low level APIs has been informally discouraged by the OpenSSL development team for a long time. However in OpenSSL 3.0 this is made more formal. All such low level APIs have been deprecated. You may still ''use'' them in your applications, but you may start to see deprecation warnings during compilation (dependent on compiler support for this). Deprecated APIs may be removed from future versions of OpenSSL so you are strongly encouraged to update your code to use the high level APIs instead. |
=== Legacy Algorithms === | === Legacy Algorithms === | ||
Some cryptographic algorithms that were available via the EVP APIs are now considered legacy and their use is strongly discouraged. These legacy EVP algorithms are still available in OpenSSL 3.0 but not by default. If you want to use them then you must load the legacy provider. This can be as simple as a config file change, or can be done programmatically (see below). | Some cryptographic algorithms that were available via the EVP APIs are now considered legacy and their use is strongly discouraged. These legacy EVP algorithms are still available in OpenSSL 3.0 but not by default. If you want to use them then you must load the legacy provider. This can be as simple as a config file change, or can be done programmatically (see below). | ||
+ | |||
+ | === Engines and "METHOD" APIs === | ||
+ | |||
+ | The refactoring to support Providers conflicts internally with the APIs used to support engines, including the ENGINE API and any function that creates or modifies custom "METHODS" (for example EVP_MD_meth_new, EVP_CIPHER_meth_new, EVP_PKEY_meth_new, RSA_meth_new, EC_KEY_METHOD_new, etc.). These functions are being deprecated in OpenSSL 3.0, and users of these APIs should know that their use can likely bypass provider selection and configuration, with unintended consequences. This is particularly relevant for applications written to use the OpenSSL 3.0 FIPS module, as detailed below. | ||
+ | Authors and maintainers of external engines are strongly encouraged to refactor their code transforming engines into providers using the new Provider API and avoiding deprecated methods. | ||
+ | |||
+ | === Versioning Scheme === | ||
+ | |||
+ | The OpenSSL versioning scheme has changed with the 3.0 release. The new versioning scheme has this format: | ||
+ | |||
+ | MAJOR.MINOR.PATCH | ||
+ | |||
+ | For version 1.1.1 and below different patch levels were indicated by a letter at the end of the release version number. This will no longer be used and instead the patch level is indicated by the final number in the version. A change in the second (MINOR) number indicates that new features may have been added. OpenSSL versions with the same major number are API and ABI compatible. If the major number changes then API and ABI compatibility is not guaranteed. | ||
+ | |||
+ | === Other major new features === | ||
+ | |||
+ | * Implementation of the Certificate Management Protocol (CMP, RFC 4210) also covering CRMF (RFC 4211) and HTTP transfer (RFC 6712) | ||
+ | * A proper HTTP(S) client in libcrypto supporting GET and POST, redirection, plain and ASN.1-encoded contents, proxies, and timeouts | ||
+ | * EVP_KDF APIs have been introduced for working with Key Derivation Functions | ||
+ | * EVP_MAC APIs have been introduced for working with MACs | ||
+ | * Support for Linux Kernel TLS | ||
+ | |||
+ | === Other notable deprecations and changes === | ||
+ | |||
+ | * The function code part of an OpenSSL error code is no longer relevant and is always set to zero. Related functions are deprecated. | ||
+ | |||
+ | * The STACK and HASH macro's have been cleaned up, so that the type-safe wrappers are declared everywhere and implemented once. See the manpage at https://www.openssl.org/docs/manmaster/man3/DEFINE_STACK_OF.html for stack, and hopefully soon once the PR is merged, https://www.openssl.org/docs/manmaster/man3/DECLARE_LHASH_OF.html (but not yet as of this writing). | ||
+ | |||
+ | * The RAND_DRBG subsystem has been removed. The new EVP_RAND is a partial replacement: the DRBG callback framework is absent. | ||
+ | |||
+ | == Installation and Compilation of OpenSSL 3.0 == | ||
+ | |||
+ | Please refer to the INSTALL.md file in the top of the distribution for instructions on how to build and install OpenSSL 3.0. Please also refer to the various platform specific NOTES files for your specific platform. | ||
== Upgrading to OpenSSL 3.0 from OpenSSL 1.1.1 == | == Upgrading to OpenSSL 3.0 from OpenSSL 1.1.1 == | ||
Line 32: | Line 73: | ||
2) Suppress the warnings. Refer to your compiler documentation on how to do this. | 2) Suppress the warnings. Refer to your compiler documentation on how to do this. | ||
− | 3) Remove your usage of the low level APIs. In this case you will need to rewrite your code to use the | + | 3) Remove your usage of the low level APIs. In this case you will need to rewrite your code to use the high level APIs instead. |
− | |||
== Upgrading to OpenSSL 3.0 from OpenSSL 1.0.2 == | == Upgrading to OpenSSL 3.0 from OpenSSL 1.0.2 == | ||
Line 72: | Line 112: | ||
− | === Upgrading from | + | More details about the breaking changes between OpenSSL versions 1.0.2 and 1.1.0 can be found on the [[OpenSSL_1.1.0_Changes|OpenSSL 1.1.0 Changes]] page. |
+ | |||
+ | === Upgrading from the OpenSSL 2.0 FIPS Object Module === | ||
The OpenSSL 2.0 FIPS Object Module was a separate download that had to be built separately and then integrated into your main OpenSSL 1.0.2 build. In OpenSSL 3.0 the FIPS support is fully integrated into the mainline version of OpenSSL and is no longer a separate download. You do not need to take separate build steps to add the FIPS support - it is built by default. You ''do'' need to take steps to ensure that your application is ''using'' the FIPS module in OpenSSL 3.0. See the further notes below on configuring this. | The OpenSSL 2.0 FIPS Object Module was a separate download that had to be built separately and then integrated into your main OpenSSL 1.0.2 build. In OpenSSL 3.0 the FIPS support is fully integrated into the mainline version of OpenSSL and is no longer a separate download. You do not need to take separate build steps to add the FIPS support - it is built by default. You ''do'' need to take steps to ensure that your application is ''using'' the FIPS module in OpenSSL 3.0. See the further notes below on configuring this. | ||
− | The function calls 'FIPS_mode()' and 'FIPS_mode_set()' | + | The function calls 'FIPS_mode()' and 'FIPS_mode_set()' have been removed from OpenSSL 3.0. You should rewrite your application to not use them. See the sections below on how to write applications to use the FIPS Module in OpenSSL 3.0. |
== Completing the installation of the FIPS Module == | == Completing the installation of the FIPS Module == | ||
− | Once OpenSSL has been built and installed you will need to take explicit steps to complete the installation of the FIPS module. The OpenSSL 3.0 FIPS support is in the form of the FIPS provider which, on Unix, is in a `fips.so` file. On Windows this will be called `fips.dll`. Following installation of OpenSSL 3.0 the default location for this file is '/usr/local/lib/ossl-modules/fips.so' on Unix or 'C:\Program Files\OpenSSL\lib\fips.dll' on Windows. | + | |
+ | Starting with OpenSSL 3.0.0 alpha16, no separate installation step for the FIPS module (a.k.a FIPS provider) is necessary anymore. It will be built and installed automatically if FIPS support has been configured. The current documentation can be found in the [https://github.com/openssl/openssl/blob/master/README-FIPS.md README-FIPS] file on the master branch. | ||
+ | |||
+ | ''The documentation in the remaining section applies to alpha versions up to OpenSSL 3.0.0 alpha15.'' | ||
+ | |||
+ | Once OpenSSL has been built and installed you will need to take explicit steps to complete the installation of the FIPS module (if you wish to use it). The OpenSSL 3.0 FIPS support is in the form of the FIPS provider which, on Unix, is in a `fips.so` file. On Windows this will be called `fips.dll`. Following installation of OpenSSL 3.0 the default location for this file is '/usr/local/lib/ossl-modules/fips.so' on Unix or 'C:\Program Files\OpenSSL\lib\ossl-modules\fips.dll' on Windows. | ||
To complete the installation you need to run the 'fipsinstall' command line application. This does 2 things: | To complete the installation you need to run the 'fipsinstall' command line application. This does 2 things: | ||
Line 89: | Line 136: | ||
The FIPS module ''must'' have the self tests run, and the FIPS module config file output generated on ''every'' machine that it is to be used on. You '''must not''' copy the FIPS module config file output data from one machine to another. | The FIPS module ''must'' have the self tests run, and the FIPS module config file output generated on ''every'' machine that it is to be used on. You '''must not''' copy the FIPS module config file output data from one machine to another. | ||
− | For example, to install the module: | + | For example, to install the FIPS module to its default location: |
− | $ openssl fipsinstall -out /usr/local/ssl/ | + | $ openssl fipsinstall -out /usr/local/ssl/fipsmodule.cnf -module /usr/local/lib/ossl-modules/fips.so |
+ | If you installed OpenSSL to a different location, you need to adjust the output and module path accordingly. | ||
== Programming in OpenSSL 3.0 == | == Programming in OpenSSL 3.0 == | ||
Line 100: | Line 148: | ||
=== Library Contexts === | === Library Contexts === | ||
− | A library context can be thought of as a "scope" for OpenSSL operations. All functionality operates with the scope of a library context. Multiple library contexts may exist at the same time, and they each may be configured differently. A library context is represented by the newly introduced | + | A library context can be thought of as a "scope" for OpenSSL operations. All functionality operates with the scope of a library context. Multiple library contexts may exist at the same time, and they each may be configured differently. A library context is represented by the newly introduced OSSL_LIB_CTX type. See the man page [https://www.openssl.org/docs/manmaster/man3/OSSL_LIB_CTX.html here]. |
− | + | '''Note:''' ''In alpha releases of OpenSSL 3.0.0 up until alpha6, the OSSL_LIB_CTX was called OPENSSL_CTX. It was renamed for OpenSSL 3.0.0 alpha7. If you are still using an alpha6 release or earlier, take a look at this [https://wiki.openssl.org/index.php?title=OpenSSL_3.0&oldid=3119 older version of the wiki page].'' | |
− | + | Many new functions have been introduced into OpenSSL that take an OSSL_LIB_CTX parameter. In many cases these are variants of some other function that existed in 1.1.1 and work in much the same way - except that they now operate within the scope of the given library context. | |
− | Config files affect a given library context. It is quite possible to have multiple library contexts in use, with each one having been configured with a different config file (see the | + | All applications have available to them the "default library context". This library context always exists and, if you don't otherwise specify one, this is the library context that will be used. Any function that takes an OSSL_LIB_CTX value as a parameter will accept the value NULL for that parameter in order to refer to the default library context. You can also explicitly create new ones via the OSSL_LIB_CTX_new() function. See the man page for further details. |
+ | |||
+ | Config files affect a given library context. It is quite possible to have multiple library contexts in use, with each one having been configured with a different config file (see the OSSL_LIB_CTX_load_config() function described on the man page). | ||
=== Providers === | === Providers === | ||
− | Providers are containers for algorithm implementations. Whenever a cryptographic algorithm is used via the | + | Providers are containers for algorithm implementations. Whenever a cryptographic algorithm is used via the high level APIs a provider is selected. It is that provider implementation that actually does the required work. There are five providers distributed with OpenSSL. In the future we expect third parties to distribute their own providers which can be added to OpenSSL dynamically. Documentation about writing providers is available on the man page [https://www.openssl.org/docs/manmaster/man7/provider.html here]. |
The standard providers are: | The standard providers are: | ||
− | * The default provider. This collects together all of the standard built-in OpenSSL algorithm implementations. If an application doesn't specify anything else explicitly or via config, then this is the provider that will be used. It is loaded automatically the first time that we try to get an algorithm from a provider if no other provider has been loaded yet. This is a "built-in" provider which means that it is built into libcrypto and does not exist as a separate standalone module. | + | * The default provider. This collects together all of the standard built-in OpenSSL algorithm implementations. If an application doesn't specify anything else explicitly (e.g. in the application or via config), then this is the provider that will be used. It is loaded automatically the first time that we try to get an algorithm from a provider if no other provider has been loaded yet. If another provider has already been loaded then it won't be loaded automatically. Therefore if you want to use it in conjunction with other providers then you must load it explicitly. This is a "built-in" provider which means that it is built into libcrypto and does not exist as a separate standalone module. |
* The legacy provider. This is a collection of legacy algorithms that are either no longer in common use or strongly discouraged from use. However some applications may need to use these algorithms for backwards compatibility reasons. This provider is NOT loaded by default. This may mean that some applications upgrading from earlier versions of OpenSSL may find that some algorithms are no longer available unless they load the legacy provider explicitly. Algorithms in the legacy provider include MD2, MD4, MDC2, RMD160, CAST5, BF (Blowfish), IDEA, SEED, RC2, RC4, RC5 and DES (but not 3DES). | * The legacy provider. This is a collection of legacy algorithms that are either no longer in common use or strongly discouraged from use. However some applications may need to use these algorithms for backwards compatibility reasons. This provider is NOT loaded by default. This may mean that some applications upgrading from earlier versions of OpenSSL may find that some algorithms are no longer available unless they load the legacy provider explicitly. Algorithms in the legacy provider include MD2, MD4, MDC2, RMD160, CAST5, BF (Blowfish), IDEA, SEED, RC2, RC4, RC5 and DES (but not 3DES). | ||
− | * The FIPS provider. This contains a sub-set of the algorithm implementations available from the default provider. Algorithms available in this provider conform to FIPS standards. It is intended that this provider will be FIPS140-2 validated. In some cases there | + | * The FIPS provider. This contains a sub-set of the algorithm implementations available from the default provider. Algorithms available in this provider conform to FIPS standards. It is intended that this provider will be FIPS140-2 validated. In some cases there may be minor behavioural differences between algorithm implementations in this provider compared to the equivalent algorithm in the default provider. This is typically in order to conform to FIPS standards. |
+ | |||
+ | * The base provider. This contains a small sub-set of non-cryptographic algorithms available in the default provider. For example algorithms to encode and decode keys to files. If you do not load the default provider then you should always load this one instead (including if you are using the FIPS provider). | ||
+ | |||
+ | * The null provider. This provider is "built-in" to libcrypto and contains no algorithm implementations. In order to guarantee that the default provider is not automatically loaded, the null provider can be loaded instead. This can be useful if you are using non-default library contexts and want to ensure that the default library context is never used "by accident". | ||
+ | |||
− | + | Providers to be loaded can be specified in the OpenSSL config file. See the man page [https://www.openssl.org/docs/manmaster/man5/config.html here]for information about how to configure providers via the config file, and how to automatically activate them. | |
+ | This is a minimal config file example to load and activate both the legacy and the default provider in the default library context. | ||
− | + | openssl_conf = openssl_init | |
+ | |||
+ | [openssl_init] | ||
+ | providers = provider_sect | ||
+ | |||
+ | [provider_sect] | ||
+ | default = default_sect | ||
+ | legacy = legacy_sect | ||
+ | |||
+ | [default_sect] | ||
+ | activate = 1 | ||
+ | |||
+ | [legacy_sect] | ||
+ | activate = 1 | ||
+ | |||
− | + | It is also possible to load them programmatically. For example you can load the legacy provider into the default library context as shown below. Note that once you have explicitly loaded a provider into the library context the default provider will no longer be automatically loaded. Therefore you will often also want to explicitly load the default provider, as is done here: | |
+ | |||
+ | #include <stdio.h> | ||
+ | #include <stdlib.h> | ||
+ | |||
+ | #include <openssl/provider.h> | ||
int main(void) | int main(void) | ||
Line 131: | Line 206: | ||
OSSL_PROVIDER *deflt; | OSSL_PROVIDER *deflt; | ||
+ | /* Load Multiple providers into the default (NULL) library context */ | ||
legacy = OSSL_PROVIDER_load(NULL, "legacy"); | legacy = OSSL_PROVIDER_load(NULL, "legacy"); | ||
if (legacy == NULL) { | if (legacy == NULL) { | ||
Line 174: | Line 250: | ||
if (mdctx == NULL) | if (mdctx == NULL) | ||
goto err; | goto err; | ||
+ | |||
+ | /* | ||
+ | * Setting the library ctx to NULL here fetches the algorithm from the providers loaded | ||
+ | * into the default library context | ||
+ | */ | ||
sha256 = EVP_MD_fetch(NULL, "SHA2-256", NULL); | sha256 = EVP_MD_fetch(NULL, "SHA2-256", NULL); | ||
if (sha256 == NULL) | if (sha256 == NULL) | ||
Line 180: | Line 261: | ||
goto err; | goto err; | ||
+ | /* Explicit fetches return a dynamic object that must be freed */ | ||
EVP_MD_free(sha256); | EVP_MD_free(sha256); | ||
Line 192: | Line 274: | ||
See the section on fetching algorithms in the provider man page for further details: [https://www.openssl.org/docs/manmaster/man7/provider.html#Fetching-algorithms]. | See the section on fetching algorithms in the provider man page for further details: [https://www.openssl.org/docs/manmaster/man7/provider.html#Fetching-algorithms]. | ||
+ | If no specific property query is required then NULL can be passed for the last argument. In any case any supplied property query is combined with the default property query. If nothing else is specified then the default property query is empty. However this can be changed so that every fetch automatically inherits these default properties. Default properties can either be set programmatically or via a config file. See the section [[OpenSSL 3.0#Loading the FIPS module at the same time as other providers|Loading the FIPS module at the same time as other providers]] for an example of how to do this. | ||
− | + | == Using the FIPS Module in applications == | |
− | + | There are a number of different ways that OpenSSL can be used in conjunction with the FIPS module. Which is the correct approach to use will depend on your own specific circumstances and what you are attempting to achieve. Note that the old functions FIPS_mode() and FIPS_mode_set() are no longer present so you must remove them from your application if you use them. | |
+ | |||
+ | Applications written to use the OpenSSL 3.0 FIPS module should not use any | ||
+ | legacy APIs or features that avoid the FIPS module. Specifically this includes: | ||
+ | |||
+ | * Low level cryptographic APIs (use the high level APIs, such as EVP, instead) | ||
+ | * Engines | ||
+ | * Any functions that create or modify custom "METHODS" (for example EVP_MD_meth_new, EVP_CIPHER_meth_new, EVP_PKEY_meth_new, RSA_meth_new, EC_KEY_METHOD_new, etc.) | ||
− | + | All of the above APIs are deprecated in OpenSSL 3.0 - so a simple rule is to | |
+ | avoid using all deprecated functions. | ||
=== Making all applications use the FIPS module by default === | === Making all applications use the FIPS module by default === | ||
Line 203: | Line 294: | ||
One simple approach is to cause all applications that are using OpenSSL to only use the FIPS module for cryptographic algorithms by default. | One simple approach is to cause all applications that are using OpenSSL to only use the FIPS module for cryptographic algorithms by default. | ||
− | This approach can be done purely via configuration. As long as applications are built and linked against OpenSSL 3.0 and do not override the loading of the default config file or its settings then they | + | This approach can be done purely via configuration. As long as applications are built and linked against OpenSSL 3.0 and do not override the loading of the default config file or its settings then they can automatically start using the FIPS module without the need for any further code changes. |
To do this the default OpenSSL config file will have to be modified. The location of this config file will depend on the platform, and any options that were given during the build process. You can check the location of the config file by running this command: | To do this the default OpenSSL config file will have to be modified. The location of this config file will depend on the platform, and any options that were given during the build process. You can check the location of the config file by running this command: | ||
Line 221: | Line 312: | ||
openssl_conf = openssl_init | openssl_conf = openssl_init | ||
− | .include /usr/local/ssl/ | + | .include /usr/local/ssl/fipsmodule.cnf |
[openssl_init] | [openssl_init] | ||
Line 228: | Line 319: | ||
[provider_sect] | [provider_sect] | ||
fips = fips_sect | fips = fips_sect | ||
+ | base = base_sect | ||
+ | |||
+ | [base_sect] | ||
+ | activate = 1 | ||
Obviously the include file location above should match the name of the FIPS module config file that you installed earlier. | Obviously the include file location above should match the name of the FIPS module config file that you installed earlier. | ||
− | Any applications that use OpenSSL 3.0 and are started after these changes are made will start using only the FIPS module unless those applications take explicit steps to avoid this default behaviour. | + | Any applications that use OpenSSL 3.0 and are started after these changes are made will start using only the FIPS module unless those applications take explicit steps to avoid this default behaviour. Note that this configuration also activates the "base" provider. The base provider does not include any cryptographic algorithms (and therefore does not impact the validation status of any cryptographic operations), but does include other supporting algorithms that may be required. It is designed to be used in conjunction with the FIPS module. |
This approach has the primary advantage that it is simple, and no code changes are required in applications in order to benefit from the FIPS module. There are some disadvantages to this approach: | This approach has the primary advantage that it is simple, and no code changes are required in applications in order to benefit from the FIPS module. There are some disadvantages to this approach: | ||
Line 238: | Line 333: | ||
* If applications take explicit steps to not load the default config file or set different settings then this method will not work for them | * If applications take explicit steps to not load the default config file or set different settings then this method will not work for them | ||
* The algorithms available in the FIPS module are a subset of the algorithms that are available in the default OpenSSL Provider. If those applications attempt to use any algorithms that are not present, then they will fail. | * The algorithms available in the FIPS module are a subset of the algorithms that are available in the default OpenSSL Provider. If those applications attempt to use any algorithms that are not present, then they will fail. | ||
− | * Usage of certain APIs avoids the use of the FIPS module. If any applications use those APIs then the FIPS module will not be used. | + | * Usage of certain deprecated APIs avoids the use of the FIPS module. If any applications use those APIs then the FIPS module will not be used. |
=== Selectively making applications use the FIPS module by default === | === Selectively making applications use the FIPS module by default === | ||
Line 254: | Line 349: | ||
Applications may choose to load the FIPS provider explicitly rather than relying on config to do this. The config file is still necessary in order to hold the FIPS module config data (such as its self test status and integrity data). But in this case we do not automatically activate the FIPS provider via that config file. | Applications may choose to load the FIPS provider explicitly rather than relying on config to do this. The config file is still necessary in order to hold the FIPS module config data (such as its self test status and integrity data). But in this case we do not automatically activate the FIPS provider via that config file. | ||
− | To do things this way configure as per the section "Making all applications use the FIPS module by default" above, but edit the | + | To do things this way configure as per the section "Making all applications use the FIPS module by default" above, but edit the fipsmodule.cnf file to remove or comment out the line which says "activate = 1" (note that setting this value to 0 is not sufficient). This means all the required config information will be available to load the FIPS module, but it is not actually automatically loaded when the application starts. The FIPS provider can then be loaded programmatically like this: |
#include <openssl/provider.h> | #include <openssl/provider.h> | ||
Line 261: | Line 356: | ||
{ | { | ||
OSSL_PROVIDER *fips; | OSSL_PROVIDER *fips; | ||
+ | OSSL_PROVIDER *base; | ||
fips = OSSL_PROVIDER_load(NULL, "fips"); | fips = OSSL_PROVIDER_load(NULL, "fips"); | ||
if (fips == NULL) { | if (fips == NULL) { | ||
printf("Failed to load FIPS provider\n"); | printf("Failed to load FIPS provider\n"); | ||
+ | exit(EXIT_FAILURE); | ||
+ | } | ||
+ | base = OSSL_PROVIDER_load(NULL, "base"); | ||
+ | if (base == NULL) { | ||
+ | OSSL_PROVIDER_unload(fips); | ||
+ | printf("Failed to load base provider\n"); | ||
exit(EXIT_FAILURE); | exit(EXIT_FAILURE); | ||
} | } | ||
Line 270: | Line 372: | ||
/* Rest of application */ | /* Rest of application */ | ||
+ | OSSL_PROVIDER_unload(base); | ||
OSSL_PROVIDER_unload(fips); | OSSL_PROVIDER_unload(fips); | ||
exit(EXIT_SUCCESS); | exit(EXIT_SUCCESS); | ||
Line 276: | Line 379: | ||
Note that this should be one of the first things that you do in your application. If any OpenSSL functions get called that require the use of cryptographic functions before this occurs then, if no provider has yet been loaded, then the default provider will be automatically loaded. If you then later explicitly load the FIPS provider then you will have both the FIPS and the default provider loaded at the same time. It is undefined which implementation of an algorithm will be used if multiple implementations are available and you have not explicitly specified via a property query (see below) which one should be used. | Note that this should be one of the first things that you do in your application. If any OpenSSL functions get called that require the use of cryptographic functions before this occurs then, if no provider has yet been loaded, then the default provider will be automatically loaded. If you then later explicitly load the FIPS provider then you will have both the FIPS and the default provider loaded at the same time. It is undefined which implementation of an algorithm will be used if multiple implementations are available and you have not explicitly specified via a property query (see below) which one should be used. | ||
− | + | Also note that in this example we have additionally loaded the "base" provider. This loads a sub-set of algorithms that are also available in the default provider - specifically non cryptographic ones which may be used in conjunction with the FIPS provider. For example this contains algorithms for encoding and decoding keys. If you decide not to load the default provider then you will usually want to load the base provider instead. | |
− | |||
− | |||
− | |||
− | |||
=== Loading the FIPS module at the same time as other providers === | === Loading the FIPS module at the same time as other providers === | ||
Line 286: | Line 385: | ||
It is possible to have the FIPS provider and other providers (such as the default provider) all loaded at the same time into the same library context. You can use a property query string during algorithm fetches to specify which implementation you would like to use. | It is possible to have the FIPS provider and other providers (such as the default provider) all loaded at the same time into the same library context. You can use a property query string during algorithm fetches to specify which implementation you would like to use. | ||
− | For example to fetch an implementation of SHA256 which | + | For example to fetch an implementation of SHA256 which conforms to FIPS standards you can specify the property query "fips=yes" like this: |
Line 301: | Line 400: | ||
sha256 = EVP_MD_fetch(NULL, "SHA2-256", "provider=default"); | sha256 = EVP_MD_fetch(NULL, "SHA2-256", "provider=default"); | ||
+ | |||
+ | It is also possible to set a default property query string. The following example sets the default property query of "fips=yes" for all fetches within the default library context: | ||
+ | |||
+ | EVP_set_default_properties(NULL, "fips=yes"); | ||
+ | |||
+ | If a fetch function has both an explicit property query specified, and a default property query is defined then the two queries are merged together and both apply. The local property query overrides the default properties if the same property name is specified in both. | ||
+ | |||
+ | There are two important built-in properties that you should be aware of: | ||
+ | |||
+ | The "provider" property enables you to specify which provider you want an implementation to be fetched from, e.g. "provider=default" or "provider=fips". All algorithms implemented in a provider have this property set on them. | ||
+ | |||
+ | There is also the "fips" property. All FIPS algorithms match against the property query "fips=yes". There are also some non-cryptographic algorithms available in the default and base providers that also have the "fips=yes" property defined for them. These are the encoder and decoder algorithms that can (for example) be used to write out a key generated in the FIPS provider to a file. The encoder and decoder algorithms are not in the FIPS module itself but are allowed to be used in conjunction with the FIPS algorithms. | ||
+ | |||
+ | It is possible to specify default properties within a config file. For example the following config file automatically loads the default and fips providers and sets the default property value to be "fips=yes". Note that this config file does not load the "base" provider. All supporting algorithms that are in "base" are also in "default", so it is unnecessary in this case: | ||
+ | |||
+ | openssl_conf = openssl_init | ||
+ | |||
+ | .include /usr/local/ssl/fipsmodule.cnf | ||
+ | |||
+ | [openssl_init] | ||
+ | providers = provider_sect | ||
+ | alg_section = algorithm_sect | ||
+ | |||
+ | [provider_sect] | ||
+ | fips = fips_sect | ||
+ | default = default_sect | ||
+ | |||
+ | [default_sect] | ||
+ | activate = 1 | ||
+ | |||
+ | [algorithm_sect] | ||
+ | default_properties = fips=yes | ||
=== Programmatically loading the FIPS module (non-default library context) === | === Programmatically loading the FIPS module (non-default library context) === | ||
− | + | In addition to using properties to separate usage of the FIPS module from other usages this can also be achieved using library contexts. In this example we create two library contexts. In one we assume the existence of a config file called "openssl-fips.cnf" that automatically loads and configures the FIPS and base providers. The other library context will just use the default provider. | |
− | === | + | OSSL_LIB_CTX *fipslibctx, *nonfipslibctx; |
+ | OSSL_PROVIDER *defctxnull = NULL; | ||
+ | EVP_MD *fipssha256 = NULL, *nonfipssha256 = NULL; | ||
+ | int ret = 1; | ||
+ | |||
+ | /* | ||
+ | * Create two non-default library contexts. One for fips usage and one for | ||
+ | * non-fips usage | ||
+ | */ | ||
+ | fipslibctx = OSSL_LIB_CTX_new(); | ||
+ | nonfipslibctx = OSSL_LIB_CTX_new(); | ||
+ | if (fipslibctx == NULL || nonfipslibctx == NULL) | ||
+ | goto err; | ||
+ | |||
+ | /* Prevent anything from using the default library context */ | ||
+ | defctxnull = OSSL_PROVIDER_load(NULL, "null"); | ||
+ | |||
+ | /* | ||
+ | * Load config file for the FIPS library context. We assume that this | ||
+ | * config file will automatically activate the FIPS and base providers so we | ||
+ | * don't need to explicitly load them here. | ||
+ | */ | ||
+ | if (!OSSL_LIB_CTX_load_config(fipslibctx, "openssl-fips.cnf")) | ||
+ | goto err; | ||
+ | |||
+ | /* | ||
+ | * We don't need to do anything special to load the default provider into | ||
+ | * nonfipslibctx. This happens automatically if no other providers are | ||
+ | * loaded. Because we don't call OSSL_LIB_CTX_load_config() explicitly for | ||
+ | * nonfipslibctx it will just use the default config file. | ||
+ | */ | ||
+ | |||
+ | /* As an example get some digests */ | ||
+ | |||
+ | /* Get a FIPS validated digest */ | ||
+ | fipssha256 = EVP_MD_fetch(fipslibctx, "SHA2-256", NULL); | ||
+ | if (fipssha256 == NULL) | ||
+ | goto err; | ||
+ | |||
+ | /* Get a non-FIPS validated digest */ | ||
+ | nonfipssha256 = EVP_MD_fetch(nonfipslibctx, "SHA2-256", NULL); | ||
+ | if (nonfipssha256 == NULL) | ||
+ | goto err; | ||
+ | |||
+ | /* Use the digests */ | ||
+ | |||
+ | printf("Success\n"); | ||
+ | ret = 0; | ||
+ | err: | ||
+ | EVP_MD_free(fipssha256); | ||
+ | EVP_MD_free(nonfipssha256); | ||
+ | OSSL_LIB_CTX_free(fipslibctx); | ||
+ | OSSL_LIB_CTX_free(nonfipslibctx); | ||
+ | OSSL_PROVIDER_unload(defctxnull); | ||
+ | |||
+ | return ret; | ||
− | + | Note that we have made use of the special "null" provider here which we load into the default library context. We could have chosen to use the default library context for FIPS usage, and just create one additional library context for other usages - or vice versa. However if code has not been converted to use library contexts then the default library context will be automatically used. This could be the case for your own existing applications as well as certain parts of OpenSSL itself. Not all parts of OpenSSL are library context aware. If this happens then you could "accidentally" use the wrong library context for a particular operation. To be sure this doesn't happen you can load the "null" provider into the default library context. Because a provider has been explicitly loaded, the default provider will not automatically load. This means code using the default context by accident will fail because no algorithms will be available. | |
− | === | + | === Using Encoders and Decoders with the FIPS module === |
− | + | Encoders and decoders are used to read and write keys or parameters from or to some external format (for example a PEM file). If your application generates keys or parameters that then need to be written into PEM or DER format then it is likely that you will need to use a encoder to do this. Similarly you need a decoder to read previously saved keys and parameters. In most cases this will be invisible to you if you are using APIs that existed in OpenSSL 1.1.1 or earlier such as i2d_PrivateKey. However the appropriate encoder/decoder will need to be available in the library context associated with the key or parameter object. The built-in OpenSSL encoder and decoder are implemented in both the default and base providers and are not in the FIPS module boundary. However since they are not cryptographic algorithms themselves it is still possible to use them in conjunction with the FIPS module, and therefore these encoder/decoder have the "fips=yes" property against them. You should ensure that either the default or base provider is loaded into the library context in this case. | |
=== Using the FIPS module in SSL/TLS === | === Using the FIPS module in SSL/TLS === | ||
− | + | Writing an application that uses libssl in conjunction with the FIPS module is much the same as writing a normal libssl application. If you are using global properties and the default library context to specify usage of FIPS validated algorithms then this will happen automatically for all cryptographic algorithms in libssl. If you are using a non-default library context to load the FIPS provider then you can supply this to libssl using the function SSL_CTX_new_ex(). This works as a drop in replacement for the function SSL_CTX_new() except it provides you with the capability to specify the library context to be used. You can also use the same function to specify libssl specific properties to use. | |
+ | |||
+ | In this first example we create two SSL_CTX objects using two different library contexts. | ||
+ | |||
+ | /* | ||
+ | * We assume that a non-default library context with the FIPS provider loaded has been | ||
+ | * created called fips_libctx. | ||
+ | / | ||
+ | SSL_CTX *fips_ssl_ctx = SSL_CTX_new_ex(fips_libctx, NULL, TLS_method()); | ||
+ | /* | ||
+ | * We assume that a non-default library context with the default provider loaded has been | ||
+ | * created called non_fips_libctx. | ||
+ | / | ||
+ | SSL_CTX *non_fips_ssl_ctx = SSL_CTX_new_ex(non_fips_libctx, NULL, TLS_method()); | ||
+ | |||
+ | In this second example we create two SSL_CTX objects using different properties to specify FIPS usage: | ||
+ | |||
+ | /* | ||
+ | * The "fips=yes" property includes all FIPS approved algorithms as well as encoders from the | ||
+ | * default provider that are allowed to be used. The NULL below indicates that we are using the | ||
+ | * default library context. | ||
+ | */ | ||
+ | SSL_CTX *fips_ssl_ctx = SSL_CTX_new_ex(NULL, "fips=yes", TLS_method()); | ||
+ | /* | ||
+ | * The "provider!=fips" property allows algorithms from any provider except the FIPS provider | ||
+ | */ | ||
+ | SSL_CTX *non_fips_ssl_ctx = SSL_CTX_new_ex(NULL, "provider!=fips", TLS_method()); | ||
+ | |||
+ | === Confirming that an algorithm is being provided by the FIPS module === | ||
+ | |||
+ | A chain of links needs to be followed to go from an algorithm instance to the provider that implements it. The process is similar for all algorithms. Here the example of a digest is used. | ||
+ | |||
+ | # To go from an ''EVP_MD_CTX'' to an ''EVP_MD'', use the '''EVP_MD_CTX_md()''' call. | ||
+ | # To go from the ''EVP_MD'' to its ''OSSL_PROVIDER'', use the '''EVP_MD_provider()''' call. | ||
+ | # To extract the name from the ''OSSL_PROVIDER'', use the '''OSSL_PROVIDER_name()''' call. | ||
+ | # Finally, use strcmp(3) or printf(3) on the name. | ||
+ | |||
+ | == Openssl command line application changes == | ||
+ | |||
+ | The following additional command line arguments have been added | ||
+ | |||
+ | '''-provider_path''' path_name - Provider load path | ||
+ | '''-provider''' provider_name - Provider to load | ||
+ | |||
+ | These options can be used multiple times to load any providers, such as the 'legacy' provider or third party providers. | ||
+ | If used then the 'default' provider would also need to be specified if required. | ||
+ | The -provider_path must be specified before the -provider option. | ||
== STATUS of current development == | == STATUS of current development == | ||
Line 328: | Line 560: | ||
The current status of OpenSSL 3.0 is '''in development'''<br /> | The current status of OpenSSL 3.0 is '''in development'''<br /> | ||
The next status is expected to be '''alpha''' | The next status is expected to be '''alpha''' | ||
+ | |||
+ | === Known issues === | ||
+ | |||
+ | ==== Building and testing ==== | ||
+ | |||
+ | * Doesn't build and test on all platforms on our watch list. See the list of [[#Platforms|platforms]] below<br /> | ||
+ | : ''To be noted that we can't pretend to build on everything and anything, but there are a number of platforms that we watch, either on our own or with community help and reporting'' | ||
+ | |||
+ | ==== Integration ==== | ||
+ | |||
+ | (these issues are tracked in [[#Provider implementation support in other OpenSSL APIs|a table further down]]) | ||
+ | |||
+ | * PKCS#7, CMS, SSL/TLS don't work with asymmetric keys implemented by a provider. There's a temporary hack in place that "downgrades" such keys to work with legacy methods (<tt>EVP_PKEY_METHOD</tt> and <tt>EVP_PKEY_ASN1_METHOD</tt>) | ||
+ | * CMP/CRMF, PKCS#7, TS, CMS, PKCS#12 and OSSL_STORE currently have no library context support | ||
+ | * OCSP, PEM, ASN.1 have some very limited library context support | ||
+ | * It is not yet possible to "fetch" a RAND algorithm | ||
+ | |||
+ | ==== Programming ==== | ||
+ | |||
+ | * EVP_set_default_properties() does not work (see [https://github.com/openssl/openssl/issues/11594 github #11594]) | ||
+ | |||
+ | ==== SSL/TLS ==== | ||
+ | |||
+ | * libssl does not currently detect what signature algorithms are available within the currently loaded providers. Unless explicitly configured differently endpoints will advertise to peers the default list of signature algorithms that are supported - even if those are not available in the currently loaded providers. This could result in handshake failures. As a workaround until this is fixed you should explicitly configure signature algorithms that are consistent with the loaded providers. | ||
=== Platforms === | === Platforms === | ||
Line 339: | Line 595: | ||
|- | |- | ||
| Linux - s390x || Yes || Yes | | Linux - s390x || Yes || Yes | ||
+ | |- | ||
+ | | FreeBSD - aarch64 || Yes || Yes || Tested on 13.0-CURRENT | ||
+ | |- | ||
+ | | FreeBSD - amd64 || Yes || Yes || Tested on 12.1-STABLE and 11.3-STABLE | ||
+ | |- | ||
+ | | FreeBSD - i386 || Yes || Yes || Had to run <code>./config no-pic</code> due to lack of CAST PIC support | ||
|- | |- | ||
| Windows + Visual C - x86 / x86_64 || Yes || Yes | | Windows + Visual C - x86 / x86_64 || Yes || Yes | ||
|- | |- | ||
− | | MacOS X || Yes || | + | | MacOS X || Yes || Yes |
|- | |- | ||
| OpenVMS - Alpha / Itanium || No || Unknown || New include directories need to be dealt with, and more elegantly than the 1.1.1 kludge | | OpenVMS - Alpha / Itanium || No || Unknown || New include directories need to be dealt with, and more elegantly than the 1.1.1 kludge | ||
Line 350: | Line 612: | ||
All the core support features are in. | All the core support features are in. | ||
+ | |||
+ | The percentages in the tables below represent the amount of work done to convert legacy implementations to a provider based ones. Algorithms for which the conversion hasn't been completed (or ever started) remain full functional via the legacy code paths. | ||
==== Provider implemented operation types ==== | ==== Provider implemented operation types ==== | ||
Line 372: | Line 636: | ||
| EVP_KEYMGMT || 95% || 70% || Missing functionality for loading HSM keys | | EVP_KEYMGMT || 95% || 70% || Missing functionality for loading HSM keys | ||
|- | |- | ||
− | | | + | | OSSL_ENCODER || 100% || 100% |
+ | |- | ||
+ | | OSSL_DECODER || 100% || 100% | ||
|- | |- | ||
| OSSL_STORE || 0% || 0% | | OSSL_STORE || 0% || 0% | ||
Line 434: | Line 700: | ||
| SHA3 || default, FIPS || 100% || ?? | | SHA3 || default, FIPS || 100% || ?? | ||
|- | |- | ||
− | | SHAKE || default, FIPS || 100% || ?? || For FIPS, only SHAKE-256, not SHAKE-128 | + | | SHAKE || default, FIPS || 100% || ?? || For the FIPS provider, only SHAKE-256 is available, not SHAKE-128. |
|- | |- | ||
| RIPEMD-160 || leagcy || 100% || ?? | | RIPEMD-160 || leagcy || 100% || ?? | ||
Line 442: | Line 708: | ||
==== Provider implemented MACs ==== | ==== Provider implemented MACs ==== | ||
− | |||
− | |||
{| class="wikitable" | {| class="wikitable" | ||
! Algorithm !! Providers !! Code completion % !! Documentation completion % !! Comment | ! Algorithm !! Providers !! Code completion % !! Documentation completion % !! Comment | ||
+ | |- | ||
+ | | BLAKE2 || default || 100% || ?? | ||
+ | |- | ||
+ | | CMAC || default || 100% || ?? | ||
+ | |- | ||
+ | | GMAC || default, FIPS || 100% || ?? | ||
+ | |- | ||
+ | | HMAC || default, FIPS || 100% || ?? | ||
+ | |- | ||
+ | | KMAC || default || 100% || ?? | ||
+ | |- | ||
+ | | POLY1305 || default || 100% || ?? | ||
+ | |- | ||
+ | | SIPHASH || default || 100% || ?? | ||
|} | |} | ||
==== Provider implemented KDFs ==== | ==== Provider implemented KDFs ==== | ||
− | |||
− | |||
{| class="wikitable" | {| class="wikitable" | ||
! Algorithm !! Providers !! Code completion % !! Documentation completion % !! Comment | ! Algorithm !! Providers !! Code completion % !! Documentation completion % !! Comment | ||
+ | |- | ||
+ | | HKDF || default, FIPS || 100% || ?? | ||
+ | |- | ||
+ | | KBKDF || default || 100% || ?? | ||
+ | |- | ||
+ | | KRB5KDF || default || 100% || ?? || Kerberos KDF | ||
+ | |- | ||
+ | | PBKDF2 || default, FIPS || 100% || ?? | ||
+ | |- | ||
+ | | SCRYPT || default || 100% || ?? | ||
+ | |- | ||
+ | | SSKDF || default, FIPS || 100% || ?? | ||
+ | |- | ||
+ | | TLS1-PRF || default, FIPS || 100% || ?? || TLS 1.x PRF is treated as a KDF by OpenSSL | ||
+ | |- | ||
+ | | X942KDF || default || 100% || ?? | ||
+ | |- | ||
+ | | X963KDF || default || 100% || ?? | ||
+ | |- | ||
|} | |} | ||
Line 468: | Line 763: | ||
| EC || default, FIPS || 100% <!-- ? --> || ?? | | EC || default, FIPS || 100% <!-- ? --> || ?? | ||
|- | |- | ||
− | | ED25519, X25519, ED448, X448 || default, FIPS || 100% <!-- ? --> || ?? | + | | ED25519, X25519, ED448, X448 || default, FIPS || 100% <!-- ? --> || ?? || Vendor affirmed for FIPS, they cannot yet be validated. |
|- | |- | ||
| RSA || default, FIPS || 100% <!-- ? --> || ?? || RSA-PSS or RSA-OAEP are considered separate key types, although the RSA EVP_ASYM_CIPHER and EVP_SIGNATURE implementations carry some of the corresponding properties. | | RSA || default, FIPS || 100% <!-- ? --> || ?? || RSA-PSS or RSA-OAEP are considered separate key types, although the RSA EVP_ASYM_CIPHER and EVP_SIGNATURE implementations carry some of the corresponding properties. | ||
|- | |- | ||
− | | RSA-PSS || default || | + | | RSA-PSS || default || 100% || ?? |
|- | |- | ||
| RSA-OAEP || default || 0% || ?? | | RSA-OAEP || default || 0% || ?? | ||
Line 484: | Line 779: | ||
! Algorithm !! Providers !! Code completion % !! Documentation completion % !! Comment | ! Algorithm !! Providers !! Code completion % !! Documentation completion % !! Comment | ||
|- | |- | ||
− | | RSA, RSAES-OAEP || default | + | | RSA || default, FIPS || 80% || ?? |
+ | |- | ||
+ | | RSAES-OAEP || default || 80% || ?? | ||
|} | |} | ||
Line 496: | Line 793: | ||
| ECDSA || default, FIPS || 100% || ?? | | ECDSA || default, FIPS || 100% || ?? | ||
|- | |- | ||
− | | ED25519, ED448 || default, FIPS || 100% || ?? | + | | ED25519, ED448 || default, FIPS || 100% || ?? || In the FIPS provider, these are vendor affirmed. |
|- | |- | ||
− | | RSA, RSASSA-PSS || default | + | | RSA, RSASSA-PSS || default, FIPS || 100% || ?? |
|} | |} | ||
Line 510: | Line 807: | ||
| ECDH || default, FIPS || 100% || ?? | | ECDH || default, FIPS || 100% || ?? | ||
|- | |- | ||
− | | X25519, X448 || default, FIPS || 100% || ?? | + | | X25519, X448 || default, FIPS || 100% || ?? || In the FIPS provider, these are vendor affirmed. |
|} | |} | ||
− | ==== Provider implemented | + | ==== Provider implemented encoder / decoder ==== |
− | ===== | + | ===== Encoders ===== |
− | |||
− | |||
{| class="wikitable" | {| class="wikitable" | ||
− | ! | + | ! Encoder !! Providers !! Code completion % !! Documentation completion % !! Comment |
+ | |- | ||
+ | | DH to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | DSA to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | ED25519 to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | ED448 to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | EC to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | RSA to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | RSA-PSS to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | RSA-OAEP to printable text, DER, PEM || default || 0% ? || ?? | ||
+ | |- | ||
+ | | SM2 to printable text, DER, PEM || default || 0% ? || ?? | ||
+ | |- | ||
+ | | X25519 to printable text, DER, PEM || default || 100% || ?? | ||
+ | |- | ||
+ | | X448 to printable text, DER, PEM || default || 100% || ?? | ||
|} | |} | ||
− | ===== | + | ===== Decoders ===== |
TO BE ADDED | TO BE ADDED | ||
{| class="wikitable" | {| class="wikitable" | ||
− | ! | + | ! Decoder !! Providers !! Code completion % !! Documentation completion % !! Comment |
|} | |} | ||
==== Provider implemented OSSL_STORE URI schemes ==== | ==== Provider implemented OSSL_STORE URI schemes ==== | ||
− | |||
− | |||
{| class="wikitable" | {| class="wikitable" | ||
! URI scheme !! Providers !! Code completion % !! Documentation completion % !! Comment | ! URI scheme !! Providers !! Code completion % !! Documentation completion % !! Comment | ||
+ | |- | ||
+ | | file: || default (?) || 0% || ?? || This is pending on decoders | ||
|} | |} | ||
− | === Provider implementation support in other OpenSSL APIs === | + | === Library Context/Provider implementation support in other OpenSSL APIs === |
Diverse OpenSSL APIs have been modified and continue to be modified to support provider implementations. | Diverse OpenSSL APIs have been modified and continue to be modified to support provider implementations. | ||
Line 545: | Line 862: | ||
{| class="wikitable" | {| class="wikitable" | ||
! API !! Code completion % !! Documentation completion % !! Comment | ! API !! Code completion % !! Documentation completion % !! Comment | ||
+ | |- | ||
+ | | ASN1 || 5% || 5% | ||
|- | |- | ||
| CMS || 0% || 0% || There are hacks in place that downgrade a key to legacy when used with CMS | | CMS || 0% || 0% || There are hacks in place that downgrade a key to legacy when used with CMS | ||
Line 551: | Line 870: | ||
|- | |- | ||
| CRMF || 5% || 0% | | CRMF || 5% || 0% | ||
+ | |- | ||
+ | | OCSP || 20% || 20% || All changes needed to pass the libssl test suite have been done. We need to investigate if further changes are required | ||
|- | |- | ||
| OSSL_STORE || 0% || 0% | | OSSL_STORE || 0% || 0% | ||
+ | |- | ||
+ | | PEM || 50% || 50% || Integrated with provider encoders for writing out keys and parameters | ||
|- | |- | ||
| PKCS#7 || 0% || 0% || There are hacks in place that downgrade a key to legacy when used with PKCS#7 | | PKCS#7 || 0% || 0% || There are hacks in place that downgrade a key to legacy when used with PKCS#7 | ||
|- | |- | ||
− | | SSL / TLS || | + | | PKCS#12 || 0% || 0% |
+ | |- | ||
+ | | SSL / TLS || 80% || 100% || There are hacks in place that downgrade a key to legacy in some situations. Some processing happens in libssl that should be moved to a provider. Presence of signature algorithms is not correctly detected | ||
+ | |- | ||
+ | | TS || 0% || 0% | ||
+ | |- | ||
+ | | X509 || 80% || 80% || All changes needed to pass the libssl test suite have been done. We need to investigate if further changes are required | ||
|} | |} |
Latest revision as of 12:36, 20 September 2021
__NUMBEREDHEADINGS__
READ ME FIRST:
This page is no longer being maintained. Refer instead to the OpenSSL 3.0 migration guide for the most up to date information.
Main Changes in OpenSSL 3.0 from OpenSSL 1.1.1[edit]
Major Release[edit]
OpenSSL 3.0 is a major release and consequently any application that currently uses an older version of OpenSSL will at the very least need to be recompiled in order to work with the new version. It is the intention that the large majority of applications will work unchanged with OpenSSL 3.0 if those applications previously worked with OpenSSL 1.1.1. However this is not guaranteed and some changes may be required in some cases. Changes may also be required if applications need to take advantage of some of the new features available in OpenSSL 3.0 such as the availability of the FIPS module.
License Change[edit]
In previous versions, OpenSSL was licensed under the dual OpenSSL and SSLeay licenses (both licenses apply). From OpenSSL 3.0 this is replaced by the Apache License v2.
Providers and FIPS support[edit]
One of the key changes from OpenSSL 1.1.1 is the introduction of the Provider concept. Providers collect together and make available algorithm implementations. With OpenSSL 3.0 it is possible to specify, either programmatically or via a config file, which providers you want to use for any given application. OpenSSL 3.0 comes with 5 different providers as standard. Over time third parties may distribute additional providers that can be plugged into OpenSSL. All algorithm implementations available via providers are accessed through the "high" level APIs (for example those functions prefixed with "EVP"). They cannot be accessed using the "low level" APIs (see below).
One of the standard providers available is the FIPS provider. This makes available FIPS validated cryptographic algorithms.
Low Level APIs[edit]
OpenSSL has historically provided two sets of APIs for invoking cryptographic algorithms: the "high level" APIs (such as the "EVP" APIs) and the "low level" APIs. The high level APIs are typically designed to work across all algorithm types. The "low level" APIs are targeted at a specific algorithm implementation. For example, the EVP APIs provide the functions `EVP_EncryptInit_ex`, `EVP_EncryptUpdate` and `EVP_EncryptFinal` to perform symmetric encryption. Those functions can be used with the algorithms AES, CHACHA, 3DES etc. On the other hand to do AES encryption using the low level APIs you would have to call AES specific functions such as `AES_set_encrypt_key`, `AES_encrypt`, and so on. The functions for 3DES are different.
Use of the low level APIs has been informally discouraged by the OpenSSL development team for a long time. However in OpenSSL 3.0 this is made more formal. All such low level APIs have been deprecated. You may still use them in your applications, but you may start to see deprecation warnings during compilation (dependent on compiler support for this). Deprecated APIs may be removed from future versions of OpenSSL so you are strongly encouraged to update your code to use the high level APIs instead.
Legacy Algorithms[edit]
Some cryptographic algorithms that were available via the EVP APIs are now considered legacy and their use is strongly discouraged. These legacy EVP algorithms are still available in OpenSSL 3.0 but not by default. If you want to use them then you must load the legacy provider. This can be as simple as a config file change, or can be done programmatically (see below).
Engines and "METHOD" APIs[edit]
The refactoring to support Providers conflicts internally with the APIs used to support engines, including the ENGINE API and any function that creates or modifies custom "METHODS" (for example EVP_MD_meth_new, EVP_CIPHER_meth_new, EVP_PKEY_meth_new, RSA_meth_new, EC_KEY_METHOD_new, etc.). These functions are being deprecated in OpenSSL 3.0, and users of these APIs should know that their use can likely bypass provider selection and configuration, with unintended consequences. This is particularly relevant for applications written to use the OpenSSL 3.0 FIPS module, as detailed below. Authors and maintainers of external engines are strongly encouraged to refactor their code transforming engines into providers using the new Provider API and avoiding deprecated methods.
Versioning Scheme[edit]
The OpenSSL versioning scheme has changed with the 3.0 release. The new versioning scheme has this format:
MAJOR.MINOR.PATCH
For version 1.1.1 and below different patch levels were indicated by a letter at the end of the release version number. This will no longer be used and instead the patch level is indicated by the final number in the version. A change in the second (MINOR) number indicates that new features may have been added. OpenSSL versions with the same major number are API and ABI compatible. If the major number changes then API and ABI compatibility is not guaranteed.
Other major new features[edit]
- Implementation of the Certificate Management Protocol (CMP, RFC 4210) also covering CRMF (RFC 4211) and HTTP transfer (RFC 6712)
- A proper HTTP(S) client in libcrypto supporting GET and POST, redirection, plain and ASN.1-encoded contents, proxies, and timeouts
- EVP_KDF APIs have been introduced for working with Key Derivation Functions
- EVP_MAC APIs have been introduced for working with MACs
- Support for Linux Kernel TLS
Other notable deprecations and changes[edit]
- The function code part of an OpenSSL error code is no longer relevant and is always set to zero. Related functions are deprecated.
- The STACK and HASH macro's have been cleaned up, so that the type-safe wrappers are declared everywhere and implemented once. See the manpage at https://www.openssl.org/docs/manmaster/man3/DEFINE_STACK_OF.html for stack, and hopefully soon once the PR is merged, https://www.openssl.org/docs/manmaster/man3/DECLARE_LHASH_OF.html (but not yet as of this writing).
- The RAND_DRBG subsystem has been removed. The new EVP_RAND is a partial replacement: the DRBG callback framework is absent.
Installation and Compilation of OpenSSL 3.0[edit]
Please refer to the INSTALL.md file in the top of the distribution for instructions on how to build and install OpenSSL 3.0. Please also refer to the various platform specific NOTES files for your specific platform.
Upgrading to OpenSSL 3.0 from OpenSSL 1.1.1[edit]
Upgrading to OpenSSL 3.0 from OpenSSL 1.1.1 should be relatively straight forward in most cases. The most likely area where you will encounter problems is if you have used low level APIs in your code (as discussed above). In that case you are likely to start seeing deprecation warnings when compiling your application. If this happens you have 3 options:
1) Ignore the warnings. They are just warnings. The deprecated functions are still present and you may still use them. However be aware that they may be removed from a future version of OpenSSL.
2) Suppress the warnings. Refer to your compiler documentation on how to do this.
3) Remove your usage of the low level APIs. In this case you will need to rewrite your code to use the high level APIs instead.
Upgrading to OpenSSL 3.0 from OpenSSL 1.0.2[edit]
Upgrading to OpenSSL 3.0 from OpenSSL 1.0.2 is likely to be significantly more difficult. In addition to the issues discussed above in the section about upgrading from 1.1.1, the main things to be aware of are:
1) The build and installation procedure has changed significantly since OpenSSL 1.0.2. Check the file INSTALL.md in the top of the installation for instructions on how to build and install OpenSSL for your platform. Also checkout the various NOTES files in the same directory, as applicable for your platform.
2) Many structures have been made opaque in OpenSSL 3.0. The structure definitions have been removed from the public header files and moved to internal header files. In practice this means that you can no longer stack allocate some structures. Instead they must be heap allocated through some function call (typically those function names have a `_new` suffix to them). Additionally you must use "setter" or "getter" functions to access the fields within those structures.
For example code that previously looked like this:
EVP_MD_CTX md_ctx; EVP_MD_CTX_init(&md_ctx); /* Do something with the md_ctx */
will now generate compiler errors. For example:
md_ctx.c:6:16: error: storage size of ‘md_ctx’ isn’t known
The code needs to be amended to look like this:
EVP_MD_CTX *md_ctx; md_ctx = EVP_MD_CTX_new(); if (md_ctx == NULL) /* Error */; /* Do something with the md_ctx */ EVP_MD_CTX_free(md_ctx);
3) Support for TLSv1.3 has been added which has a number of implications for SSL/TLS applications. See the TLS1.3 page for further details.
More details about the breaking changes between OpenSSL versions 1.0.2 and 1.1.0 can be found on the OpenSSL 1.1.0 Changes page.
Upgrading from the OpenSSL 2.0 FIPS Object Module[edit]
The OpenSSL 2.0 FIPS Object Module was a separate download that had to be built separately and then integrated into your main OpenSSL 1.0.2 build. In OpenSSL 3.0 the FIPS support is fully integrated into the mainline version of OpenSSL and is no longer a separate download. You do not need to take separate build steps to add the FIPS support - it is built by default. You do need to take steps to ensure that your application is using the FIPS module in OpenSSL 3.0. See the further notes below on configuring this.
The function calls 'FIPS_mode()' and 'FIPS_mode_set()' have been removed from OpenSSL 3.0. You should rewrite your application to not use them. See the sections below on how to write applications to use the FIPS Module in OpenSSL 3.0.
Completing the installation of the FIPS Module[edit]
Starting with OpenSSL 3.0.0 alpha16, no separate installation step for the FIPS module (a.k.a FIPS provider) is necessary anymore. It will be built and installed automatically if FIPS support has been configured. The current documentation can be found in the README-FIPS file on the master branch.
The documentation in the remaining section applies to alpha versions up to OpenSSL 3.0.0 alpha15.
Once OpenSSL has been built and installed you will need to take explicit steps to complete the installation of the FIPS module (if you wish to use it). The OpenSSL 3.0 FIPS support is in the form of the FIPS provider which, on Unix, is in a `fips.so` file. On Windows this will be called `fips.dll`. Following installation of OpenSSL 3.0 the default location for this file is '/usr/local/lib/ossl-modules/fips.so' on Unix or 'C:\Program Files\OpenSSL\lib\ossl-modules\fips.dll' on Windows.
To complete the installation you need to run the 'fipsinstall' command line application. This does 2 things:
- Runs the FIPS module self tests
- Generates FIPS module config file output containing information about the module such as the self test status, and the module checksum
The FIPS module must have the self tests run, and the FIPS module config file output generated on every machine that it is to be used on. You must not copy the FIPS module config file output data from one machine to another.
For example, to install the FIPS module to its default location:
$ openssl fipsinstall -out /usr/local/ssl/fipsmodule.cnf -module /usr/local/lib/ossl-modules/fips.so
If you installed OpenSSL to a different location, you need to adjust the output and module path accordingly.
Programming in OpenSSL 3.0[edit]
Applications written to work with OpenSSL 1.1.1 will mostly just work with OpenSSL 3.0. However changes will be required if you want to take advantage of some of the new features that OpenSSL 3.0 makes available. In order to do that you need to understand some new concepts introduced in OpenSSL 3.0.
Library Contexts[edit]
A library context can be thought of as a "scope" for OpenSSL operations. All functionality operates with the scope of a library context. Multiple library contexts may exist at the same time, and they each may be configured differently. A library context is represented by the newly introduced OSSL_LIB_CTX type. See the man page here.
Note: In alpha releases of OpenSSL 3.0.0 up until alpha6, the OSSL_LIB_CTX was called OPENSSL_CTX. It was renamed for OpenSSL 3.0.0 alpha7. If you are still using an alpha6 release or earlier, take a look at this older version of the wiki page.
Many new functions have been introduced into OpenSSL that take an OSSL_LIB_CTX parameter. In many cases these are variants of some other function that existed in 1.1.1 and work in much the same way - except that they now operate within the scope of the given library context.
All applications have available to them the "default library context". This library context always exists and, if you don't otherwise specify one, this is the library context that will be used. Any function that takes an OSSL_LIB_CTX value as a parameter will accept the value NULL for that parameter in order to refer to the default library context. You can also explicitly create new ones via the OSSL_LIB_CTX_new() function. See the man page for further details.
Config files affect a given library context. It is quite possible to have multiple library contexts in use, with each one having been configured with a different config file (see the OSSL_LIB_CTX_load_config() function described on the man page).
Providers[edit]
Providers are containers for algorithm implementations. Whenever a cryptographic algorithm is used via the high level APIs a provider is selected. It is that provider implementation that actually does the required work. There are five providers distributed with OpenSSL. In the future we expect third parties to distribute their own providers which can be added to OpenSSL dynamically. Documentation about writing providers is available on the man page here.
The standard providers are:
- The default provider. This collects together all of the standard built-in OpenSSL algorithm implementations. If an application doesn't specify anything else explicitly (e.g. in the application or via config), then this is the provider that will be used. It is loaded automatically the first time that we try to get an algorithm from a provider if no other provider has been loaded yet. If another provider has already been loaded then it won't be loaded automatically. Therefore if you want to use it in conjunction with other providers then you must load it explicitly. This is a "built-in" provider which means that it is built into libcrypto and does not exist as a separate standalone module.
- The legacy provider. This is a collection of legacy algorithms that are either no longer in common use or strongly discouraged from use. However some applications may need to use these algorithms for backwards compatibility reasons. This provider is NOT loaded by default. This may mean that some applications upgrading from earlier versions of OpenSSL may find that some algorithms are no longer available unless they load the legacy provider explicitly. Algorithms in the legacy provider include MD2, MD4, MDC2, RMD160, CAST5, BF (Blowfish), IDEA, SEED, RC2, RC4, RC5 and DES (but not 3DES).
- The FIPS provider. This contains a sub-set of the algorithm implementations available from the default provider. Algorithms available in this provider conform to FIPS standards. It is intended that this provider will be FIPS140-2 validated. In some cases there may be minor behavioural differences between algorithm implementations in this provider compared to the equivalent algorithm in the default provider. This is typically in order to conform to FIPS standards.
- The base provider. This contains a small sub-set of non-cryptographic algorithms available in the default provider. For example algorithms to encode and decode keys to files. If you do not load the default provider then you should always load this one instead (including if you are using the FIPS provider).
- The null provider. This provider is "built-in" to libcrypto and contains no algorithm implementations. In order to guarantee that the default provider is not automatically loaded, the null provider can be loaded instead. This can be useful if you are using non-default library contexts and want to ensure that the default library context is never used "by accident".
Providers to be loaded can be specified in the OpenSSL config file. See the man page herefor information about how to configure providers via the config file, and how to automatically activate them.
This is a minimal config file example to load and activate both the legacy and the default provider in the default library context.
openssl_conf = openssl_init [openssl_init] providers = provider_sect [provider_sect] default = default_sect legacy = legacy_sect [default_sect] activate = 1 [legacy_sect] activate = 1
It is also possible to load them programmatically. For example you can load the legacy provider into the default library context as shown below. Note that once you have explicitly loaded a provider into the library context the default provider will no longer be automatically loaded. Therefore you will often also want to explicitly load the default provider, as is done here:
#include <stdio.h> #include <stdlib.h> #include <openssl/provider.h> int main(void) { OSSL_PROVIDER *legacy; OSSL_PROVIDER *deflt; /* Load Multiple providers into the default (NULL) library context */ legacy = OSSL_PROVIDER_load(NULL, "legacy"); if (legacy == NULL) { printf("Failed to load Legacy provider\n"); exit(EXIT_FAILURE); } deflt = OSSL_PROVIDER_load(NULL, "default"); if (deflt == NULL) { printf("Failed to load Default provider\n"); OSSL_PROVIDER_unload(legacy); exit(EXIT_FAILURE); } /* Rest of application */ OSSL_PROVIDER_unload(legacy); OSSL_PROVIDER_unload(deflt); exit(EXIT_SUCCESS); }
Fetching algorithms and property queries[edit]
In order to use a cryptographic algorithm (such as AES) then an implementation for it must first be "fetched" from the available providers that have been loaded into the library context being used. This can be done either implicitly or explicitly.
With implicit fetching the application does not need to do anything special. Algorithms implementations will be fetched automatically by the relevant APIs. For example:
EVP_MD_CTX *mdctx; mdctx = EVP_MD_CTX_new(); if (mdctx == NULL) goto err; if (EVP_DigestInit_ex(mdctx, EVP_sha256(), NULL) != 1) goto err;
In this code we are initialising a digest operation to use the SHA256 algorithm. The EVP_DigestInit_ex() function will automatically fetch an implementation of the SHA256 algorithm from the available providers when it needs to. It will do so using the default library context and the default property query string (see below).
With explicit fetching an application fetches the implementation to be used up front, and then passes that to the relevant EVP API. For example:
EVP_MD_CTX *mdctx; EVP_MD *sha256; mdctx = EVP_MD_CTX_new(); if (mdctx == NULL) goto err; /* * Setting the library ctx to NULL here fetches the algorithm from the providers loaded * into the default library context */ sha256 = EVP_MD_fetch(NULL, "SHA2-256", NULL); if (sha256 == NULL) goto err; if (EVP_DigestInit_ex(mdctx, sha256, NULL) != 1) goto err; /* Explicit fetches return a dynamic object that must be freed */ EVP_MD_free(sha256);
In this example we have explicitly fetched an implementation of SHA256 from the set of available providers loaded into the default library context.
With an explicit fetch we can additionally supply a property query to further specify which implementation we wish to obtain. For example:
sha256 = EVP_MD_fetch(NULL, "SHA2-256", "fips=yes");
Here we are explicitly fetching a FIPS validated implementation of the SHA256 algorithm. Such an implementation exists in the FIPS provider, so we would need to have ensured that the FIPS provider was loaded into the default library context in order for this to be successful. If no algorithm implementation that matches the criteria can be located then the fetch will fail.
See the section on fetching algorithms in the provider man page for further details: [1].
If no specific property query is required then NULL can be passed for the last argument. In any case any supplied property query is combined with the default property query. If nothing else is specified then the default property query is empty. However this can be changed so that every fetch automatically inherits these default properties. Default properties can either be set programmatically or via a config file. See the section Loading the FIPS module at the same time as other providers for an example of how to do this.
Using the FIPS Module in applications[edit]
There are a number of different ways that OpenSSL can be used in conjunction with the FIPS module. Which is the correct approach to use will depend on your own specific circumstances and what you are attempting to achieve. Note that the old functions FIPS_mode() and FIPS_mode_set() are no longer present so you must remove them from your application if you use them.
Applications written to use the OpenSSL 3.0 FIPS module should not use any legacy APIs or features that avoid the FIPS module. Specifically this includes:
- Low level cryptographic APIs (use the high level APIs, such as EVP, instead)
- Engines
- Any functions that create or modify custom "METHODS" (for example EVP_MD_meth_new, EVP_CIPHER_meth_new, EVP_PKEY_meth_new, RSA_meth_new, EC_KEY_METHOD_new, etc.)
All of the above APIs are deprecated in OpenSSL 3.0 - so a simple rule is to avoid using all deprecated functions.
Making all applications use the FIPS module by default[edit]
One simple approach is to cause all applications that are using OpenSSL to only use the FIPS module for cryptographic algorithms by default.
This approach can be done purely via configuration. As long as applications are built and linked against OpenSSL 3.0 and do not override the loading of the default config file or its settings then they can automatically start using the FIPS module without the need for any further code changes.
To do this the default OpenSSL config file will have to be modified. The location of this config file will depend on the platform, and any options that were given during the build process. You can check the location of the config file by running this command:
$ openssl version -d OPENSSLDIR: "/usr/local/ssl"
Caution: Many Operating Systems install OpenSSL by default. It is a common error to not have the correct version of OpenSSL on your $PATH. Check that you are running an OpenSSL 3.0 version like this:
$ openssl version -v OpenSSL 3.0.0-dev xx XXX xxxx (Library: OpenSSL 3.0.0-dev xx XXX xxxx)
The OPENSSLDIR value above gives the directory name for where the default config file is stored. So in this case the default config file will be called /usr/local/ssl/openssl.cnf
Edit the config file to add the following lines near the beginning:
openssl_conf = openssl_init .include /usr/local/ssl/fipsmodule.cnf [openssl_init] providers = provider_sect [provider_sect] fips = fips_sect base = base_sect [base_sect] activate = 1
Obviously the include file location above should match the name of the FIPS module config file that you installed earlier.
Any applications that use OpenSSL 3.0 and are started after these changes are made will start using only the FIPS module unless those applications take explicit steps to avoid this default behaviour. Note that this configuration also activates the "base" provider. The base provider does not include any cryptographic algorithms (and therefore does not impact the validation status of any cryptographic operations), but does include other supporting algorithms that may be required. It is designed to be used in conjunction with the FIPS module.
This approach has the primary advantage that it is simple, and no code changes are required in applications in order to benefit from the FIPS module. There are some disadvantages to this approach:
- You may not want all applications to use the FIPS module. It may be the case that some applications should and some should not.
- If applications take explicit steps to not load the default config file or set different settings then this method will not work for them
- The algorithms available in the FIPS module are a subset of the algorithms that are available in the default OpenSSL Provider. If those applications attempt to use any algorithms that are not present, then they will fail.
- Usage of certain deprecated APIs avoids the use of the FIPS module. If any applications use those APIs then the FIPS module will not be used.
Selectively making applications use the FIPS module by default[edit]
A variation on the above approach is to do the same thing on an individual application basis. The default OpenSSL config file depends on the compiled in value for OPENSSLDIR as described in the section above. However it is also possible to override the config file to be used via the OPENSSL_CONF environment variable. For example the following on Unix will cause the application to be executed with a non-standard config file location:
$ OPENSSL_CONF=/my/non-default/openssl.cnf myapplication
Using this mechanism you can control which config file is loaded (and hence whether the FIPS module is loaded) on an application by application basis.
This removes the disadvantage listed above that you may not want all applications to use the FIPS module. All the other advantages and disadvantages still apply.
Programmatically loading the FIPS module (default library context)[edit]
Applications may choose to load the FIPS provider explicitly rather than relying on config to do this. The config file is still necessary in order to hold the FIPS module config data (such as its self test status and integrity data). But in this case we do not automatically activate the FIPS provider via that config file.
To do things this way configure as per the section "Making all applications use the FIPS module by default" above, but edit the fipsmodule.cnf file to remove or comment out the line which says "activate = 1" (note that setting this value to 0 is not sufficient). This means all the required config information will be available to load the FIPS module, but it is not actually automatically loaded when the application starts. The FIPS provider can then be loaded programmatically like this:
#include <openssl/provider.h> int main(void) { OSSL_PROVIDER *fips; OSSL_PROVIDER *base; fips = OSSL_PROVIDER_load(NULL, "fips"); if (fips == NULL) { printf("Failed to load FIPS provider\n"); exit(EXIT_FAILURE); } base = OSSL_PROVIDER_load(NULL, "base"); if (base == NULL) { OSSL_PROVIDER_unload(fips); printf("Failed to load base provider\n"); exit(EXIT_FAILURE); } /* Rest of application */ OSSL_PROVIDER_unload(base); OSSL_PROVIDER_unload(fips); exit(EXIT_SUCCESS); }
Note that this should be one of the first things that you do in your application. If any OpenSSL functions get called that require the use of cryptographic functions before this occurs then, if no provider has yet been loaded, then the default provider will be automatically loaded. If you then later explicitly load the FIPS provider then you will have both the FIPS and the default provider loaded at the same time. It is undefined which implementation of an algorithm will be used if multiple implementations are available and you have not explicitly specified via a property query (see below) which one should be used.
Also note that in this example we have additionally loaded the "base" provider. This loads a sub-set of algorithms that are also available in the default provider - specifically non cryptographic ones which may be used in conjunction with the FIPS provider. For example this contains algorithms for encoding and decoding keys. If you decide not to load the default provider then you will usually want to load the base provider instead.
Loading the FIPS module at the same time as other providers[edit]
It is possible to have the FIPS provider and other providers (such as the default provider) all loaded at the same time into the same library context. You can use a property query string during algorithm fetches to specify which implementation you would like to use.
For example to fetch an implementation of SHA256 which conforms to FIPS standards you can specify the property query "fips=yes" like this:
EVP_MD *sha256; sha256 = EVP_MD_fetch(NULL, "SHA2-256", "fips=yes");
If no property query is specified, or more than one implementation matches the property query then it is undefined which implementation of a particular algorithm will be returned.
This example shows an explicit request for an implementation of SHA256 from the default provider:
EVP_MD *sha256; sha256 = EVP_MD_fetch(NULL, "SHA2-256", "provider=default");
It is also possible to set a default property query string. The following example sets the default property query of "fips=yes" for all fetches within the default library context:
EVP_set_default_properties(NULL, "fips=yes");
If a fetch function has both an explicit property query specified, and a default property query is defined then the two queries are merged together and both apply. The local property query overrides the default properties if the same property name is specified in both.
There are two important built-in properties that you should be aware of:
The "provider" property enables you to specify which provider you want an implementation to be fetched from, e.g. "provider=default" or "provider=fips". All algorithms implemented in a provider have this property set on them.
There is also the "fips" property. All FIPS algorithms match against the property query "fips=yes". There are also some non-cryptographic algorithms available in the default and base providers that also have the "fips=yes" property defined for them. These are the encoder and decoder algorithms that can (for example) be used to write out a key generated in the FIPS provider to a file. The encoder and decoder algorithms are not in the FIPS module itself but are allowed to be used in conjunction with the FIPS algorithms.
It is possible to specify default properties within a config file. For example the following config file automatically loads the default and fips providers and sets the default property value to be "fips=yes". Note that this config file does not load the "base" provider. All supporting algorithms that are in "base" are also in "default", so it is unnecessary in this case:
openssl_conf = openssl_init .include /usr/local/ssl/fipsmodule.cnf [openssl_init] providers = provider_sect alg_section = algorithm_sect [provider_sect] fips = fips_sect default = default_sect [default_sect] activate = 1 [algorithm_sect] default_properties = fips=yes
Programmatically loading the FIPS module (non-default library context)[edit]
In addition to using properties to separate usage of the FIPS module from other usages this can also be achieved using library contexts. In this example we create two library contexts. In one we assume the existence of a config file called "openssl-fips.cnf" that automatically loads and configures the FIPS and base providers. The other library context will just use the default provider.
OSSL_LIB_CTX *fipslibctx, *nonfipslibctx; OSSL_PROVIDER *defctxnull = NULL; EVP_MD *fipssha256 = NULL, *nonfipssha256 = NULL; int ret = 1; /* * Create two non-default library contexts. One for fips usage and one for * non-fips usage */ fipslibctx = OSSL_LIB_CTX_new(); nonfipslibctx = OSSL_LIB_CTX_new(); if (fipslibctx == NULL || nonfipslibctx == NULL) goto err; /* Prevent anything from using the default library context */ defctxnull = OSSL_PROVIDER_load(NULL, "null"); /* * Load config file for the FIPS library context. We assume that this * config file will automatically activate the FIPS and base providers so we * don't need to explicitly load them here. */ if (!OSSL_LIB_CTX_load_config(fipslibctx, "openssl-fips.cnf")) goto err; /* * We don't need to do anything special to load the default provider into * nonfipslibctx. This happens automatically if no other providers are * loaded. Because we don't call OSSL_LIB_CTX_load_config() explicitly for * nonfipslibctx it will just use the default config file. */ /* As an example get some digests */ /* Get a FIPS validated digest */ fipssha256 = EVP_MD_fetch(fipslibctx, "SHA2-256", NULL); if (fipssha256 == NULL) goto err; /* Get a non-FIPS validated digest */ nonfipssha256 = EVP_MD_fetch(nonfipslibctx, "SHA2-256", NULL); if (nonfipssha256 == NULL) goto err; /* Use the digests */ printf("Success\n"); ret = 0; err: EVP_MD_free(fipssha256); EVP_MD_free(nonfipssha256); OSSL_LIB_CTX_free(fipslibctx); OSSL_LIB_CTX_free(nonfipslibctx); OSSL_PROVIDER_unload(defctxnull); return ret;
Note that we have made use of the special "null" provider here which we load into the default library context. We could have chosen to use the default library context for FIPS usage, and just create one additional library context for other usages - or vice versa. However if code has not been converted to use library contexts then the default library context will be automatically used. This could be the case for your own existing applications as well as certain parts of OpenSSL itself. Not all parts of OpenSSL are library context aware. If this happens then you could "accidentally" use the wrong library context for a particular operation. To be sure this doesn't happen you can load the "null" provider into the default library context. Because a provider has been explicitly loaded, the default provider will not automatically load. This means code using the default context by accident will fail because no algorithms will be available.
Using Encoders and Decoders with the FIPS module[edit]
Encoders and decoders are used to read and write keys or parameters from or to some external format (for example a PEM file). If your application generates keys or parameters that then need to be written into PEM or DER format then it is likely that you will need to use a encoder to do this. Similarly you need a decoder to read previously saved keys and parameters. In most cases this will be invisible to you if you are using APIs that existed in OpenSSL 1.1.1 or earlier such as i2d_PrivateKey. However the appropriate encoder/decoder will need to be available in the library context associated with the key or parameter object. The built-in OpenSSL encoder and decoder are implemented in both the default and base providers and are not in the FIPS module boundary. However since they are not cryptographic algorithms themselves it is still possible to use them in conjunction with the FIPS module, and therefore these encoder/decoder have the "fips=yes" property against them. You should ensure that either the default or base provider is loaded into the library context in this case.
Using the FIPS module in SSL/TLS[edit]
Writing an application that uses libssl in conjunction with the FIPS module is much the same as writing a normal libssl application. If you are using global properties and the default library context to specify usage of FIPS validated algorithms then this will happen automatically for all cryptographic algorithms in libssl. If you are using a non-default library context to load the FIPS provider then you can supply this to libssl using the function SSL_CTX_new_ex(). This works as a drop in replacement for the function SSL_CTX_new() except it provides you with the capability to specify the library context to be used. You can also use the same function to specify libssl specific properties to use.
In this first example we create two SSL_CTX objects using two different library contexts.
/* * We assume that a non-default library context with the FIPS provider loaded has been * created called fips_libctx. / SSL_CTX *fips_ssl_ctx = SSL_CTX_new_ex(fips_libctx, NULL, TLS_method()); /* * We assume that a non-default library context with the default provider loaded has been * created called non_fips_libctx. / SSL_CTX *non_fips_ssl_ctx = SSL_CTX_new_ex(non_fips_libctx, NULL, TLS_method());
In this second example we create two SSL_CTX objects using different properties to specify FIPS usage:
/* * The "fips=yes" property includes all FIPS approved algorithms as well as encoders from the * default provider that are allowed to be used. The NULL below indicates that we are using the * default library context. */ SSL_CTX *fips_ssl_ctx = SSL_CTX_new_ex(NULL, "fips=yes", TLS_method()); /* * The "provider!=fips" property allows algorithms from any provider except the FIPS provider */ SSL_CTX *non_fips_ssl_ctx = SSL_CTX_new_ex(NULL, "provider!=fips", TLS_method());
Confirming that an algorithm is being provided by the FIPS module[edit]
A chain of links needs to be followed to go from an algorithm instance to the provider that implements it. The process is similar for all algorithms. Here the example of a digest is used.
- To go from an EVP_MD_CTX to an EVP_MD, use the EVP_MD_CTX_md() call.
- To go from the EVP_MD to its OSSL_PROVIDER, use the EVP_MD_provider() call.
- To extract the name from the OSSL_PROVIDER, use the OSSL_PROVIDER_name() call.
- Finally, use strcmp(3) or printf(3) on the name.
Openssl command line application changes[edit]
The following additional command line arguments have been added
-provider_path path_name - Provider load path -provider provider_name - Provider to load
These options can be used multiple times to load any providers, such as the 'legacy' provider or third party providers. If used then the 'default' provider would also need to be specified if required. The -provider_path must be specified before the -provider option.
STATUS of current development[edit]
[this is a collection of notes, changing as time and alpha / beta releases go]
The current status of OpenSSL 3.0 is in development
The next status is expected to be alpha
Known issues[edit]
Building and testing[edit]
- Doesn't build and test on all platforms on our watch list. See the list of platforms below
- To be noted that we can't pretend to build on everything and anything, but there are a number of platforms that we watch, either on our own or with community help and reporting
Integration[edit]
(these issues are tracked in a table further down)
- PKCS#7, CMS, SSL/TLS don't work with asymmetric keys implemented by a provider. There's a temporary hack in place that "downgrades" such keys to work with legacy methods (EVP_PKEY_METHOD and EVP_PKEY_ASN1_METHOD)
- CMP/CRMF, PKCS#7, TS, CMS, PKCS#12 and OSSL_STORE currently have no library context support
- OCSP, PEM, ASN.1 have some very limited library context support
- It is not yet possible to "fetch" a RAND algorithm
Programming[edit]
- EVP_set_default_properties() does not work (see github #11594)
SSL/TLS[edit]
- libssl does not currently detect what signature algorithms are available within the currently loaded providers. Unless explicitly configured differently endpoints will advertise to peers the default list of signature algorithms that are supported - even if those are not available in the currently loaded providers. This could result in handshake failures. As a workaround until this is fixed you should explicitly configure signature algorithms that are consistent with the loaded providers.
Platforms[edit]
These are platforms that have been observed so far. More will be added.
Platform | Builds | Tests | Comment |
---|---|---|---|
Linux - x86 / x86_64 | Yes | Yes | |
Linux - s390x | Yes | Yes | |
FreeBSD - aarch64 | Yes | Yes | Tested on 13.0-CURRENT |
FreeBSD - amd64 | Yes | Yes | Tested on 12.1-STABLE and 11.3-STABLE |
FreeBSD - i386 | Yes | Yes | Had to run ./config no-pic due to lack of CAST PIC support
|
Windows + Visual C - x86 / x86_64 | Yes | Yes | |
MacOS X | Yes | Yes | |
OpenVMS - Alpha / Itanium | No | Unknown | New include directories need to be dealt with, and more elegantly than the 1.1.1 kludge |
Features[edit]
All the core support features are in.
The percentages in the tables below represent the amount of work done to convert legacy implementations to a provider based ones. Algorithms for which the conversion hasn't been completed (or ever started) remain full functional via the legacy code paths.
Provider implemented operation types[edit]
Operation type | Code completion % | Documentation completion % | Comment |
---|---|---|---|
EVP_DIGEST | 100% | ?? | |
EVP_CIPHER | 100% | ?? | |
EVP_MAC | 100% | ?? | |
EVP_KDF | 100% | ?? | |
EVP_ASYM_CIPHER | 100% | ?? | |
EVP_KEYEXCH | 100% | ?? | |
EVP_SIGNATURE | 100% | ?? | |
EVP_KEYMGMT | 95% | 70% | Missing functionality for loading HSM keys |
OSSL_ENCODER | 100% | 100% | |
OSSL_DECODER | 100% | 100% | |
OSSL_STORE | 0% | 0% |
Provider implemented ciphers[edit]
Algorithm | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
AES | default, FIPS | 100% | ?? | |
ARIA | default | 100% | ?? | |
BF | legacy | 100% | ?? | |
CAMELLIA | default | 100% | ?? | |
CAST | legacy | 100% | ?? | |
DES | legacy | 100% | ?? | |
DESX | legacy | 100% | ?? | |
DES-EDE3 | default, FIPS | 100% | ?? | For FIPS, only DES-EDE3-ECB and DES-EDE3-CBC |
IDEA | legacy | 100% | ?? | |
RC2 | legacy | 100% | ?? | |
RC4 | legacy | 100% | ?? | |
RC5 | legacy | 100% | ?? | |
SEED | legacy | 100% | ?? | |
SM4 | default | 100% | ?? |
Provider implemented digests[edit]
Algorithm | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
BLAKE2 | default | 100% | ?? | |
SM3 | default | 100% | ?? | |
MD2 | legacy | 100% | ?? | |
MD4 | legacy | 100% | ?? | |
MD5, MD5-SHA1 | default | 100% | ?? | MD5-SHA1 is a TLS special, not otherwise useful |
MDC2 | legacy | 100% | ?? | |
SHA1 | default, FIPS | 100% | ?? | |
SHA2 | default, FIPS | 100% | ?? | |
SHA3 | default, FIPS | 100% | ?? | |
SHAKE | default, FIPS | 100% | ?? | For the FIPS provider, only SHAKE-256 is available, not SHAKE-128. |
RIPEMD-160 | leagcy | 100% | ?? | |
WHIRLPOOL | legacy | 100% | ?? |
Provider implemented MACs[edit]
Algorithm | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
BLAKE2 | default | 100% | ?? | |
CMAC | default | 100% | ?? | |
GMAC | default, FIPS | 100% | ?? | |
HMAC | default, FIPS | 100% | ?? | |
KMAC | default | 100% | ?? | |
POLY1305 | default | 100% | ?? | |
SIPHASH | default | 100% | ?? |
Provider implemented KDFs[edit]
Algorithm | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
HKDF | default, FIPS | 100% | ?? | |
KBKDF | default | 100% | ?? | |
KRB5KDF | default | 100% | ?? | Kerberos KDF |
PBKDF2 | default, FIPS | 100% | ?? | |
SCRYPT | default | 100% | ?? | |
SSKDF | default, FIPS | 100% | ?? | |
TLS1-PRF | default, FIPS | 100% | ?? | TLS 1.x PRF is treated as a KDF by OpenSSL |
X942KDF | default | 100% | ?? | |
X963KDF | default | 100% | ?? |
Provider implemented asymmetric key types[edit]
Key type | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
DH | default, FIPS | 95% | ?? | |
DSA | default, FIPS | 100% | ?? | |
EC | default, FIPS | 100% | ?? | |
ED25519, X25519, ED448, X448 | default, FIPS | 100% | ?? | Vendor affirmed for FIPS, they cannot yet be validated. |
RSA | default, FIPS | 100% | ?? | RSA-PSS or RSA-OAEP are considered separate key types, although the RSA EVP_ASYM_CIPHER and EVP_SIGNATURE implementations carry some of the corresponding properties. |
RSA-PSS | default | 100% | ?? | |
RSA-OAEP | default | 0% | ?? | |
SM2 | default | 0% | ?? |
Provider implemented asymmetric ciphers[edit]
Algorithm | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
RSA | default, FIPS | 80% | ?? | |
RSAES-OAEP | default | 80% | ?? |
Provider implemented signature[edit]
Algorithm | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
DSA | default, FIPS | 100% | ?? | |
ECDSA | default, FIPS | 100% | ?? | |
ED25519, ED448 | default, FIPS | 100% | ?? | In the FIPS provider, these are vendor affirmed. |
RSA, RSASSA-PSS | default, FIPS | 100% | ?? |
Provider implemented key exchange[edit]
Algorithm | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
DH | default, FIPS | 70% | ?? | We lack support for X9.42 DH, which is needed by CMS |
ECDH | default, FIPS | 100% | ?? | |
X25519, X448 | default, FIPS | 100% | ?? | In the FIPS provider, these are vendor affirmed. |
Provider implemented encoder / decoder[edit]
Encoders[edit]
Encoder | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
DH to printable text, DER, PEM | default | 100% | ?? | |
DSA to printable text, DER, PEM | default | 100% | ?? | |
ED25519 to printable text, DER, PEM | default | 100% | ?? | |
ED448 to printable text, DER, PEM | default | 100% | ?? | |
EC to printable text, DER, PEM | default | 100% | ?? | |
RSA to printable text, DER, PEM | default | 100% | ?? | |
RSA-PSS to printable text, DER, PEM | default | 100% | ?? | |
RSA-OAEP to printable text, DER, PEM | default | 0% ? | ?? | |
SM2 to printable text, DER, PEM | default | 0% ? | ?? | |
X25519 to printable text, DER, PEM | default | 100% | ?? | |
X448 to printable text, DER, PEM | default | 100% | ?? |
Decoders[edit]
TO BE ADDED
Decoder | Providers | Code completion % | Documentation completion % | Comment |
---|
Provider implemented OSSL_STORE URI schemes[edit]
URI scheme | Providers | Code completion % | Documentation completion % | Comment |
---|---|---|---|---|
file: | default (?) | 0% | ?? | This is pending on decoders |
Library Context/Provider implementation support in other OpenSSL APIs[edit]
Diverse OpenSSL APIs have been modified and continue to be modified to support provider implementations.
API | Code completion % | Documentation completion % | Comment |
---|---|---|---|
ASN1 | 5% | 5% | |
CMS | 0% | 0% | There are hacks in place that downgrade a key to legacy when used with CMS |
CMP | ?? | ?? | We need to investigate if we need to change anything |
CRMF | 5% | 0% | |
OCSP | 20% | 20% | All changes needed to pass the libssl test suite have been done. We need to investigate if further changes are required |
OSSL_STORE | 0% | 0% | |
PEM | 50% | 50% | Integrated with provider encoders for writing out keys and parameters |
PKCS#7 | 0% | 0% | There are hacks in place that downgrade a key to legacy when used with PKCS#7 |
PKCS#12 | 0% | 0% | |
SSL / TLS | 80% | 100% | There are hacks in place that downgrade a key to legacy in some situations. Some processing happens in libssl that should be moved to a provider. Presence of signature algorithms is not correctly detected |
TS | 0% | 0% | |
X509 | 80% | 80% | All changes needed to pass the libssl test suite have been done. We need to investigate if further changes are required |