PRECIS S. Whited Internet-Draft Individual Intended status: Standards Track September 18, 2018 Expires: March 22, 2019 Preparation, Enforcement, and Comparison of Internationalized Strings (PRECIS) Test Vectors draft-whited-precis-test-vectors-02 Abstract This document contains machine readable test vectors for several Preparation, Enforcement, and Comparison of Internationalized Strings (PRECIS) profiles. Status of This Memo This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on March 22, 2019. Copyright Notice Copyright (c) 2018 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License. Whited Expires March 22, 2019 [Page 1] Internet-Draft PRECIS: Tests September 2018 Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 1.1. Overview . . . . . . . . . . . . . . . . . . . . . . . . 2 1.2. Terminology . . . . . . . . . . . . . . . . . . . . . . . 3 2. Test Vectors . . . . . . . . . . . . . . . . . . . . . . . . 3 2.1. Methodology . . . . . . . . . . . . . . . . . . . . . . . 3 2.2. Enforcement Tests . . . . . . . . . . . . . . . . . . . . 3 2.2.1. Basic . . . . . . . . . . . . . . . . . . . . . . . . 3 2.2.2. Context Rule 1 . . . . . . . . . . . . . . . . . . . 3 2.2.3. Context Rule 2 . . . . . . . . . . . . . . . . . . . 4 2.2.4. Context Rule 3 . . . . . . . . . . . . . . . . . . . 5 2.2.5. Context Rule 4 . . . . . . . . . . . . . . . . . . . 5 2.2.6. Context Rule 5+6 . . . . . . . . . . . . . . . . . . 5 2.2.7. Context Rule 7 . . . . . . . . . . . . . . . . . . . 6 2.2.8. Context Rule 8+9 . . . . . . . . . . . . . . . . . . 6 2.2.9. Nickname . . . . . . . . . . . . . . . . . . . . . . 6 2.2.10. OpaqueString . . . . . . . . . . . . . . . . . . . . 7 2.2.11. UsernameCaseMapped . . . . . . . . . . . . . . . . . 8 2.2.12. UsernameCasePreserved . . . . . . . . . . . . . . . . 10 2.2.13. UsernameCaseMappedRestricted . . . . . . . . . . . . 10 2.3. Comparison Tests . . . . . . . . . . . . . . . . . . . . 10 2.3.1. Nickname . . . . . . . . . . . . . . . . . . . . . . 10 3. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 11 4. Security Considerations . . . . . . . . . . . . . . . . . . . 11 5. References . . . . . . . . . . . . . . . . . . . . . . . . . 11 Appendix A. Acknowledgements . . . . . . . . . . . . . . . . . . 11 Author's Address . . . . . . . . . . . . . . . . . . . . . . . . 11 1. Introduction 1.1. Overview This document contains machine readable test vectors for several Preparation, Enforcement, and Comparison of Internationalized Strings (PRECIS) [RFC8264] profiles. Two sets of vectors exist for profiles of the base classes. The first set tests the enforcement step. It takes the form of a table that contains an input string, an output string and an optional error. If the error column has a value of "ctx" it indicates that the context rule was violated, "empty" means that an empty string was disallowed, "rune" means that a disallowed code point (rune) was encountered, and "bidi" indicates that the BIDI Rule was violated. The second set tests the PRECIS comparison step. It takes the form of a table that contains two strings, a boolean that is TRUE if the two strings should be considered equal and FALSE otherwise, and an optional comment. Whited Expires March 22, 2019 [Page 2] Internet-Draft PRECIS: Tests September 2018 Vectors for inclusion of code points in the IdentifierClass and FreeformClass are not included. A complete list of valid inputs and Outputs for the derived property algorithm specified in [RFC8264] can be found in the IANA "PRECIS Derived Property Value" registry. 1.2. Terminology Many important terms used in this document are defined in [RFC8264], [RFC6365], and [Unicode]. 2. Test Vectors 2.1. Methodology The test vectors in this document have been verified by three independent implementations. An implementation that concurs with the results provided in this document should be interoperable with other implementations. Input and output strings are expressed as UTF-8 and hexidecimal encoded byte strings. 2.2. Enforcement Tests 2.2.1. Basic +------------+----------+-----+ | Input | Output | Err | +------------+----------+-----+ | 65cc81cc9f | c3a9cc9f | | +------------+----------+-----+ 2.2.2. Context Rule 1 Whited Expires March 22, 2019 [Page 3] Internet-Draft PRECIS: Tests September 2018 +------------------------------+------------------------------+-----+ | Input | Output | Err | +------------------------------+------------------------------+-----+ | e2808c | | ctx | | e2808c61 | | ctx | | 61e2808c | | ctx | | e2808cd8a7 | | ctx | | d8ace2808c | | ctx | | d890e2808cd890d8a7 | | ctx | | d8acd890e2808cd890 | | ctx | | d8ace2808cd8a7 | d8ace2808cd8a7 | | | d8acd890e2808cd890d8a7 | d8acd890e2808cd890d8a7 | | | d8acd890d890e2808cd890d890d8 | d8acd890d890e2808cd890d890d8 | | | a7 | a7 | | | d8acd890e2808cd8a7 | d8acd890e2808cd8a7 | | | d8ace2808cd890d8a7 | d8ace2808cd890d8a7 | | | eaa1b2e2808cd8ac | eaa1b2e2808cd8ac | | | eaa1b2d890e2808cd890d8ac | eaa1b2d890e2808cd890d8ac | | | eaa1b2d890d890e2808cd890d890 | eaa1b2d890d890e2808cd890d890 | | | d8ac | d8ac | | | eaa1b2d890e2808cd8ac | eaa1b2d890e2808cd8ac | | | eaa1b2e2808cd890d8ac | eaa1b2e2808cd890d8ac | | | e0a98de2808c | e0a98de2808c | | | eaa1b2e0a98de2808c | eaa1b2e0a98de2808c | | | eaa1b2e0a98dd890e2808c | | ctx | | eaa1b2e0a98dd890e2808c | | ctx | | e0ab8de2808c | e0ab8de2808c | | | eaa1b2e0ab8de2808c | eaa1b2e0ab8de2808c | | | eaa1b2e0ab8dd890e2808c | | ctx | | eaa1b2e0ab8dd890e2808c | | ctx | | eaa1b2e0ab8de2808cd8ac | eaa1b2e0ab8de2808cd8ac | | | eaa1b2e2808ce0ab8dd8ac | eaa1b2e2808ce0ab8dd8ac | | +------------------------------+------------------------------+-----+ 2.2.3. Context Rule 2 +--------------------+--------------------+-----+ | Input | Output | Err | +--------------------+--------------------+-----+ | e2808d | | ctx | | e2808d61 | | ctx | | 61e2808d | | ctx | | e0a98de2808d | e0a98de2808d | | | eaa1b2e0a98de2808d | eaa1b2e0a98de2808d | | | e0a98d61e2808d | | ctx | +--------------------+--------------------+-----+ Whited Expires March 22, 2019 [Page 4] Internet-Draft PRECIS: Tests September 2018 2.2.4. Context Rule 3 +--------------+--------------+-----+ | Input | Output | Err | +--------------+--------------+-----+ | c2b7 | | ctx | | 6cc2b7 | | ctx | | c2b76c | | ctx | | 61c2b7 | | ctx | | 6cc2b761 | | ctx | | 61c2b761 | | ctx | | 6cc2b76c | 6cc2b76c | | | 616cc2b76c61 | 616cc2b76c61 | | +--------------+--------------+-----+ 2.2.5. Context Rule 4 +------------------+------------------+-----+ | Input | Output | Err | +------------------+------------------+-----+ | cdb5 | | ctx | | cdb561 | | ctx | | ceb1cdb5 | | ctx | | cdb5ceb1 | cdb5ceb1 | | | ceb1cdb5ceb1 | ceb1cdb5ceb1 | | | cdb5cdb5ceb1 | cdb5cdb5ceb1 | | | ceb1cdb5cdb5ceb1 | ceb1cdb5cdb5ceb1 | | | ceb1cdb5cdb5 | | ctx | | ceb1cdb5cdb561 | | ctx | +------------------+------------------+-----+ 2.2.6. Context Rule 5+6 +--------------------+--------------------+-----+ | Input | Output | Err | +--------------------+--------------------+-----+ | d7b3 | | ctx | | d7b3d794 | | ctx | | 61d7b362 | | ctx | | d7a9d7b3 | d7a9d7b3 | | | d7a9d7b3d7b3d7b3 | d7a9d7b3d7b3d7b3 | | | d7b4 | | ctx | | d7b4d794 | | ctx | | 61d7b462 | | ctx | | d7a9d7b4 | d7a9d7b4 | | | d7a9d7b4d7b4d7b4 | d7a9d7b4d7b4d7b4 | | | 61d7a9d7b4d7b4d7b4 | 61d7a9d7b4d7b4d7b4 | | +--------------------+--------------------+-----+ Whited Expires March 22, 2019 [Page 5] Internet-Draft PRECIS: Tests September 2018 2.2.7. Context Rule 7 +------------------------+------------------------+-----+ | Input | Output | Err | +------------------------+------------------------+-----+ | e383bb | | ctx | | 616263e383bb | | ctx | | e383bb646566 | | ctx | | 616263e383bb646566 | | ctx | | 61e3838563e383bb646566 | 61e3838563e383bb646566 | | | 616263e383bb64e381b666 | 616263e383bb64e381b666 | | | e2ba906263e383bb646566 | e2ba906263e383bb646566 | | +------------------------+------------------------+-----+ 2.2.8. Context Rule 8+9 +--------------------------+----------------------+-----+ | Input | Output | Err | +--------------------------+----------------------+-----+ | d9a1d9a2d9a3d9a4d9a5dbb6 | | ctx | | dbb1dbb2dbb3dbb4dbb5d9a6 | | ctx | | d9a1d9a2d9a3d9a4d9a5 | d9a1d9a2d9a3d9a4d9a5 | | | dbb1dbb2dbb3dbb4dbb5 | dbb1dbb2dbb3dbb4dbb5 | | +--------------------------+----------------------+-----+ 2.2.9. Nickname Whited Expires March 22, 2019 [Page 6] Internet-Draft PRECIS: Tests September 2018 +---------------------------------------+---------------------+-----+ | Input | Output | Err | +---------------------------------------+---------------------+-----+ | 20205377616e20206f6620202041766f6e202 | 5377616e206f6620417 | | | 020 | 66f6e | | | | | emp | | | | ty | | 20 | | emp | | | | ty | | 2020 | | emp | | | | ty | | 61c2a061e19a8061e2808061e2808161e2808 | 6120612061206120612 | | | 261e2808361e2808461e2808561e2808661e2 | 0612061206120612061 | | | 808761e2808861e2808961e2808a61e280af6 | 2061206120612061206 | | | 1e2819f61e3808061 | 120612061 | | | 466f6f | 466f6f | | | 666f6f | 666f6f | | | 466f6f20426172 | 466f6f20426172 | | | 666f6f20626172 | 666f6f20626172 | | | cea3 | cea3 | | | cf83 | cf83 | | | cf82 | cf82 | | | e2999a | e2999a | | | 5269636861726420e285a3 | 5269636861726420495 | | | | 6 | | | e284ab | c385 | | | efac80 | 6666 | | | d7a961 | d7a961 | | | eb8f99ec9dbceca1b0eab1b4ebb380eab2bde | eb8f99ec9dbceca1b0e | | | d9788eb9dbd | ab1b4ebb380eab2bded | | | | 9788eb9dbd | | +---------------------------------------+---------------------+-----+ 2.2.10. OpaqueString Whited Expires March 22, 2019 [Page 7] Internet-Draft PRECIS: Tests September 2018 +---------------------------------------+---------------------+-----+ | Input | Output | Err | +---------------------------------------+---------------------+-----+ | 20205377616e20206f6620202041766f6e202 | 20205377616e20206f6 | | | 020 | 620202041766f6e2020 | | | | 20 | | | | | emp | | | | ty | | 20 | 20 | | | 2020 | 2020 | | | 61c2a061e19a8061e2808061e2808161e2808 | 6120612061206120612 | | | 261e2808361e2808461e2808561e2808661e2 | 0612061206120612061 | | | 808761e2808861e2808961e2808a61e280af6 | 2061206120612061206 | | | 1e2819f61e3808061 | 120612061 | | | 466f6f | 466f6f | | | 666f6f | 666f6f | | | 466f6f20426172 | 466f6f20426172 | | | 666f6f20626172 | 666f6f20626172 | | | cf83 | cf83 | | | 5269636861726420e285a3 | 5269636861726420e28 | | | | 5a3 | | | e284ab | c385 | | | 4a61636b206f6620e299a673 | 4a61636b206f6620e29 | | | | 9a673 | | | 6d7920636174206973206120096279 | | run | | | | e | | d7a961 | d7a961 | | +---------------------------------------+---------------------+-----+ 2.2.11. UsernameCaseMapped Whited Expires March 22, 2019 [Page 8] Internet-Draft PRECIS: Tests September 2018 +-----------------------------+------------------------------+------+ | Input | Output | Err | +-----------------------------+------------------------------+------+ | 6a756c696574406578616d706c6 | 6a756c696574406578616d706c65 | | | 52e636f6d | 2e636f6d | | | 6675737362616c6c | 6675737362616c6c | | | 6675c39f62616c6c | 6675c39f62616c6c | | | cf80 | cf80 | | | cea3 | cf83 | | | cf83 | cf83 | | | cf82 | cf82 | | | 49 | 69 | | | 49 | 69 | | | cf92 | | rune | | ceb0 | ceb0 | | | 666f6f20626172 | | rune | | e2999a | | bidi | | 7e | 7e | | | 61 | 61 | | | 21 | 21 | | | c2b2 | | bidi | | 09 | | rune | | 0a | | rune | | e29b96 | | bidi | | e29bbf | | bidi | | efac80 | | rune | | e19a80 | | bidi | | 20 | | rune | | 2020 | | rune | | c785 | | rune | | e19bae | | rune | | d288 | | bidi | | e284ab | c3a5 | | | 41cc8a | c3a5 | | | c385 | c3a5 | | | c3a7 | c3a7 | | | 63cca7 | c3a7 | | | c598 | c599 | | | 52cc8c | c599 | | | e1b9a1 | e1b9a1 | | | d090 | d0b0 | | | efbca1efbca2 | 6162 | | | d7a963 | | bidi | +-----------------------------+------------------------------+------+ Whited Expires March 22, 2019 [Page 9] Internet-Draft PRECIS: Tests September 2018 2.2.12. UsernameCasePreserved +--------------+--------+------+ | Input | Output | Err | +--------------+--------+------+ | 414243 | 414243 | | | efbca1efbca2 | 4142 | | | d7a963 | | bidi | | efac80 | | rune | | e284ab | c385 | | | e1ba9b | | rune | +--------------+--------+------+ 2.2.13. UsernameCaseMappedRestricted +--------------------------------------+--------+------+ | Input | Output | Err | +--------------------------------------+--------+------+ | 6a756c696574406578616d706c652e636f6d | | rune | | 49 | 69 | | +--------------------------------------+--------+------+ 2.3. Comparison Tests 2.3.1. Nickname +-----------------------------------+----------------------+--------+ | A | B | Result | +-----------------------------------+----------------------+--------+ | 61 | 62 | false | | 20205377616e20206f6620202041766f6 | 7377616e206f66206176 | true | | e202020 | 6f6e | | | 466f6f | 666f6f | true | | 666f6f | 666f6f | true | | 466f6f20426172 | 666f6f20626172 | true | | 666f6f20626172 | 666f6f20626172 | true | | cea3 | cf83 | true | | cea3 | cf82 | false | | cf83 | cf82 | false | | 5269636861726420e285a3 | 72696368617264206976 | true | | e284ab | c3a5 | true | | efac80 | 6666 | true | | c39f | 7353 | false | | c2a8 | 20cc88 | true | | c2a8 | cc88 | true | | 20cc88 | cc88 | true | +-----------------------------------+----------------------+--------+ Whited Expires March 22, 2019 [Page 10] Internet-Draft PRECIS: Tests September 2018 3. IANA Considerations This document requires no interaction with the Internet Assigned Numbers Authority (IANA). 4. Security Considerations This document is intended to provide test vectors for the PRECIS framework and its profiles. No assertion of the security of the PRECIS framework or its profiles for any particular use is intended. The reader is referred to [RFC8264] for a discussion of the general security of the PRECIS framework. 5. References [RFC6365] Hoffman, P. and J. Klensin, "Terminology Used in Internationalization in the IETF", BCP 166, RFC 6365, DOI 10.17487/RFC6365, September 2011, . [RFC8264] Saint-Andre, P. and M. Blanchet, "PRECIS Framework: Preparation, Enforcement, and Comparison of Internationalized Strings in Application Protocols", RFC 8264, DOI 10.17487/RFC8264, October 2017, . [Unicode] The Unicode Consortium, "The Unicode Standard", . Appendix A. Acknowledgements The author would like to thank Marcel van Lohuizen of Google for his help and code reviews on the Go programming language implementation of PRECIS for which these tests were designed and for contributing many of the tests himself. Also, Peter Saint-Andre for his encouragement on this document. Author's Address Sam Whited Individual Email: sam@samwhited.com URI: https://blog.samwhited.com/ Whited Expires March 22, 2019 [Page 11]