<!--DEBUG:--><!--DEBUG:dc3-united-states-software-in-english-pdf-2--><!--DEBUG:--><!--DEBUG:dc3-united-states-software-in-english-pdf-2--><!--DEBUG-spv-->{"id":3387892,"date":"2025-11-22T22:49:00","date_gmt":"2025-11-22T20:49:00","guid":{"rendered":"http:\/\/nhub.news\/?p=3387892"},"modified":"2025-11-23T08:24:39","modified_gmt":"2025-11-23T06:24:39","slug":"new-token-oriented-object-notation-toon-hopes-to-cut-llm-costs-by-reducing-token-consumption","status":"publish","type":"post","link":"http:\/\/nhub.news\/ru\/2025\/11\/new-token-oriented-object-notation-toon-hopes-to-cut-llm-costs-by-reducing-token-consumption\/","title":{"rendered":"New Token-Oriented Object Notation (TOON) Hopes to Cut LLM Costs by Reducing Token Consumption"},"content":{"rendered":"<p style=\"text-align: justify;\"><b>The recently released Token-Oriented Object Notation (TOON) aims to be a schema-aware alternative to JSON that significantly reduces token consumption at a similar level of accuracy. While the existence and importance of token saved depend on the data shape. some benchmarks show TOON may use in some cases 40% fewer tokens than JSON, possibly resulting in LLM and inference cost savings.<\/b><br \/>\nThe recently released Token-Oriented Object Notation (TOON) aims to be a schema-aware alternative to JSON that significantly reduces token consumption at a similar level of accuracy. While the existence and quantity of saved tokens depend on the data shape, some benchmarks show that TOON may use 40% fewer tokens in some cases than JSON, potentially resulting in LLM and inference cost savings.<br \/>TOON self-describes as a compact, human-readable encoding of the JSON data model for LLM prompts.<br \/>Consider the following JSON: { &#171;context&#187;: { &#171;task&#187;: &#171;Our favorite hikes together&#187;, &#171;location&#187;: &#171;Boulder&#187;, &#171;season&#187;: &#171;spring_2025&#187; }, &#171;friends&#187;: [&#171;ana&#187;, &#171;luis&#187;, &#171;sam&#187;], &#171;hikes&#187;: [ { &#171;id&#187;: 1, &#171;name&#187;: &#171;Blue Lake Trail&#187;, &#171;distanceKm&#187;: 7.5, &#171;elevationGain&#187;: 320, &#171;companion&#187;: &#171;ana&#187;, &#171;wasSunny&#187;: true }, { &#171;id&#187;: 2, &#171;name&#187;: &#171;Ridge Overlook&#187;, &#171;distanceKm&#187;: 9.2, &#171;elevationGain&#187;: 540, &#171;companion&#187;: &#171;luis&#187;, &#171;wasSunny&#187;: false }, { &#171;id&#187;: 3, &#171;name&#187;: &#171;Wildflower Loop&#187;, &#171;distanceKm&#187;: 5.1, &#171;elevationGain&#187;: 180, &#171;companion&#187;: &#171;sam&#187;, &#171;wasSunny&#187;: true } ] } <br \/>In the TOON format, the same data becomes: context:<br \/> task: Our favorite hikes together<br \/> location: Boulder<br \/> season: spring_2025<br \/>friends[3]: ana,luis,sam<br \/>hikes[3]{id,name,distanceKm,elevationGain,companion,wasSunny}:<br \/> 1,Blue Lake Trail,7.5,320,ana,true<br \/> 2,Ridge Overlook,9.2,540,luis,false<br \/> 3,Wildflower Loop,5.1,180,sam,true<br \/>Running this example in an online playground will show a 55% reduction in tokens vs. pretty-printed JSON, 25% vs. compact JSON, and 38% vs. YAML.<\/p>\n<p>As the previous example showcases, TOON combines YAML (for nested objects) and CSV (for uniform arrays) layouts to save tokens. However, for non-uniform data, JSON may be more efficient. For deeply nested objects, YAML may be more token-efficient. For flat datasets, CSV remains the most compact format. TOON adds a small overhead (~5%) with field headers and array declarations, in order to improve LLM accuracy.<br \/>Johann Schopplich explained on X: <br \/>\u201cDoes token efficiency hurt accuracy?\u201d<br \/>No \ud83d\ude42 TOON hits 99.4% accuracy on GPT 5 Nano while using 46% fewer tokens.<br \/>Tested across ~160 questions and 3 LLMs with semantic validation.<br \/>I think explicit lengths + field lists = fewer mistakes. <br \/>Readers may review TOON\u2019s specifications, documentation, online playgrounds, and run their own efficiency and accuracy benchmarks. In latency-critical applications, developers should compare Time To First Token and tokens per second in both formats.<br \/>The reference implementation in TypeScript\/JavaScript is maintained at github.com\/toon-format\/toon. The reference implementation includes a complete encoder and decoder, CLI tools for JSON-to-TOON conversion, and performance benchmarks. TOON 1.0 was released under the MIT license two weeks ago.<\/p>\n<script>jQuery(function(){jQuery(\".vc_icon_element-icon\").css(\"top\", \"0px\");});<\/script><script>jQuery(function(){jQuery(\"#td_post_ranks\").css(\"height\", \"10px\");});<\/script><script>jQuery(function(){jQuery(\".td-post-content\").find(\"p\").find(\"img\").hide();});<\/script>","protected":false},"excerpt":{"rendered":"<p>The recently released Token-Oriented Object Notation (TOON) aims to be a schema-aware alternative to JSON that significantly reduces token consumption at a similar level of accuracy. While the existence and importance of token saved depend on the data shape. some benchmarks show TOON may use in some cases 40% fewer tokens than JSON, possibly resulting [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3387891,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[93],"tags":[],"_links":{"self":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/posts\/3387892"}],"collection":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/comments?post=3387892"}],"version-history":[{"count":1,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/posts\/3387892\/revisions"}],"predecessor-version":[{"id":3387893,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/posts\/3387892\/revisions\/3387893"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/media\/3387891"}],"wp:attachment":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/media?parent=3387892"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/categories?post=3387892"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/tags?post=3387892"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}