{"id":684,"date":"2025-04-07T20:16:18","date_gmt":"2025-04-07T20:16:18","guid":{"rendered":"https:\/\/www.techrepublic.com\/?p=4301387"},"modified":"2025-04-07T20:16:18","modified_gmt":"2025-04-07T20:16:18","slug":"deepseek-grm-introducing-an-enhanced-ai-reasoning-technique","status":"publish","type":"post","link":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/","title":{"rendered":"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique"},"content":{"rendered":"<figure id=\"attachment_4301388\" aria-describedby=\"caption-attachment-4301388\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-4301388 size-full\" src=\"https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1.jpg\" alt=\"Exevutives using AI computing simulation.\" width=\"1400\" height=\"788\" srcset=\"https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1.jpg 1400w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-300x169.jpg 300w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-1024x576.jpg 1024w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-768x432.jpg 768w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-50x28.jpg 50w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-770x433.jpg 770w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-370x208.jpg 370w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-270x152.jpg 270w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-740x417.jpg 740w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-540x304.jpg 540w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-1110x625.jpg 1110w, https:\/\/assets.techrepublic.com\/uploads\/2025\/04\/exevutives-using-ai-computing-simulation-2025-02-19-12-48-22-utc-1-810x456.jpg 810w\" sizes=\"auto, (max-width: 1400px) 100vw, 1400px\"><figcaption id=\"caption-attachment-4301388\" class=\"wp-caption-text\">Image: Envato\/DC_Studio<\/figcaption><\/figure>\n<p>Researchers from AI company DeepSeek and Tsinghua University have introduced a new technique to enhance \u201creasoning\u201d in large language models (LLMs).<\/p>\n<p>Reasoning capabilities have emerged as a critical benchmark in the race to build top-performing generative AI systems. <a href=\"https:\/\/www.techrepublic.com\/article\/trump-tariffs-tech-prices\/\">China and the U.S.<\/a> are actively competing to develop the most powerful and practical models. According to a Stanford University report in April, China\u2019s LLMs are rapidly closing the gap with their U.S. counterparts. In 2024, China produced 15 notable AI models compared to 40 in the U.S., but it leads in patents and academic publications.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"What_is_DeepSeeks_new_technique\"><\/span>What is DeepSeek\u2019s new technique?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>DeepSeek researchers published a paper, titled \u201cInference-Time Scaling for Generalist Reward Modeling,\u201d on Cornell University\u2019s arXiv, the archive of scientific papers. Note that papers published on arXiv are not necessarily peer-reviewed.<\/p>\n<p>In the paper, the researchers detailed a combination of <a href=\"https:\/\/arxiv.org\/abs\/2504.02495\" target=\"_blank\" rel=\"noopener\">two AI training methods<\/a>: generative reward modeling and self-principled critique tuning.<\/p>\n<p>\u201cIn this work, we investigate how to improve reward modeling (RM) with more inference compute for general queries, i.e. the inference-time scalability of generalist RM, and further, how to improve the effectiveness of performance-compute scaling with proper learning methods,\u201d the researchers wrote.<\/p>\n<aside class=\"pinbox right\">\n<h3 class=\"heading\">More must-read AI coverage<\/h3>\n<\/aside>\n<p><strong>SEE: <a href=\"https:\/\/www.techrepublic.com\/article\/news-ddos-cyberattacks-political-conflicts-netscout\/\">DDoS Attacks Now Key Weapons in Geopolitical Conflicts<\/a>, NETSCOUT Warns<\/strong><\/p>\n<p>Reward modeling is the process of training AI to align more closely with user preferences. With Self-Principled Critique Tuning, the model generates its own critiques or \u2018principles\u2019 during inference to fine-tune its answers. The combined approach continues the effort to let LLMs deliver more relevant answers faster.<\/p>\n<p>\u201cEmpirically, we show that SPCT significantly improves the quality and scalability of GRMs, outperforming existing methods and models in various RM benchmarks without severe biases, and could achieve better performance compared to training-time scaling,\u201d the researchers wrote.<\/p>\n<p>They called the models trained with this method DeepSeek-GRM.<\/p>\n<p>\u201cDeepSeek-GRM still meets challenges in some tasks, which we believe can be addressed by future efforts in generalist reward systems,\u201d the researchers wrote.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Whats_next_for_DeepSeek\"><\/span>What\u2019s next for DeepSeek?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>DeepSeek has generated significant buzz around the R1 model, which rivals leading reasoning-focused models like OpenAI o1. A second model, DeepSeek-R2, is rumored for release in May. The company also launched <a href=\"https:\/\/www.techrepublic.com\/article\/news-qwen-2-5-deepseek-3-ai-model-security\/\">DeepSeek-V3-0324<\/a>, an updated reasoning model released in late March.<\/p>\n<p>According to the paper, models built with the new GRM-SPCT method will be open-searched, though no release date has been specified.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Image: Envato\/DC_Studio Researchers from AI company DeepSeek and Tsinghua University have introduced a new technique to enhance \u201creasoning\u201d in large language models (LLMs). Reasoning capabilities have emerged as a critical benchmark in the race to build top-performing generative AI systems. China and the U.S. are actively competing to develop the most powerful and practical models. [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":685,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-684","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique - TecnoArtesanos Tech Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique - TecnoArtesanos Tech Blog\" \/>\n<meta property=\"og:description\" content=\"Image: Envato\/DC_Studio Researchers from AI company DeepSeek and Tsinghua University have introduced a new technique to enhance \u201creasoning\u201d in large language models (LLMs). Reasoning capabilities have emerged as a critical benchmark in the race to build top-performing generative AI systems. China and the U.S. are actively competing to develop the most powerful and practical models. [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/\" \/>\n<meta property=\"og:site_name\" content=\"TecnoArtesanos Tech Blog\" \/>\n<meta property=\"article:published_time\" content=\"2025-04-07T20:16:18+00:00\" \/>\n<meta name=\"author\" content=\"Sergio Morales\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sergio Morales\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/\",\"url\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/\",\"name\":\"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique - TecnoArtesanos Tech Blog\",\"isPartOf\":{\"@id\":\"https:\/\/blog.tecnoartesanos.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog.tecnoartesanos.com\/wp-content\/uploads\/2025\/04\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique.jpg\",\"datePublished\":\"2025-04-07T20:16:18+00:00\",\"author\":{\"@id\":\"https:\/\/blog.tecnoartesanos.com\/#\/schema\/person\/ec88bc1410fd158963717c4216f04807\"},\"breadcrumb\":{\"@id\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#primaryimage\",\"url\":\"https:\/\/blog.tecnoartesanos.com\/wp-content\/uploads\/2025\/04\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique.jpg\",\"contentUrl\":\"https:\/\/blog.tecnoartesanos.com\/wp-content\/uploads\/2025\/04\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique.jpg\",\"width\":1400,\"height\":788},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.tecnoartesanos.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.tecnoartesanos.com\/#website\",\"url\":\"https:\/\/blog.tecnoartesanos.com\/\",\"name\":\"TecnoArtesanos Tech Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.tecnoartesanos.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.tecnoartesanos.com\/#\/schema\/person\/ec88bc1410fd158963717c4216f04807\",\"name\":\"Sergio Morales\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.tecnoartesanos.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/3d45178fc8fbbe32d39278bc504fa9093f947f406ff4f1ddcfa27505ab772184?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/3d45178fc8fbbe32d39278bc504fa9093f947f406ff4f1ddcfa27505ab772184?s=96&d=mm&r=g\",\"caption\":\"Sergio Morales\"},\"sameAs\":[\"https:\/\/sergiomorales.space\"],\"url\":\"https:\/\/blog.tecnoartesanos.com\/index.php\/author\/sergiomorales\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique - TecnoArtesanos Tech Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/","og_locale":"en_US","og_type":"article","og_title":"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique - TecnoArtesanos Tech Blog","og_description":"Image: Envato\/DC_Studio Researchers from AI company DeepSeek and Tsinghua University have introduced a new technique to enhance \u201creasoning\u201d in large language models (LLMs). Reasoning capabilities have emerged as a critical benchmark in the race to build top-performing generative AI systems. China and the U.S. are actively competing to develop the most powerful and practical models. [&hellip;]","og_url":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/","og_site_name":"TecnoArtesanos Tech Blog","article_published_time":"2025-04-07T20:16:18+00:00","author":"Sergio Morales","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Sergio Morales","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/","url":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/","name":"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique - TecnoArtesanos Tech Blog","isPartOf":{"@id":"https:\/\/blog.tecnoartesanos.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#primaryimage"},"image":{"@id":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#primaryimage"},"thumbnailUrl":"https:\/\/blog.tecnoartesanos.com\/wp-content\/uploads\/2025\/04\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique.jpg","datePublished":"2025-04-07T20:16:18+00:00","author":{"@id":"https:\/\/blog.tecnoartesanos.com\/#\/schema\/person\/ec88bc1410fd158963717c4216f04807"},"breadcrumb":{"@id":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#primaryimage","url":"https:\/\/blog.tecnoartesanos.com\/wp-content\/uploads\/2025\/04\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique.jpg","contentUrl":"https:\/\/blog.tecnoartesanos.com\/wp-content\/uploads\/2025\/04\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique.jpg","width":1400,"height":788},{"@type":"BreadcrumbList","@id":"https:\/\/blog.tecnoartesanos.com\/index.php\/2025\/04\/07\/deepseek-grm-introducing-an-enhanced-ai-reasoning-technique\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.tecnoartesanos.com\/"},{"@type":"ListItem","position":2,"name":"DeepSeek-GRM: Introducing an Enhanced AI Reasoning Technique"}]},{"@type":"WebSite","@id":"https:\/\/blog.tecnoartesanos.com\/#website","url":"https:\/\/blog.tecnoartesanos.com\/","name":"TecnoArtesanos Tech Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.tecnoartesanos.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blog.tecnoartesanos.com\/#\/schema\/person\/ec88bc1410fd158963717c4216f04807","name":"Sergio Morales","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.tecnoartesanos.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/3d45178fc8fbbe32d39278bc504fa9093f947f406ff4f1ddcfa27505ab772184?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3d45178fc8fbbe32d39278bc504fa9093f947f406ff4f1ddcfa27505ab772184?s=96&d=mm&r=g","caption":"Sergio Morales"},"sameAs":["https:\/\/sergiomorales.space"],"url":"https:\/\/blog.tecnoartesanos.com\/index.php\/author\/sergiomorales\/"}]}},"_links":{"self":[{"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/posts\/684","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/comments?post=684"}],"version-history":[{"count":0,"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/posts\/684\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/media\/685"}],"wp:attachment":[{"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/media?parent=684"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/categories?post=684"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.tecnoartesanos.com\/index.php\/wp-json\/wp\/v2\/tags?post=684"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}