{"id":2250,"date":"2026-09-16T13:11:21","date_gmt":"2026-09-16T11:11:21","guid":{"rendered":"https:\/\/www.ideas.edu.pl\/?post_type=publikacje&#038;p=2250"},"modified":"2026-09-16T13:11:21","modified_gmt":"2026-09-16T11:11:21","slug":"hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning","status":"publish","type":"publikacje","link":"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/","title":{"rendered":"HINT: A hypernetwork approach to training weight interval regions in continual learning"},"content":{"rendered":"<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Recently, a new Continual Learning (CL) paradigm was presented to control catastrophic forgetting, called Interval Continual Learning (InterContiNet), which relies on enforcing interval constraints on the neural network parameter space. Unfortunately, InterContiNet training is challenging due to the high dimensionality of the weight space, making intervals difficult to manage. To address this issue, we introduce HINT, a technique that employs interval arithmetic within the embedding space and utilizes a hypernetwork to map these intervals to the parameter space of the target network. We train interval embeddings for consecutive tasks and train a hypernetwork to transform these embeddings into weights of the target network. An embedding for a given task is trained along with the hypernetwork, preserving the response of the target network for the previous task embeddings. Interval arithmetic works with lower-dimensional embedding space rather than directly preparing intervals in a high-dimensional weight space. Furthermore, HINT maintains the guarantee of not forgetting. At the end of the training, we can choose one universal embedding to produce a single network dedicated to all tasks. In such a framework, we can utilize one set of weights. HINT obtains significantly better results than InterContiNet and gives SOTA results on several benchmarks.<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">Autorzy: Patryk Krukowski, Anna Bielawska, Kamil Ksi\u0105\u017cek, Pawe\u0142 Wawrzy\u0144ski, Pawe\u0142 Batorski, Przemys\u0142aw Spurek<\/p>\n\n\n\n<div style=\"height:64px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-group is-layout-grid wp-container-core-group-is-layout-5ab56a3c wp-block-group-is-layout-grid\"><\/div>\n\n\n\n<div class=\"wp-block-group is-layout-grid wp-container-core-group-is-layout-5ab56a3c wp-block-group-is-layout-grid\"><\/div>","protected":false},"template":"","nazwa-konferencji":[],"rodzaj-publikacji":[38],"rok-publikacji":[14],"class_list":["post-2250","publikacje","type-publikacje","status-publish","hentry","rodzaj-publikacji-artykul-w-czasopismie","rok-publikacji-14"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>HINT: Hypernetwork approach to training weight interval regions in continual learning &#8226; IDEAS Instytut Badawczy<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"HINT: Hypernetwork approach to training weight interval regions in continual learning &#8226; IDEAS Instytut Badawczy\" \/>\n<meta property=\"og:description\" content=\"Recently, a new Continual Learning (CL) paradigm was presented to control catastrophic forgetting, called Interval Continual Learning (InterContiNet), which relies on enforcing interval constraints on the neural network parameter space. Unfortunately, InterContiNet training is challenging due to the high dimensionality of the weight space, making intervals difficult to manage. To address this issue, we introduce [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"IDEAS Instytut Badawczy\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/feature-image-home.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1800\" \/>\n\t<meta property=\"og:image:height\" content=\"945\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\\\/\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\\\/\",\"name\":\"HINT: Hypernetwork approach to training weight interval regions in continual learning &#8226; IDEAS Instytut Badawczy\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#website\"},\"datePublished\":\"2026-09-16T11:11:21+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Strona g\u0142\u00f3wna\",\"item\":\"https:\\\/\\\/www.ideas.edu.pl\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Publikacje\",\"item\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"HINT: Hypernetwork approach to training weight interval regions in continual learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#website\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/\",\"name\":\"IDEAS Instytut Badawczy\",\"description\":\"Pa\u0144stwowa jednostka badawczo-naukowa\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#organization\"},\"alternateName\":\"IDEAS\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.ideas.edu.pl\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#organization\",\"name\":\"IDEAS Instytut Badawczy\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/wp-content\\\/uploads\\\/e90241d6e73025d0d829abc28d67cb84.svg\",\"contentUrl\":\"https:\\\/\\\/www.ideas.edu.pl\\\/wp-content\\\/uploads\\\/e90241d6e73025d0d829abc28d67cb84.svg\",\"width\":152,\"height\":43,\"caption\":\"IDEAS Instytut Badawczy\"},\"image\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"HINT: Hypernetwork approach to training weight interval regions in continual learning &#8226; IDEAS Instytut Badawczy","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/","og_locale":"en_US","og_type":"article","og_title":"HINT: Hypernetwork approach to training weight interval regions in continual learning &#8226; IDEAS Instytut Badawczy","og_description":"Recently, a new Continual Learning (CL) paradigm was presented to control catastrophic forgetting, called Interval Continual Learning (InterContiNet), which relies on enforcing interval constraints on the neural network parameter space. Unfortunately, InterContiNet training is challenging due to the high dimensionality of the weight space, making intervals difficult to manage. To address this issue, we introduce [&hellip;]","og_url":"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/","og_site_name":"IDEAS Instytut Badawczy","og_image":[{"width":1800,"height":945,"url":"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/feature-image-home.webp","type":"image\/webp"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ideas.edu.pl\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/","url":"https:\/\/www.ideas.edu.pl\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/","name":"HINT: Hypernetwork approach to training weight interval regions in continual learning &#8226; IDEAS Instytut Badawczy","isPartOf":{"@id":"https:\/\/www.ideas.edu.pl\/#website"},"datePublished":"2026-09-16T11:11:21+00:00","breadcrumb":{"@id":"https:\/\/www.ideas.edu.pl\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ideas.edu.pl\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ideas.edu.pl\/publikacje\/hint-hypernetwork-approach-to-training-weight-interval-regions-in-continual-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Strona g\u0142\u00f3wna","item":"https:\/\/www.ideas.edu.pl\/"},{"@type":"ListItem","position":2,"name":"Publikacje","item":"https:\/\/www.ideas.edu.pl\/publikacje\/"},{"@type":"ListItem","position":3,"name":"HINT: Hypernetwork approach to training weight interval regions in continual learning"}]},{"@type":"WebSite","@id":"https:\/\/www.ideas.edu.pl\/#website","url":"https:\/\/www.ideas.edu.pl\/","name":"IDEAS Research Institute","description":"State research and scientific unit","publisher":{"@id":"https:\/\/www.ideas.edu.pl\/#organization"},"alternateName":"IDEAS","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ideas.edu.pl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.ideas.edu.pl\/#organization","name":"IDEAS Research Institute","url":"https:\/\/www.ideas.edu.pl\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ideas.edu.pl\/#\/schema\/logo\/image\/","url":"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/e90241d6e73025d0d829abc28d67cb84.svg","contentUrl":"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/e90241d6e73025d0d829abc28d67cb84.svg","width":152,"height":43,"caption":"IDEAS Instytut Badawczy"},"image":{"@id":"https:\/\/www.ideas.edu.pl\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/publikacje\/2250","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/publikacje"}],"about":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/types\/publikacje"}],"wp:attachment":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/media?parent=2250"}],"wp:term":[{"taxonomy":"nazwa-konferencji","embeddable":true,"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/nazwa-konferencji?post=2250"},{"taxonomy":"rodzaj-publikacji","embeddable":true,"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/rodzaj-publikacji?post=2250"},{"taxonomy":"rok-publikacji","embeddable":true,"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/rok-publikacji?post=2250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}