{"id":2252,"date":"2026-09-21T09:23:53","date_gmt":"2026-09-21T07:23:53","guid":{"rendered":"https:\/\/www.ideas.edu.pl\/?post_type=publikacje&#038;p=2252"},"modified":"2026-09-21T09:23:54","modified_gmt":"2026-09-21T07:23:54","slug":"hypermask-adaptive-hypernetwork-based-masks-for-continual-learning","status":"publish","type":"publikacje","link":"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/","title":{"rendered":"HyperMask: Adaptive hypernetwork-based masks for continual learning"},"content":{"rendered":"<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Artificial neural networks suffer from catastrophic forgetting when they are trained sequentially on multiple tasks. Many continual learning (CL) strategies aim to overcome this problem. One of the most effective is the hypernetwork-based approach. The hypernetwork generates the weights of a target model based on the task\u2019s identity. The model\u2019s main limitation is that, in practice, the hypernetwork can produce completely different architectures for subsequent tasks. To address this issue, we employ the lottery ticket hypothesis, which posits the existence of sparse subnetworks\u2014referred to as \u201cwinning tickets\u201d\u2014that preserve the performance of the entire network. In this paper, we propose a method called HyperMask, which dynamically filters a target network depending on the CL task. The hypernetwork generates semi-binary masks to obtain dedicated target subnetworks. Furthermore, based on the lottery ticket hypothesis, we can use a single network with weighted subnets. Depending on the task, the importance of certain weights may be dynamically increased, while that of others may be decreased. HyperMask achieves competitive results on several CL datasets and, in some scenarios, outperforms state-of-the-art scores, both with derived and unknown task identities.<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">Authors: Kamil Ksi\u0105\u017cek, Przemys\u0142aw Spurek<\/p>\n\n\n\n<div style=\"height:64px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-group is-layout-grid wp-container-core-group-is-layout-5ab56a3c wp-block-group-is-layout-grid\"><\/div>\n\n\n\n<div class=\"wp-block-group is-layout-grid wp-container-core-group-is-layout-5ab56a3c wp-block-group-is-layout-grid\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>","protected":false},"template":"","nazwa-konferencji":[],"rodzaj-publikacji":[38],"rok-publikacji":[14],"class_list":["post-2252","publikacje","type-publikacje","status-publish","hentry","rodzaj-publikacji-artykul-w-czasopismie","rok-publikacji-14"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>HyperMask: Adaptive hypernetwork-based masks for continual learning &#8226; IDEAS Instytut Badawczy<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"HyperMask: Adaptive hypernetwork-based masks for continual learning &#8226; IDEAS Instytut Badawczy\" \/>\n<meta property=\"og:description\" content=\"Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. Many continual learning (CL) strategies are trying to overcome this problem. One of the most effective is the hypernetwork-based approach. The hypernetwork generates the weights of a target model based on the task\u2019s identity. The model\u2019s main limitation is that, [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"IDEAS Instytut Badawczy\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-21T07:23:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/feature-image-home.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1800\" \/>\n\t<meta property=\"og:image:height\" content=\"945\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\\\/\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\\\/\",\"name\":\"HyperMask: Adaptive hypernetwork-based masks for continual learning &#8226; IDEAS Instytut Badawczy\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#website\"},\"datePublished\":\"2026-09-21T07:23:53+00:00\",\"dateModified\":\"2026-09-21T07:23:54+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Strona g\u0142\u00f3wna\",\"item\":\"https:\\\/\\\/www.ideas.edu.pl\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Publikacje\",\"item\":\"https:\\\/\\\/www.ideas.edu.pl\\\/publikacje\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"HyperMask: Adaptive hypernetwork-based masks for continual learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#website\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/\",\"name\":\"IDEAS Instytut Badawczy\",\"description\":\"Pa\u0144stwowa jednostka badawczo-naukowa\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#organization\"},\"alternateName\":\"IDEAS\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.ideas.edu.pl\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#organization\",\"name\":\"IDEAS Instytut Badawczy\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.ideas.edu.pl\\\/wp-content\\\/uploads\\\/e90241d6e73025d0d829abc28d67cb84.svg\",\"contentUrl\":\"https:\\\/\\\/www.ideas.edu.pl\\\/wp-content\\\/uploads\\\/e90241d6e73025d0d829abc28d67cb84.svg\",\"width\":152,\"height\":43,\"caption\":\"IDEAS Instytut Badawczy\"},\"image\":{\"@id\":\"https:\\\/\\\/www.ideas.edu.pl\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"HyperMask: Adaptive hypernetwork-based masks for continual learning &#8226; IDEAS Instytut Badawczy","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/","og_locale":"en_US","og_type":"article","og_title":"HyperMask: Adaptive hypernetwork-based masks for continual learning &#8226; IDEAS Instytut Badawczy","og_description":"Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. Many continual learning (CL) strategies are trying to overcome this problem. One of the most effective is the hypernetwork-based approach. The hypernetwork generates the weights of a target model based on the task\u2019s identity. The model\u2019s main limitation is that, [&hellip;]","og_url":"https:\/\/www.ideas.edu.pl\/en\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/","og_site_name":"IDEAS Instytut Badawczy","article_modified_time":"2026-09-21T07:23:54+00:00","og_image":[{"width":1800,"height":945,"url":"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/feature-image-home.webp","type":"image\/webp"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ideas.edu.pl\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/","url":"https:\/\/www.ideas.edu.pl\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/","name":"HyperMask: Adaptive hypernetwork-based masks for continual learning &#8226; IDEAS Instytut Badawczy","isPartOf":{"@id":"https:\/\/www.ideas.edu.pl\/#website"},"datePublished":"2026-09-21T07:23:53+00:00","dateModified":"2026-09-21T07:23:54+00:00","breadcrumb":{"@id":"https:\/\/www.ideas.edu.pl\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ideas.edu.pl\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ideas.edu.pl\/publikacje\/hypermask-adaptive-hypernetwork-based-masks-for-continual-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Strona g\u0142\u00f3wna","item":"https:\/\/www.ideas.edu.pl\/"},{"@type":"ListItem","position":2,"name":"Publikacje","item":"https:\/\/www.ideas.edu.pl\/publikacje\/"},{"@type":"ListItem","position":3,"name":"HyperMask: Adaptive hypernetwork-based masks for continual learning"}]},{"@type":"WebSite","@id":"https:\/\/www.ideas.edu.pl\/#website","url":"https:\/\/www.ideas.edu.pl\/","name":"IDEAS Research Institute","description":"State research and scientific unit","publisher":{"@id":"https:\/\/www.ideas.edu.pl\/#organization"},"alternateName":"IDEAS","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ideas.edu.pl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.ideas.edu.pl\/#organization","name":"IDEAS Research Institute","url":"https:\/\/www.ideas.edu.pl\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ideas.edu.pl\/#\/schema\/logo\/image\/","url":"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/e90241d6e73025d0d829abc28d67cb84.svg","contentUrl":"https:\/\/www.ideas.edu.pl\/wp-content\/uploads\/e90241d6e73025d0d829abc28d67cb84.svg","width":152,"height":43,"caption":"IDEAS Instytut Badawczy"},"image":{"@id":"https:\/\/www.ideas.edu.pl\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/publikacje\/2252","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/publikacje"}],"about":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/types\/publikacje"}],"wp:attachment":[{"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/media?parent=2252"}],"wp:term":[{"taxonomy":"nazwa-konferencji","embeddable":true,"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/nazwa-konferencji?post=2252"},{"taxonomy":"rodzaj-publikacji","embeddable":true,"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/rodzaj-publikacji?post=2252"},{"taxonomy":"rok-publikacji","embeddable":true,"href":"https:\/\/www.ideas.edu.pl\/en\/wp-json\/wp\/v2\/rok-publikacji?post=2252"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}