{"id":174058,"date":"2026-06-04T11:22:39","date_gmt":"2026-06-04T09:22:39","guid":{"rendered":"https:\/\/www.startupbusiness.it\/inside-the-machine-2-how-a-neural-network-learns\/174058\/"},"modified":"2026-06-05T11:19:00","modified_gmt":"2026-06-05T09:19:00","slug":"inside-the-machine-2-how-a-neural-network-learns","status":"publish","type":"post","link":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/","title":{"rendered":"Inside the machine (2): how a neural network learns"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><em>The \u201cInside the machine\u201d series by Giuseppe Ciuni continues. In the <a href=\"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-what-llms-really-are\/171120\/\" target=\"_blank\" rel=\"noreferrer noopener\">first article,<\/a> we looked at what an LLM is \u2014 a statistical text simulator that predicts the next token \u2014 along with tokenisers, RAG and the first enterprise use cases. This second article delves a step further: understanding how a neural network learns changes the way we interpret a model\u2019s behaviour in production, and therefore how we design a reliable system.  <\/em><\/p>\n\n<p class=\"wp-block-paragraph\">The concepts that will be introduced in this article are as follows: <\/p>\n\n<ul class=\"wp-block-list\">\n<li><strong>Gradiente, loss and Learning Rate<\/strong><\/li>\n\n\n\n<li><strong>Autograd (<\/strong>automatic differentiation)<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">Each of these concepts explains how AI works. A CTO or founder looking to integrate AI into their company or start-up will need to address the following questions: <\/p>\n\n<ul class=\"wp-block-list\">\n<li>Why does an AI model come up with answers that drive CTOs mad or make the employee presenting the integration to their boss anxious, hoping the system won\u2019t go haywire during the demo?<\/li>\n\n\n\n<li>Why might the same model be excellent as a general-purpose chatbot but completely unsuitable for a specialised task?<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">Let\u2019s take it step by step (though we\u2019ll have to touch on a few technical details)<\/p>\n\n<h2 class=\"wp-block-heading\"><strong>How a neural network learns<\/strong><\/h2>\n\n<p class=\"wp-block-paragraph\">A neural network is a mathematical function that takes as input a sequence of words or parts of words (the concept of a token, A neural network is a mathematical function that takes as input a sequence of words or parts of words (the concept of a token is <a href=\"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-what-llms-really-are\/171120\/\" target=\"_blank\" rel=\"noreferrer noopener\">explained in the article<\/a>) and produces the next element based on a probabilistic calculation.<\/p>\n\n<p class=\"wp-block-paragraph\">At the start of model training, the parameters (i.e. the weights, which are the numbers that determine the behaviour of each operation) are initialised completely at random.<\/p>\n\n<p class=\"wp-block-paragraph\">In fact: \u201cThe model knows nothing\u201d<\/p>\n\n<p class=\"wp-block-paragraph\"><br\/>If, at this early stage, we were to ask the model to complete the sentence: <\/p>\n\n<p class=\"wp-block-paragraph\">&#8220;The wheel is a&#8230;&#8221;,<\/p>\n\n<p class=\"wp-block-paragraph\">its response would be purely random. It could easily return:  <\/p>\n\n<p class=\"wp-block-paragraph\">&#8220;The wheel is an animal&#8221;<\/p>\n\n<p class=\"wp-block-paragraph\">This problem can be solved through training <\/p>\n\n<p class=\"wp-block-paragraph\">Training is the process by which the model\u2019s parameters are adjusted step by step. In effect, it is a cycle that repeats until the algorithm\u2019s predictions align with the \u2018statistical patterns\u2019 present in the datasets used to train the model. <\/p>\n\n<p class=\"wp-block-paragraph\">The gradient (a nightmare for students who have studied Mathematical Analysis)<\/p>\n\n<p class=\"wp-block-paragraph\">To understand how this correction works, let\u2019s imagine we are in the mountains and surrounded by thick fog. The only information we have is the contour of the ground beneath our feet: we can sense whether the ground is going uphill, downhill, or sloping to the right or left. Our aim is to head downhill.  <\/p>\n\n<p class=\"wp-block-paragraph\">If we take it one step at a time down the slope, sooner or later we\u2019ll make it down. <\/p>\n\n<p class=\"wp-block-paragraph\">In simple, non-mathematical terms, measuring this slope beneath our feet defines the gradient.<\/p>\n\n<p class=\"wp-block-paragraph\">To put it in more mathematical terms: the gradient is the vector that indicates the direction of maximum slope (the steepest incline). <\/p>\n\n<p class=\"wp-block-paragraph\">Since our aim is to move downwards, the model must move in the opposite direction to the ascent: towards the minimum error. This downward process is known as gradient descent. <\/p>\n\n<p class=\"wp-block-paragraph\">The gradient answers the question: &#8220;If I increase this number (the parameter) slightly, does the error go up or down? By how much?&#8221; <\/p>\n\n<p class=\"wp-block-paragraph\"><strong>The Loss function<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">The value that measures the model\u2019s overall error is called the loss (loss function). <\/p>\n\n<p class=\"wp-block-paragraph\">The loss function performs the following calculation: it takes the output generated by the model (the prediction) and mathematically measures how far it is from the correct answer (the true value). <\/p>\n\n<p class=\"wp-block-paragraph\">In our example, the loss represents our altitude on the mountain.<\/p>\n\n<p class=\"wp-block-paragraph\">The loss function answers the question: &#8220;How far off the mark am I at this very moment? How far are we from the minimum error (the bottom of the valley)?&#8221;<\/p>\n\n<p class=\"wp-block-paragraph\"><strong>Learning Rate<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">Another useful parameter in the process of minimising error is the learning rate, which determines how much weight to assign to the gradient at each iteration and, consequently, how large the step the model takes between iterations should be.<\/p>\n\n<p class=\"wp-block-paragraph\">The learning rate answers the question: &#8220;How long should the step we take at each juncture of the descent be, so as not to overshoot the target?&#8221;<\/p>\n\n<p class=\"wp-block-paragraph\">Finding the right stride length is one of the trickiest parts of the training itself. <\/p>\n\n<p class=\"wp-block-paragraph\">If the learning rate is too high, there is a risk of overshooting: the model behaves erratically, \u2018jumps\u2019 past the global minimum (the bottom of the valley) and ends up climbing back up the opposite slope. Conversely, a learning rate that is too low results in the descent being reduced to infinitesimal shifts in the parameters, slowing down the entire process and making it inefficient in terms of time and cost.  <\/p>\n\n<p class=\"wp-block-paragraph\">This problem is solved by an algorithm called Adam, an optimiser that dynamically calculates the step size as parameters change; it is used in many current models, including<a href=\"https:\/\/karpathy.ai\/microgpt.html\" target=\"_blank\" rel=\"noreferrer noopener nofollow\"> microgpt.<\/a><\/p>\n\n<p class=\"wp-block-paragraph\">To sum up, the three elements that work together at every step are:<\/p>\n\n<p class=\"wp-block-paragraph\">The Loss: tells us where we are (how large the current error is).<\/p>\n\n<p class=\"wp-block-paragraph\">The gradient: it tells us where to go (the direction of descent to minimise error).<\/p>\n\n<p class=\"wp-block-paragraph\"><strong>Il Learning Rate:<\/strong> ci dice quanto deve essere lungo il passo da fare in una data direzione.<\/p>\n\n<p class=\"wp-block-paragraph\"><br\/>Here is a visual example in the figure illustrating the parameter optimisation process.<\/p>\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1231\" height=\"741\" src=\"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/06\/image.png\" alt=\"\" class=\"wp-image-173529\"\/><figcaption class=\"wp-element-caption\">Figure 1<\/figcaption><\/figure>\n\n<ul class=\"wp-block-list\">\n<li>Point 1: high error, proceed with large steps <\/li>\n\n\n\n<li>Point 2: error reduction; the step size is reduced<\/li>\n\n\n\n<li>Points 3 and 4: further reduction of the error: further reduction in the number of steps<\/li>\n\n\n\n<li>Point 5: trough (low point). The model makes as few errors as possible <\/li>\n<\/ul>\n\n<h2 class=\"wp-block-heading\"><strong>Autograd<\/strong><\/h2>\n\n<p class=\"wp-block-paragraph\">Whilst the model makes its prediction by attempting to guess the next token, Autograd records every single mathematical operation performed on the data, creating a detailed map of the process. <\/p>\n\n<p class=\"wp-block-paragraph\">Once the final error (the loss) has been calculated using a mathematical formula, it is able to calculate the exact slope of the terrain (the gradient) for all hundreds of billions of parameters simultaneously and in a single step.<\/p>\n\n<p class=\"wp-block-paragraph\">Thanks to Autograd, the entire process of calculating the gradient is automated. <\/p>\n\n<p class=\"wp-block-paragraph\">Returning to the example of the mountain, given that there are hundreds of billions of parameters, what we see in the mist is not a mere human hiker but a gigantic robot made up of billions of mechanical micro-joints attempting to make its way down into the valley; see Figure 2.<\/p>\n\n<p class=\"wp-block-paragraph\">Each parameter corresponds to one of these joints: the angle of a bolt on the little toe, the flexion of a knee joint, the tilt of a vertebra, and so on. <\/p>\n\n<p class=\"wp-block-paragraph\">At first, as the settings are random, the robot moves in an uncoordinated manner. To descend, it must adjust all the billions of bolts simultaneously, based on the slope of the ground (the gradient).  <\/p>\n\n<p class=\"wp-block-paragraph\">Autograd calculates the gradients of the model parameters and provides a gradient map for all the robot\u2019s joints. This allows each joint to be coordinated until the robot\u2019s posture is suitable for running down the valley. <\/p>\n\n<p class=\"wp-block-paragraph\">Figure 2 illustrates how Autograd works:<\/p>\n\n<ul class=\"wp-block-list\">\n<li>In the first image, the robot is completely uncoordinated (random initial parameters). <\/li>\n\n\n\n<li>In the second image, the robot begins to coordinate its first joints (parameters currently being adjusted). <\/li>\n\n\n\n<li>In the third image, the robot is in its running configuration heading towards the valley (the parameter optimisation phase has been completed).<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">Karpathy implements <a href=\"https:\/\/karpathy.ai\/microgpt.html\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">autograd in Microgpt <\/a>in around thirty lines of Python.<\/p>\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"538\" height=\"1358\" src=\"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/06\/image-1.png\" alt=\"\" class=\"wp-image-173530\"\/><figcaption class=\"wp-element-caption\">Figure 2: An example of autograd<\/figcaption><\/figure>\n\n<h2 class=\"wp-block-heading\">Conclusions<\/h2>\n\n<p class=\"wp-block-paragraph\">If those with decision-making authority within a company stop viewing AI as a \u2018magic box\u2019 and understand how it works, they will be able to anticipate the model\u2019s failures rather than simply having to deal with them. <\/p>\n\n<p class=\"wp-block-paragraph\">In this sector, it is important to bear in mind two key concepts of both an economic and a technical nature:<\/p>\n\n<p class=\"wp-block-paragraph\"><strong>Tip 1: The cost of training a model<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">Training GPT-4 from scratch cost hundreds of millions of dollars. Training \u201cLlama 3 70B\u201d cost less, but still ran into the millions of dollars. It would be interesting to know how much it cost to train Claude\u2019s Opus 4.8.  <\/p>\n\n<p class=\"wp-block-paragraph\">Fine-tuning an existing model costs between \u20ac500 and \u20ac10,000, depending on the size of the model and the amount of data. <\/p>\n\n<p class=\"wp-block-paragraph\">99% of companies don\u2019t need to train staff from scratch: the basic training has already been carried out and paid for. <\/p>\n\n<p class=\"wp-block-paragraph\">The budget for those looking to introduce AI into their start-up or business production process is allocated to fine-tuning or RAG (if it is necessary to work with up-to-date data).<\/p>\n\n<p class=\"wp-block-paragraph\"><strong>Tip 2: \u201cThe model learns from our users\u201d<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">The process of tuning billions of parameters takes place once, on dedicated infrastructure with vast resources. Once a model is in production, the parameters are fixed.  <\/p>\n\n<p class=\"wp-block-paragraph\"><strong>The model typically does not change, does not learn, and does not update itself<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">If a seller of AI solutions tells you that \u201cour model adapts to your users over time\u201d, you need to ask the following questions: how does this happen? How often is the model retrained? On what data? Above all: who pays for it? If the answers are not comprehensive \u2013 as they likely won\u2019t be \u2013 it means that the claim that the model adapts to users is untrue; it would be too expensive, even though with highly advanced technologies there is always the possibility, however remote, that something unexpected might happen.    <\/p>\n\n<p class=\"wp-block-paragraph\">The next issue of \u2018Inside the Machine\u2019 will explore the base model and the Instruct model, Supervised Fine-Tuning, and Reinforcement Learning from Human Feedback (photo by I<a href=\"https:\/\/unsplash.com\/it\/@omilaev?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\">gor Omilaev<\/a> on <a href=\"https:\/\/unsplash.com\/it\/foto\/uninsegna-al-neon-al-neon-che-si-trova-sul-lato-di-un-muro-9XtKSci9crg?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\">Unsplash<\/a>)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The second article in the series explores the inner workings of artificial intelligence: autograd, gradient<\/p>\n","protected":false},"author":125,"featured_media":171119,"comment_status":"open","ping_status":"open","sticky":true,"template":"","format":"standard","meta":{"_acf_changed":false,"_substack_draft_id":"","_substack_draft_url":"","_substack_last_pushed":"","_substack_premium":"","footnotes":""},"categories":[1134],"tags":[1324,1480,1331],"companies":[],"journalist":[3458],"class_list":["post-174058","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-learn","tag-artificial-intelligence-en","tag-education-en","tag-innovation-en","journalist-giuseppe-ciuni"],"featured_sizes_urls":{"thumbnail":{"src":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","width":150,"height":84,"crop":false,"srcset":false,"alt":"how artificial intelligence works"},"large":{"src":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","width":1024,"height":576,"crop":false,"srcset":false,"alt":"how artificial intelligence works"},"2048x2048":{"src":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","width":1280,"height":720,"crop":false,"srcset":false,"alt":"how artificial intelligence works"}},"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Inside the machine (2): how a neural network learns<\/title>\n<meta name=\"description\" content=\"The second article in the series explores the inner workings of artificial intelligence: autograd, gradient\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Inside the machine (2): how a neural network learns\" \/>\n<meta property=\"og:description\" content=\"The second article in the series explores the inner workings of artificial intelligence: autograd, gradient\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/\" \/>\n<meta property=\"og:site_name\" content=\"Startupbusiness.it\" \/>\n<meta property=\"article:published_time\" content=\"2026-06-04T09:22:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-06-05T09:19:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Emil Abirascid\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@emilabirascid\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Emil Abirascid\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/\"},\"author\":{\"name\":\"Emil Abirascid\",\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/#\\\/schema\\\/person\\\/4e2760db2cb7ca47d635ea3d8d8486dd\"},\"headline\":\"Inside the machine (2): how a neural network learns\",\"datePublished\":\"2026-06-04T09:22:39+00:00\",\"dateModified\":\"2026-06-05T09:19:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/\"},\"wordCount\":1592,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.startupbusiness.it\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/igor-omilaev-9XtKSci9crg-unsplash.jpg\",\"keywords\":[\"artificial intelligence\",\"education\",\"innovation\"],\"articleSection\":[\"Learn\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/\",\"url\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/\",\"name\":\"Inside the machine (2): how a neural network learns\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.startupbusiness.it\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/igor-omilaev-9XtKSci9crg-unsplash.jpg\",\"datePublished\":\"2026-06-04T09:22:39+00:00\",\"dateModified\":\"2026-06-05T09:19:00+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/#\\\/schema\\\/person\\\/4e2760db2cb7ca47d635ea3d8d8486dd\"},\"description\":\"The second article in the series explores the inner workings of artificial intelligence: autograd, gradient\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/inside-the-machine-2-how-a-neural-network-learns\\\/174058\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.startupbusiness.it\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/igor-omilaev-9XtKSci9crg-unsplash.jpg\",\"contentUrl\":\"https:\\\/\\\/www.startupbusiness.it\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/igor-omilaev-9XtKSci9crg-unsplash.jpg\",\"width\":1280,\"height\":720,\"caption\":\"how artificial intelligence works\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/\",\"name\":\"Startupbusiness.it\",\"description\":\"May the Force be with you!\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/#\\\/schema\\\/person\\\/4e2760db2cb7ca47d635ea3d8d8486dd\",\"name\":\"Emil Abirascid\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ac925fb049ca749d7e16a36a75fbc9bf342bb19b7c22dae55be274ab4557890a?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ac925fb049ca749d7e16a36a75fbc9bf342bb19b7c22dae55be274ab4557890a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/ac925fb049ca749d7e16a36a75fbc9bf342bb19b7c22dae55be274ab4557890a?s=96&d=mm&r=g\",\"caption\":\"Emil Abirascid\"},\"description\":\"Emil Abirascid (\u30a8\u30df\u30fc\u30eb\u30fb\u30a2\u30d3\u30e9\u30b7\u30c3\u30c9), giornalista, fondatore e direttore di Startupbusiness, il primo magazine sull\u2019ecosistema startup e innovazione italiano. Co-fondatore di Designtech, l\u2019hub di innovazione che avvicina il mondo del design con quello della tecnologia. Advisor di Austrian Business Agency, Emil Banca, Fondazione Symbola, Fondazione Quadrans. Partecipa regolarmente a incontri, convegni, conferenze dedicate all\u2019ecosistema dell\u2019innovazione. E\u2019 stato co-organizzatore degli Italian Innovation Day and Series che si sono svolti dal dal 2016 al 2020 nelle citt\u00e0 di Tokyo in Giappone, Melbourne, Adelaide, Perth, Canberra in Australia e Singapore e co-organizzatore dell\u2019Italy India Innovation Day di AIICP 2021 e 2022. Ha curato il volume \u2018L\u2019innovazione che non ti aspetti. Contesti e visioni per l\u2019impresa\u2019 , l\u2019edizione italiana di \u2018La startup digitale, guida pratica step by step\u2019 e ha scritto la prefazione all\u2019edizione italiana de \u2018La quarta era\u2019 di Byron Reese, ed \u00e8 co-autore di \u2018Cosa e Dove: strategie digitali di ricerca del lavoro\u2019, tutti editi da FrancoAngeli. In passato \u00e8 stato curatore di StartupDigest Italy, coordinatore scientifico del Forum per la Ricerca della Provincia Autonoma di Trento, board member di TechChill Milano advisor di di ScaleIT , ha collaborato con Il Sole 24 Ore \u00e8 stato direttore di Innov\u2019azione, bimestrale edito da Apsti, ha collaborato con Corriere Innovazione ed \u00e8 stato presidente del comitato di selezione del Premio Marzotto e advisor di Cetif-Universit\u00e0 Cattolica Milano.\",\"sameAs\":[\"https:\\\/\\\/www.abirascid.com\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/emilabirascid\",\"https:\\\/\\\/x.com\\\/emilabirascid\"],\"url\":\"https:\\\/\\\/www.startupbusiness.it\\\/en\\\/author\\\/emil-abirascid\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Inside the machine (2): how a neural network learns","description":"The second article in the series explores the inner workings of artificial intelligence: autograd, gradient","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/","og_locale":"en_US","og_type":"article","og_title":"Inside the machine (2): how a neural network learns","og_description":"The second article in the series explores the inner workings of artificial intelligence: autograd, gradient","og_url":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/","og_site_name":"Startupbusiness.it","article_published_time":"2026-06-04T09:22:39+00:00","article_modified_time":"2026-06-05T09:19:00+00:00","og_image":[{"width":1280,"height":720,"url":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","type":"image\/jpeg"}],"author":"Emil Abirascid","twitter_card":"summary_large_image","twitter_creator":"@emilabirascid","twitter_misc":{"Written by":"Emil Abirascid","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/#article","isPartOf":{"@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/"},"author":{"name":"Emil Abirascid","@id":"https:\/\/www.startupbusiness.it\/en\/#\/schema\/person\/4e2760db2cb7ca47d635ea3d8d8486dd"},"headline":"Inside the machine (2): how a neural network learns","datePublished":"2026-06-04T09:22:39+00:00","dateModified":"2026-06-05T09:19:00+00:00","mainEntityOfPage":{"@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/"},"wordCount":1592,"commentCount":0,"image":{"@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/#primaryimage"},"thumbnailUrl":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","keywords":["artificial intelligence","education","innovation"],"articleSection":["Learn"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/","url":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/","name":"Inside the machine (2): how a neural network learns","isPartOf":{"@id":"https:\/\/www.startupbusiness.it\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/#primaryimage"},"image":{"@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/#primaryimage"},"thumbnailUrl":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","datePublished":"2026-06-04T09:22:39+00:00","dateModified":"2026-06-05T09:19:00+00:00","author":{"@id":"https:\/\/www.startupbusiness.it\/en\/#\/schema\/person\/4e2760db2cb7ca47d635ea3d8d8486dd"},"description":"The second article in the series explores the inner workings of artificial intelligence: autograd, gradient","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.startupbusiness.it\/en\/inside-the-machine-2-how-a-neural-network-learns\/174058\/#primaryimage","url":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","contentUrl":"https:\/\/www.startupbusiness.it\/wp-content\/uploads\/2026\/05\/igor-omilaev-9XtKSci9crg-unsplash.jpg","width":1280,"height":720,"caption":"how artificial intelligence works"},{"@type":"WebSite","@id":"https:\/\/www.startupbusiness.it\/en\/#website","url":"https:\/\/www.startupbusiness.it\/en\/","name":"Startupbusiness.it","description":"May the Force be with you!","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.startupbusiness.it\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.startupbusiness.it\/en\/#\/schema\/person\/4e2760db2cb7ca47d635ea3d8d8486dd","name":"Emil Abirascid","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/ac925fb049ca749d7e16a36a75fbc9bf342bb19b7c22dae55be274ab4557890a?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/ac925fb049ca749d7e16a36a75fbc9bf342bb19b7c22dae55be274ab4557890a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ac925fb049ca749d7e16a36a75fbc9bf342bb19b7c22dae55be274ab4557890a?s=96&d=mm&r=g","caption":"Emil Abirascid"},"description":"Emil Abirascid (\u30a8\u30df\u30fc\u30eb\u30fb\u30a2\u30d3\u30e9\u30b7\u30c3\u30c9), giornalista, fondatore e direttore di Startupbusiness, il primo magazine sull\u2019ecosistema startup e innovazione italiano. Co-fondatore di Designtech, l\u2019hub di innovazione che avvicina il mondo del design con quello della tecnologia. Advisor di Austrian Business Agency, Emil Banca, Fondazione Symbola, Fondazione Quadrans. Partecipa regolarmente a incontri, convegni, conferenze dedicate all\u2019ecosistema dell\u2019innovazione. E\u2019 stato co-organizzatore degli Italian Innovation Day and Series che si sono svolti dal dal 2016 al 2020 nelle citt\u00e0 di Tokyo in Giappone, Melbourne, Adelaide, Perth, Canberra in Australia e Singapore e co-organizzatore dell\u2019Italy India Innovation Day di AIICP 2021 e 2022. Ha curato il volume \u2018L\u2019innovazione che non ti aspetti. Contesti e visioni per l\u2019impresa\u2019 , l\u2019edizione italiana di \u2018La startup digitale, guida pratica step by step\u2019 e ha scritto la prefazione all\u2019edizione italiana de \u2018La quarta era\u2019 di Byron Reese, ed \u00e8 co-autore di \u2018Cosa e Dove: strategie digitali di ricerca del lavoro\u2019, tutti editi da FrancoAngeli. In passato \u00e8 stato curatore di StartupDigest Italy, coordinatore scientifico del Forum per la Ricerca della Provincia Autonoma di Trento, board member di TechChill Milano advisor di di ScaleIT , ha collaborato con Il Sole 24 Ore \u00e8 stato direttore di Innov\u2019azione, bimestrale edito da Apsti, ha collaborato con Corriere Innovazione ed \u00e8 stato presidente del comitato di selezione del Premio Marzotto e advisor di Cetif-Universit\u00e0 Cattolica Milano.","sameAs":["https:\/\/www.abirascid.com\/","https:\/\/www.linkedin.com\/in\/emilabirascid","https:\/\/x.com\/emilabirascid"],"url":"https:\/\/www.startupbusiness.it\/en\/author\/emil-abirascid\/"}]}},"author_name":"Emil Abirascid","categories_names":["Learn"],"_links":{"self":[{"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/posts\/174058","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/users\/125"}],"replies":[{"embeddable":true,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/comments?post=174058"}],"version-history":[{"count":1,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/posts\/174058\/revisions"}],"predecessor-version":[{"id":174059,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/posts\/174058\/revisions\/174059"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/media\/171119"}],"wp:attachment":[{"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/media?parent=174058"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/categories?post=174058"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/tags?post=174058"},{"taxonomy":"companies","embeddable":true,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/companies?post=174058"},{"taxonomy":"journalist","embeddable":true,"href":"https:\/\/www.startupbusiness.it\/en\/wp-json\/wp\/v2\/journalist?post=174058"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}