Behind the Curtain: Explainable Artificial Intelligence

Behind the Curtain: Explainable Artificial Intelligence

Artificial intelligence (AI) is contributing to the transformation of a large number of sectors, from suggesting a song to analyzing our health status via a watch, along with manufacturing industry. One hindrance on this transformation relates to the overall complexity of AI systems, which often poses challenges in terms of transparency and comprehensions of the results delivered. In this context, the AI’s explanatory capability (or “explainability”) is referred as the ability to make their decisions and actions understandable to users – which is known as eXplainable AI (XAI); this is something crucial to generate trust and ensure a responsible adoption of these technologies.


A wide range of technological solutions are currently being investigated in order to improve the explainability of AI algorithms. One of the main strategies includes the creation of intrinsically explainable models (ante hoc explanations). This type of models, such as decision trees and association rules, are designed to be transparent and comprehensible by their own nature. Their logical structure allows users to seamlessly follow the reasoning behind the AI-based decisions. Tools for visualization of AI explanations are key, since they represent graphically the decision-making process performed by the model, thus facilitating user comprehension. These tools might take different forms, such as dedicated dashboards, augmented reality glasses, or natural language explanations (as speech or as text).

Tree decision. Explainable AI method
Intrinsically explainable system: decision tree. The intermediary nodes are conditions that are progressively verified until reaching the final result
Natural language explanation. Explainable AI methodes.
Natural Language explanations for a recommender system of new routes for exercising. Extracted from Xu et al. (2023). XAIR: framework of XAI in augmented reality.

Another commonly used family of explanation techniques is called post hoc methods: these consist in, once the AI model has been created and trained, a posteriori processing and analyzing this resulting model to provide explanations of the results. For example, some of these techniques evaluate how much is contributed by each input variable in the final result of the system (sensibility analysis). Among post hoc explainability techniques, SHAP (Shapley Additive exPlanations), a method based on cooperative game theory, allows to extract coefficients that determine the importance of each input variable on the final result of an AI algorithm.

Other XAI techniques include decomposition, which divides the AI model into simpler and more easily explainable components, and knowledge distillation into surrogate models, which approximate the function of the original system while being more easily comprehensible. On the other hand, the so-called “local explanations” consist in methods that explain individual examples (input-output), not the entire AI model. An example are the explanations provided by tools such as LIME (Local Interpretable Model-agnostic Explanations). As an illustration of LIME, the example in the following figure shows a specific inference in text classification task, in which a text is classified as “sincere” (with 84% of likelihood), and the most relevant words for that decision are highlighted, as an explanation of this individual classification [Linardatos et al. (2020)].

Decomposition tecnhique. Explainable AI

An additional approach for XAI relates to the integration of input by users in the process of AI model construction, which is known in general as “Human-in-the-Loop” (HITL). This approach allows users to interact (e.g. by labelling new data) and to supervise the AI algorithm building process, adjusting its decisions in real time and thus improving the overall system transparency.

At CARTIF, we are actively working in different projects related with AI, such as s-X-AIPI to help advance in the explainability of AI systems used in industrial applications. A significant example in our work are dashboards (visualization or control panels) designed for the supervision and analysis of the performance of fabrication processes studied in the project. These dashboards allow plant operators to visualize and understand in real time the actual status of the industrial process.

Predictive and anomaly detection models have been created in the context of asphalt industrial processes which not only anticipate future values, but also detect unusual situations in the asphalt process and explain the factors that have an influence on these predictions and detections. Thus, this helps operators make adequate informed decisions and better understand the results generated by the AI systems and how to take proper actions.

Explainability in AI methods is essential for the safe and effective AI adoption in all types of sectors: industry, retail, logistics, pharma, construction… In CARTIF, we are committed with the development of technologies to create AI-based applications that do not only improve processes and services, but also are transparent and comprehensible for users; in short, that are explainable.


Co-author

Iñaki Fernández. PhD in Artificial Intelligence. Researcher at the Health and Wellbeing Area of CARTIF.

Fermentation, travel partner

Fermentation, travel partner

Fermentation is perhaps one of the oldest technologies that has accompanied humanity for thousand of years. Throughout history, numerous evidences and traces have been found that demonstrate the use of fermentation by several cultures and civilisations, as a common and fundamental practice in the production of food and beverages, or even for medicinal and ceremonial purposes.

For example, archaeological remains have been found in China (7000-6600 BC ) of a fermented drink made from rice, honey and fruit in ceramic vessels, or in Iran (5000 BC) ceramic jars with wine residues, or Egyptian hieroglyphs and papyri (2500 BC) describing the production of beer and wine, as well as their consumption in religious ceremonies everyday life.

Vectores por Vecteezy

In addition, the analysis of botanical remains (seeds, plant fragments) has provided evidence of the use of fermented plants, or more recently the analysis and study of the DNA of yeasts and other microorganisms has provided genetic evidence of the use of fermentation since ancient times. These ancient methodes laid the foundations for the use and evolution of a practice that has evolved significantly over time.

The application of biotechnological techniques for the manufacture of pharmaceutical, biofuels, fertilisers and nutritional supplements has proven to be an age-old tool that has been adapted and sophisticated to suit today´s needs.

Global challenges such as environmental sustainability, food security, food scarcity, waste reduction and recovery find in fermentation a powerful tool to address these problems.

In this way, the use of different microorganisms can be the key to the revalorisation of different by-products and waste from industry, transforming them into high-value products such as biofuels (biodiesel, biogas), biodegradable compounds (bioplastics), or molecules of interest (lipids, organic acids, dyes, etc.) that can be incorporated back into the value chain thus contributing to a circular economy.

Fermentation can transform some agri-food by-products, which would otherwise be wasted, into products with an improved organoleptic profile by reducing or transforming undesirable compounds that negatively affect taste and texture. In this way, fermentation processes can improve the organoleptic profile and, thus the acceptability of certain by-products, which can then be incorporated back into the value chain.

Another future challenges is the increase in the world´s population, which brings with it an increase in demand for protein and poses challenges to the sustainability of traditional protein sources such as meat and dairy products. This is where the use of microorganisms, in this case fungi fermentation, emerges as an alternative to traditional protein sources. Fungi fermentation is key to obtaining microproteins that allow the development of flavours and textures that mimic meat and are sensorially appealing to the consumer. These types of proteins are rich in high quality nutrients, and are also presented as an alternative that requires fewer natural resources (water and land) and produces fewer greenhouse gases.

Fermentation also has the potential to mitigate pollution, playing an important role in waste management and pollutant reduction. Thus, certain organic wastes (waste oils, industrial waste, polluted waters) can be fermented to produce biogas, fertilisers and bioplastics, or it can be used to treat wastewater by reducing organic compounds before they are released into the environment. These processes can also be used in biorremediation processes, soil and contaminated area treatments.

According to the latest research, certain bacteria and fungi could be used to ferment and degradeplastics, such as polyethylene and polyester, or even use them as a source of carbon to obtain compounds of interest.

Therefore, fermentation today isn´t restricted to its use in the food industry for the production of fermented foods. Society must recognise and explore the alternatives offered by biotechnology, and in particular fermentative processes, to face present and future challenges.

Harnessing the abilities of bacteria, yeasts and fungi to transform waste materials into useful products, reduce waste and pollution will allow us to move towards a cleaner and sustainable future, thanks to micro-organisms, felow travellers that have served mankind for thousand of years, and may now be the solution to many of our future challenges.

Batteries of the future: beyond lithium

Batteries of the future: beyond lithium

In the vast universe of energy technology, lithium-ion batteries have reignes supreme for decades. From our mobile phones to electric vehicles, these batteries have been the silent engine that drives our daily lives. But, like any technology, lithium also has its limitations and challenges. What comes next? Join us as we explore the batteries of the future and the alternatives to lithium that could transform the world.

Lithium has numerous advantages, but it also presents significant challenges. Lithium can be environmentally costly to extract, and growing demand is putting pressure on global supplies. In addition, lithium batteries, while efficient, have limitations in terms of storage capacity and safety. So what options do we have?

In the search for more affordable and abundant alternatives to lithium-ion batteries, sodium-ion batteries are emerging as a promising option by using sodium instead of lithium as the active ion. Although they do not currently achieve the same energy density as lithium batteries, sodium-ion batteries offer significant advantages in safety and sustainability by using more abundant and less expensive materials. In addition, solid-state batteries represent another innovation by replacing liquid electrolyte with solid electrolyte, improving safety and potentially energy efficiency with higher energy densities and faster charge times, making them ideal for applications in electric vehicles and portable devices. Finally, graphene, known for its ultra-thin and tough structure, is revolutionising energy storage with promises of ultra-fast charge times and long lifetimes, promoting significant advances in consumer electronics and industries, and paving the way for a new generation of more efficient and durable devices.

While electric batteries have been the mainstay of modern energy storage, relying only on one technology isn´t enough to meet the energy challenges of the future. Diversification of storage sources is essential to create a robust and resilient energy system. In addition to electric batteries, exploring options such as thermal storage and other innovative methods will allow us to make better use of renewable energy, optimise energy efficiency and ensure a constant and reliable supply.

Let´s discover some of these fascinanting alternatives!

Compressed air storage (CAES) uses underground caverns or tanks to compress air at high pressure during periods of low electric demand. When electricity is required, the compressed air is expanded to generate power efficiently through turbines, which is crucial for stabilising power grids in areas where topography doesn´t allow for reservoirs. Hidraulic storage, on the other hand, harnesses reservoirs and dams to store and release water on demand, providing stability to the electricity system and facilitating the integration of intermitent renewable enrgies towards a more sustainable and stable future.

In the vibrant world of energy, one of the biggest challenges is managing those times when energy consumption spikes unexpectedly. How do we ensure that our power grid holds up without blackouts?

Vecteezy.com

An alternative can be flywheels, which are notable for their ability to store kinetic energy in a rotating disc and release it almost instantly. But they aren´t the only heroes in this scneario. Supercapacitors, with their ability to charge and discharge energy at breakneck speeds, also play a crucial role in providing a boost of energy when it is needed most.

By integrating these technologies, which are capable of providing large power peaks in short periods of time, with other storage or generation systems, remarkable stability is achieved in electricity grids. This is especially beneficial for small or medium-sized grids that intend to operate in isolation, ensuring a reliable and constant power supply.

Phase change materials (PCM) are substances that store and release large amounts of thermal energy during their melting and solidification process. These materials can be used for applications such as building air conditioning, improving energy efficiency and reducing the need for heating and cooling systems.

Similar to PCM, thermal change material (TCM) store thermal energy, but with different mechanisms, such as absorbing and realeasing heat through chemical reactions. The TCM can be used in thermal energy storage systems for solar power plants, increasing efficiency and storage capacity.

Ammonia is emerging as a promising energy carrier. It can be used as fuel directly or as a storage medium for hydrogen. As a liquid at moderate temperature and pressure, it is easier to store and transport than pure hydrogen. Moreover, it can be produced sustainably using renewable energies.

Hydrogen by Vecteezy

Hydrogen is considered by many to be the fuel of the future. It can be produced from water using renewable energy, stored and then converted back into electricity using fuel cells. In addition, it has thermal and mobility apllications. However, the challenge remains the infrastructure for its efficient and safe production, storage and distribution.

The race for the next generation of energy storage technologies is in full swing. With so many promising options on the horizon, the future of portable energy and storage looks brighter than ever. From sodium and graphene to innovative phase-change materials and hydrogen, we are on the verge of an energy revolution.

At CARTIF, we excel with innovative projects that explore advanced solutions for energy storage, such as THUMBS UP and SINNOGENES, among others. These projects reflect our strong commitment to research and development of sustainable technologies that are set to transform the global energy landscape. Keep up to date with the latest news by visiting our blog and website to follow these exciting developments.

Innflation

Innflation

‘Innflation’ (innovation + innflation) is the phenomenon whereby an increase in the supply of R&D is not reflected in a reduction in its price because there is a stimulated demand for the purchase of that R&D.

It´s the phenomenon that moves us away from dull innovation systems characterised by continuous price reduction due to oversupply and allows us to have thriving innovation systems characterised by long-term transfer relationships so that the R&D generated is transformed into innovation when successfully exploited.

A dull innovation system, in which the phenomenon of ‘innflation’ doesn´t occur, is characterised by the fact that the public resources allocated to the generation of R&D supply are public expenditure, because the agents that generate that supply are stressed and compete in a red ocean in terms of price. These are innovation systems dependent on the outside world with low and decreasing levels of productivity, characterised by the flight of talent.

Dull innovation system. Innovation system dependent on the outside world with low and decreasing levels of productivity, characterised by the flight of talent.”

It is therefore a question of implementing dual innovation policies that make it possible to sustain the supply of R&D, but also to stimulate the demand for R&D so that public resources are invested and not spent, to compete on value by creating blue oceans and not on price, undervaluing innovation, to have stimulated and efficient R&D agents, to use our own technology and promote our technological independence, and to have an impact on increasing productivity and retaining talent.

Stimulating demand for R&D must be done through systemic policies with a single, comprehensive visionthat includes:

  • Attractive tax deduction policies to stimulate new investors in innovation.
  • Industrial policy to increase the m2 of production plants equipped with their own technology (supply of R&D generated)
  • Education and employment policies to create and retain talent.
  • Communication and information policy to create culture, but, above all, innovation discipline.
  • Policies for the creation of technology-based companies based on the supply of R&D generated.

Stimulating demand will maintain long-term transfer relationships and have a positive effec on ‘innflation’ levels.

Innovate for you, innovate for me, innovate for us.

METABUILDING Labs, or how to improve the technical and environmental quality of façade components for building construction

METABUILDING Labs, or how to improve the technical and environmental quality of façade components for building construction

The construction sector has evolved over the years and, with it, processes and products have gradually adapted to the needs of the market at all times. At CARTIF we have been researching and working in the field of infrastructures and building around thirty years to transform architecture and develop technological solutions focused on sustainable and intelligent construction.

We operate in different fields of application with special emphasis on the sensorisation and monitoring of infrastructures, the integration of renewable energies in buildings, as well as 3D printing technologies in construction, devices and IoT networks (Internet of Things).

On the road to the quest for the smart home, CARTIF researches in building rehabilitation and preventive maintenance, 3D digitisation and measuring, FEM simulation, the development of new materials with innovative properties and solutions for logistics and transport.

A proof of this is the METABUILDING Labs project, where we lead the construction of a network of test benches for façade components.

Metabuilding labs brochure

The main objective of this project, funded by the Horizon 2020 european programme and compound by a consortium of 40 partners proceed of 13 european countries, is contribute a Innovative European Ecosystem and a competitive, sustainable and inclusive grid of Open Innovative Testbenches, that stimulates the inversion of vanguard technologies for building envelopes.

With a focus on optimising the technical and environmental quality of building products, the project consortium is driving the development of these technologies by providing access to services and infrastructure for prototyping, testing and certification. The platform metabuilding.com serves as virtual and unique access to this powerful innovation ecosystem, that includes a wide grid of testing facilities.

In addition, innovative, replicable, standarised and cost-effective facilities known as O3BET (Open Source/Data/Access Building Envelope Testbench) have been desgined and developed during the project to test innovative envelope components under real conditions on a 1:1 scale.

CARTIF has been invovled in the definiton of the requirements and specifications of the prototype of this 03BET and has built the first and only test bench of these characterisitcs in Spain, which is located in the Boecillo Technolgoy Park, next to our facilities. The aim is to continue working on the start-up, the definition of tests and services, the development of the corresponding digital twin, as well as the replication of this test bench, which will be built in seven other countries in the European Union.

This is a milestone that we want to continue to pass on to all companies in the building renovation sector, especially SMEs, to facilitate their access to highly innovative testing tools. And, ultimately, to improve the sustainability of construction.

You can also consume locally

You can also consume locally

In a world that is increasingly globalized, the trend to consume local products and opt for short distribution chains has become increasingly relevant. This approach not only has economic implications but also environmental and social ones, positively impacting citizens and the planet. However, this trend is far from becoming our routine food shopping practice.

According to data published by the Spanish Ministry of Agriculture, Fisheries, and Food in 2021, food is primarily distributed through supermarkets, hypermarkets, and discount stores, reaching 73% of sales, while traditional shops distribute 18% of food1. At the European level, direct sales between farmers and consumers only represent 2% of the fresh food market2.

Some forms of selling local or proximity products through short distribution chains include farmers’ markets, direct on-farm sales, or community-supported agriculture (CSA), a model in which consumers purchase subscriptions directly from farmers and in return, regularly receive fresh products like fruits, vegetables, and sometimes meat or dairy during the harvest season.

Consuming local products strengthens the economy of our region. By buying directly from local producers and farmers, we promote the growth of small and medium-sized businesses, generating employment and keeping resources within the community. This cycle of local consumption and production helps create a more resilient economy, less dependent on global fluctuations.

Short distribution chains, characterized by the minimal number of intermediaries between the producer and the consumer, have a direct impact on the freshness and quality of products. By reducing the time and distance of transport, food arrives fresher and more nutritious to our tables. Additionally, this reduction in transport decreases carbon emissions and the ecological footprint, significantly contributing to the fight against climate change.

From a social perspective, local consumption strengthens social ties. Knowing the producers and understanding the origin of the products we consume creates a deeper connection and a sense of belonging and responsibility towards our community. This direct relationship also allows for fairer trade, where producers receive adequate remuneration for their work, avoiding exploitation and promoting decent working conditions.

In terms of sustainability, short distribution chains promote more responsible and sustainable agricultural and production practices. Local producers often adopt more environmentally friendly farming methods, such as organic or regenerative agriculture, which preserve biodiversity and improve soil health. This contrasts with the intensive, large-scale practices of global food industries, which often result in environmental degradation and loss of natural resources.

FUSILLI_local consumption

However, there are barriers that are preventing the take-off of this type of distribution. The main limitations are the small volumes and limited variety of production that are not always able to meet the demand of large buyers, such as in the case of public purchases for hospitals, schools, etc. Additionally, the time and lack of specific producer’s skills can be considered barriers since, besides production tasks, they must perform marketing, advertising, sales, management, etc. Moreover, the higher price and lower convenience, meaning less variety in sizes, formats, pre-processed products, etc., of these types of products make them less adaptable to the lifestyle of many people compared to products sold in large distribution chains. There is also the lesser availability of hours or proximity that these markets can offer the consumer.

Research into how to minimize these barriers is key to tipping the balance towards a more responsible and sustainable production and consumption model in the long term. Greater consumer awareness, along with increased support from public agencies to generate and maintain strategies and actions that support local consumption, are essential.

Many cities and regions are implementing multiple, integrated strategies to promote the shortening of supply chains and stimulate the demand for locally and sustainably produced food. These represent a firm commitment to the development of low-carbon, resilient, and diversified food systems. Some examples are the Strategic Food Plan of Catalonia 2021-2026, the Municipal Action Plan of the Vitoria-Gasteiz Food Strategy 2017-2025, or the Food Corridors Strategy in Coimbra (Portugal).

Local consumption market_FUSILLI

Some of the actions that are part of these strategies include promoting an online sales network for local products, enhancing the commercialization of local products through the increase and improvement of producer market infrastructures, fair trade fairs, etc., creating a distribution network for local products and facilitating the adhesion of local producers to it, legislating and training public technicians to improve local producers’ access to public procurement, especially in tenders aimed at school canteens, among others.

These strategies and actions are being developed with the participation of many involved actors, from producers to consumer associations, including distributors, food companies, representatives of public agencies, etc., and are equipped with solid monitoring and evaluation mechanisms.

CARTIF, through the FUSILLI project, is working in 12 European cities with the aim of shortening food distribution chains and contributing to the transition towards a more sustainable food system. This set of best practices and experiences are available to be adapted to any other context involved with local consumption and the sustainability of its citizens and planet.

And as an example of our commitment, CARTIF, in collaboration with the Association of Organic Producers Vallaecolid, offers its employees the possibility to buy local and seasonal products weekly and receive them at their workplace. It’s that easy! Are you willing to be part of a similar initiative?


1 Report of the food consume in Spain 2020. Available at: https://www.mapa.gob.es/ca/alimentacion/temas/consumo-tendencias/informe-anual-consumo-2020-v2-nov2021-baja-res_tcm34-562704.pdf

2 Short food supply chains and local food systems in the EU, 2016. Available at: https://www.europarl.europa.eu/RegData/etudes/BRIE/2016/586650/EPRS_BRI(2016)586650_EN.pdf