What is deep learning?

What is deep learning?

In the 20th Century 80’s decade there was reborn interest in neural networks, both in academia and industry. A neural network is an algorithm that mimics the neural connections present in the neocortex. The interest was motivated by the rediscovering of algorithms to train the networks. Through training, a neural network can learn to do something. And since neural networks are implemented in computers, we have computers that can learn. This is an intellectual ability that people share with monkeys among other animals with neocortex. For this reason, neural networks are the backbone of machine learning, which according to some is part of artificial intelligence.

Neural networks can learn to classify objects and also to reproduce the behaviour of complex systems. They learn by examples. When we want to teach a neural network to differentiate between apples and oranges we have to present it examples of both fruits with a label indicating if it is an orange or an apple. The point is the neural network will be able to correctly classify oranges and apples different to the ones used during training. This is because a neural network does not perform a mere memorisation, but they are able to generalise. This is the key for learning.

But the interest in neural networks that raised up during the eighties faded as the following decade started because more promising machine learning methods appeared. However, a group of indomitable Canadian researchers managed to persevere and transformed neural networks into deep learning.

Deep learning is an algorithm family similar to neural networks, with the same aim and better performance. The number of neurons and connections is higher, but the main difference is the abstraction capacity. When we train a neural network to differentiate between apples and oranges we cannot present the items as they are, we have to extract some features that describe the oranges and apples, as the colour, shape, size, etc. To do this is what in this context we call abstraction. In contrast to neural networks, deep learning is able to do abstraction by itself. This is the reason why deep learning is thought to be able to understand what they see and heard and it is, therefore, a bridge between machine learning and artificial intelligence.

As it happened with neural networks, deep learning has gained huge interest among companies. In 2013, Facebook failed to buy company DeepMind, but Google succeeded one year later when it paid 500 million dollars for it. In case some body missed this irruption of deep learning in the media, it became mainstream in early 2016 when Google DeepMind software AlphaGo beated Lee Sedol, the go champion. This was an unprecedented technical success because go is much harder than chess. When IBM’s Deep Blue won Garry Kasparov in 1996, it used a strategy based on figuring out all the possible short-term movements. However, this strategy is not possible in go because the possibilities are infinite in comparison to chess. For this reason, Google DeepMind’s AlphaGo is not programmed to play go, it is able to learn to play by itself. The machine learns by playing many times against a human player, improving in every game until it becomes unbeatable.

Deep learning is not a secret arcane, anybody who wants to learn it can do it. There are free available tools, like Theano, TensorFlow and H2O, that allows any person with programming knowledge and the concepts in mind to try it. The company OpenAI has freely released its first algorithm, which has been made around the reinforced learning paradigm. There also companies offering commercial products onto which applications can be build. These are the cases of the Spanish Artelnics and the Californian Numenta. Deep learning is being successfully used for face recognition and verbal command interpretation.

Deep learning, besides other machine learning paradigms, could be an important innovation opportunity. It could be one of the tools to unleash the value hidden in the big data repositories. Moreover, in the industrial practice it could be used to detect and classify faults or defects, to model complex systems to be used in control schemes, and in novelty detection.

Safety in collaborative robotics

Safety in collaborative robotics

In July 2015 we were surprised by the news that a robot kills factory worker after picking him up and crushing him against a metal plate at Volkswagen plant in Baunatal (Germany). They insisted the death was a result of human error and not any malfunction on the part of the robot. A Volkswagen spokesman stressed that “the robot was not one of the new generation of lightweight collaborative robots that work side-by-side with workers on the production line and forgo safety cages”.

The application of robots in industrial processes is widespread in industry (mainly automotive), where they perform a multitude of tasks, mostly sequential, repetitive and at high speed. Accidents caused by robots are highly unusual. Many robot accidents do not occur under normal operating conditions but, instead during programming, maintenance, repair, testing, setup, or adjustment. During many of these operations the operator, programmer, or corrective maintenance worker may temporarily be within the robot’s working envelope where unintended operations could result in injuries. During normal operation, robots are confined in safety cages precisely to prevent incidents in contact with humans.

Without adequate safety measures traditional industrial robots can cause serious accidents to people by crushing and trapping (occur when a worker’s limb or other body part can be trapped between a robot’s arm and other peripheral equipment, or the worker may be physically driven into and crushed by other peripheral equipment; it can be deadly, as in the case of Baunatal), collision or impact (occur when a robot’s movements become unpredictable and a worker is struck by the robot) or by projection of materials (occur when parts of the robot , tool or product handled, breaks and fly off and hits a worker).

By rules applicable throughout the EU, it has been mandatory to provide a sufficiently large security perimeter to the entire workspace of the industrial robot that prevents access to the robot when in operation. When it will be necessary to enter to this area, the worker must perform some action to stop the robot, facilitating the access. Harmonised standards ISO 10218-1 and ISO 10218-2, “Safety requirements for industrial robots”, contain the minimum requirements for safe operation of these industrial robots.

This “separation” between workers and robots in an industrial environment is weakened through collaborative robots already available on the market (Universal Robots family of robots, ABB’s YuMi, KUKA’s LBR iiwa…) and the new technical specification ISO/TS 15066:2016, “Collaborative Robots”, that specifies the safety requirements for collaborative industrial robot systems and the work environment. The standard describes different concepts of collaboration and requirements needed to achieve them. The ISO standard also points out that the collaborative operation is a developing field and the new technical specification is likely to evolve in future editions.

Collaborative robots are designed to operate in a shared workspace with workers without the need for conventional protections, safety cages or safety barriers. The main premise in the design of these robots is the safety of workers (Asimov’s first law of robotics: “a robot will not harm a human being”). These robots are designed to work side by side with workers.

The proximity of workers and robots requires a great safety design based on a combination of mechanical design and control measures, both the manipulator and the workspace. So rather than talking about collaborative robots, in CARTIF we prefer to speak of safe collaboration spaces (collaborative spaces). Besides the robot is safe, so it is the applications and working environments.

To ensure safety can be used different technologies and security measures. Lightweight manipulators without shearing or cutting points, with rounded geometries, smooth surfaces and deformable or elastic components. Speed, acceleration and power can be limited. Current, force, torque sensors can be integrated to detect collisions. Real-time movement of the robot can be adjusted with proximity and tactile sensors. In order to be “aware of the collaborative space” it can be added visual systems based on 2D/3D computer vision technologies.

Usually, collaborative robots are similar to traditional industrial robots but smaller, lighter, less fast and powerful, cheaper and easier to install and configure. These robots do not need to be fast or powerful as they are specially designed to interact with workers. As experts say, in a collaborative space, the worker can bring skills, flexibility and, above all, ability to identify, understand and solve problems, and the robot provides repeatability, accuracy and endurance. Nevertheless, the ISO/TS 15066:2016 standard does not limit the capabilities of the robot in collaborative applications.

Augmented reality. The new work tool

Augmented reality. The new work tool

Augmented Reality (AR) is a technology that is little by little is making way in our daily lives. In broad terms, it consists in embedding digital information to the reality we have before our eyes through real-time superposition of this information about the image that provides our device, either a Smartphone, Tablet or a Smart Glasses.

Therefore, to use this technology is not necessary to have special devices. Thanks to the mobile devices development, equipment available to everyone as those mentioned before, can be the instrument that will allow access to the world of Augmented Reality (AR). It is true that in the last years are emerging new devices such as the Smart Glasses that are adapted specifically to this type of applications, and allow provide a better user experience by leaving freedom of movements of their hands. It is expected that with the development of new applications these devices will be entering in the consumer market in a generalized manner, as has happened with other devices such as smart watches, or activity tracker wristbands.

There are many applications of Augmented Reality (AR) and are varied. Most of them are oriented to leisure and tourism. As an example, there are applications that just taking a picture of a monument or a work of art, can provide you with information about it, its history, or oddities such as images of their appearance in the past.

New applications are emerging constantly related to leisure, mobility, marketing and advertising, including additional content that improve and enhance the user experience. These contents can be quite varied, including explanatory texts, links to supporting documentation, videos, images, indications for locating places or events, etc.

Equally, new applications are emerging for use in professional fields, such as architecture, to show designs and scale models, marketing and sales, for example catalogs that include QR codes to display additional content, medicine or education, which presents countless opportunities for the expansion of content through videos, tutorials or examples, allowing to learn in a more enjoyable and didactic way.

The industrial environments also are becoming an important field of application of Augmented Reality. Most experts expected that large-scale implementation in the industrial area will take place in the next three to five years as an increasingly robust technology. CARTIF is involved in some projects that apply the augmented reality to maintenance work in the industry.

Through the use of a Smart Glasses, the technicians are able to perform their tasks as they have always done, since they have complete freedom to use their hands, and at the same time they can access, for example, to technical specifications sheets for particular equipment, to the drawings of a facility, or the operating and malfunction history for a machine.

It would also be possible to guide the maintenance operator in performing a particular task, indicating the steps to be carried out and checking when and how has performed them. In the same way, they could be very useful in the training of novice operators for the accomplishment of these tasks, or even that the managers can monitor and evaluate the performance of operators.

Internet connected agriculture

Internet connected agriculture

Agriculture is a so old human activity that popular wisdom is full of proverbs and sayings giving recommendations about the best way to precede in farm duties. Popular wisdom along with the knowledge transmitted from parents to children has determined agriculture practice for centuries. Only in 20th Century the advent of machines and chemical fertilisers and pest-controllers started to change the conditions.

Sensor Yara ALS (Active Light Source) to estimate the nitrogen needs.

Nowadays agriculture has to face a changing scenario. New cultures, new policies, less water available, less public tolerance towards chemicals, less people attracted by rural life, emergent countries and the market dominated by a few, big actors. This changing situation leads agriculture to adopting industrial-like principles: process optimisation, cost reduction, performance improvement.

Information and Communications Technologies (ICT) and Internet of Things (IoT) can help to improve agriculture activities according to the new paradigm. These technologies are related to the ability to generate, to process and to use data from the agriculture process.

Data source can be sensors in the process and activity logs. When data are accessed through Internet and processed in the cloud to provide autonomy to the process we have an IoT process because it is not the farmer who is using Internet but the things themselves, where a thing is the field, an irrigation device or a combine harvester. Let’s see some examples that can be applied to improve agriculture.

An irrigation system can be automatized using moisture sensors buried in the soil. When the moisture reaches a critical value determined by the farmer, the system starts to work and will go on while the moisture is below the threshold. When the field is wide enough sensors can be placed along it, and the irrigation system can apply different water flows depending on the local conditions. The system can be improved by incorporating weather prediction, which can be used to delay the irrigation when rains are foreseen. Alternatively, the system can warm the farmer who will make a decision based on the information provided by the system.

Other example is a combine harvester equipped with a sensor able to measure the production per square meter. At the end of the task, there is a map of the field reflecting the production meter by meter. This map can be used during the next season to adjust the fertilisation according to the local needs. Moreover, the most suitable time to fertilise is automatically computed considering weather and soil conditions and the forecasted values.

All these techniques based on sensors, data processing and Internet access to the data, machines and fields allow to improve the farm yield and to reduce the use of resources. At the same time, they allow to cover the blanks caused to popular wisdom by this changing world.

Would you buy an electric car?

Would you buy an electric car?

If you are hesitating about which technology would best fit your needs and liking, you should carefully analyze pros and cons and compare what you can get from both. A good starting point may be the type of driving you intend to do. If you plan to spend a lot of time in stop-start traffic, then the electric one might be the right choice.

For electric cars usually the high purchase price is a barrier that will only be overcome if you intend to drive enough kilometers along their useful life. You can counteract your initial investment with the lower price of electricity when compared to diesel or gasoline.

Another barrier is the driving range, which may be around 150 – 200 km under real conditions. Though this should be enough to cover actual everyday driving needs, facts show that this is an important deterrent for most potential buyers. Right now, plug-in cars account for not more than one-tenth of 1% of the global car market, and they are rare in the streets of our cities in most countries (Norway or Netherlands would be an exception). The Organization of the Petroleum Exporting Countries predicts just 1% of electric vehicles in 2040, while other experts don’t foresee a real impact for the next 50 years.

However, some hints suggest that predictions might be different for the short term. According to Bloomberg New Energy Finance (BNEF), several carmakers (including Tesla, Chevrolet and Nissan) plan to sell long-range electric cars at around €25.000, while they are investing billions on new models. Moreover, battery prices fell 35% last year and their related technology is quickly evolving towards higher energy density. According to BNEF the price of long-range electric vehicles is expected to fall below €20.000 by 2040 and 35% of new cars worldwide will be plug-in.

Real facts are that those vehicles achieving the highest number of sales in 2015 were Volkswagen Golf (275.848 sales), followed by Ford Fiesta (173.999 sales). These numbers have been surpassed by the 276.00 pre-orders received by Tesla for their new Tesla 3 model, though they won’t necessarily become actual sales in 2017. The basic Tesla 3 model will have a starting purchase price of €31.000, and a range of at least 346 km per charge. This makes a big difference to all we have seen till now. Tesla has been known worldwide for their luxurious models, only affordable for a few well-off and now they offer their technology to everyone.

So both price and driving range might not be barriers anymore.

Another argument in favour of electric cars is the driving experience, extremely quiet and smooth, with no need of a gearbox, and therefore easier than an internal combustion one.

Costs related to maintenance should be less in electric car than those from conventional ones, due to the absence of gearbox, oils and cooling fluids. Moreover, electric drives have less moving parts.

An important argument against might be battery longevity, which is not 100% reliable and might fail before expected. As this is somehow uncontrollable many manufacturers are offering long warranties to reassure potential customers. Some of them offer battery-leasing schemes as an alternative to acquiring the battery together with the car.

Finally, other obstacles for most potential buyers are the difficulties and additional costs associated with installing a charging point at home for an electric car, where one feels the vehicle will be safely charged at the preferred time (usually overnight).

You can get a pretty good estimation of the total costs associated to your new car, be it conventional or electric, with CEVNE, a tool developed by CARTIF that helps you decide from the budgetary point of view.

And if all the previous arguments are not enough to help you make a decision, you should then consider the benefits of electric vehicles for the environment. Tail-pipe emissions are zero, thus helping to improve air quality in our cities and towns, though we know the electricity used for charging must come from somewhere… maybe a coal fired power station. If this were the case we would not be contributing that much to a cleaner environment, though we know the share of renewable sources worldwide is steadily increasing.

SAGIT, Advanced Production Management System

SAGIT, Advanced Production Management System

Spanish SOHOs and SMEs have faced in recent years to a very complex macroeconomic environment. Indeed, it might be more precise saying that they are still facing this situation. The fall in the domestic consumption, along with financial constraints, has caused a contraction of the main economic indicators in most productive sectors of our economy.

Despite this unfavorable scenario, we happily can see that the adoption of ICT –Information and Communications Technologies – tools is clearly consolidated in the daily procedures of management and control. ICT tools introduction is considered absolutely necessary for survival in the market. IC Technology keeps being one of the best allies of entrepreneurs in their attempt to improve the competitiveness of their business, allowing the opening of new markets and the optimization of the internal management processes.

Regarding their information systems, one of the biggest challenges that these companies may face, is the adoption of an advanced management system capable to accurately identify the current and future situation of their business. That is, a system that centralizes all the company data and numbers.

However, unfortunately, much more often than expected, we can found SMEs who have suffered serious problems in the process of implementing such systems. If we wanted to enumerate the different possible causes for the occurrence of these problems, every entrepreneur, worker or implementation technician that have faced a situation like this, could probably provide two or more reasons based on their particular suffering experience. What we can state is that, in too many occasions, projects fail because their excessive implementation required time. Companies must adapt to the new market trends while they are implementing already obsolete tools associated to their production processes.

However, we must not understand these problems as an obstacle to the adoption of such systems within our companies. We simply must consider it as a warning of the deserved importance of the implementation processes within the company. It is crucial to accept and understand that, every worker in the company must be an active element in the implementation process, and each worker role is equally relevant, with completely independence on their position within the organization. In order to success in the implementing project, there are two equally important choices to make: system and people. The final selection of the system, in order to choose the most suitable one for the company profile and the required objectives. The company personnel, involved in the data collection must be aware of the importance of doing it rigorously in time and place.

Obviously, all the responsibility for the success or failure must not be attributed only to the company staff. The role developed by the technician staff of the outsourced implementing company will be also essential. Implementing tasks will face predicted and also unexpected problems. The external technicians must be able to early detect them and choose the most suitable solution for each situation.

Regarding this last issue, in CARTIF, we have developed our own advanced management ICT system specifically oriented for the SMEs: SAGIT. It was initially though and designed targeting the agrofood industrial companies and their traceability requirements. First developments and implementing were focus on the vegetables and winery sectors. After that, additional functionalities were added in order to be implemented in diverse sectors like fresh and cured meat, flour mills, daily-products, industrial bakery, snacks, etc. Over time the system has evolved into a multi-sector solution capable of managing any company in any sector. In addition, we managed to create, build and maintain a work team with extensive experience in adapting and implementing the same solutions in many different processes and situations.