Framework for Qualifying AI Systems in Industrial Quality Inspection (AIQualify)

For small and medium-sized enterprises (SMEs), the manual part of quality inspection in industrial production is very high. By using artificial intelligence (AI), companies hope to automate quality inspection and gain economic benefits. Machine learning (ML) methods such as artificial neural networks are coming to the fore. These promise high performance and are trained entirely on data, without the need for explicit, human-made rules. However, it is precisely the self-learning property that leads to concerns among companies regarding reliability or acceptance and makes the evaluation of ML methods more difficult, in contrast to conventional software and rule-based AI systems. In addition, SMEs often lack the human resources and expertise to test the suitability of third-party AI systems. The aim of the project is therefore to develop a software framework for the simplified qualification and auditing of ML-based AI systems in industrial quality inspection. The framework consists of a process model including software-supported methods and tools. Since the development of AI systems goes through several phases and development decisions with an impact on the result are made in each phase, qualification covers all phases. To this end, the framework supports the determination and formulation of test and evaluation criteria along all phases. These criteria are recorded in a so-called assurance case (AS), which is used by the framework to support the auditing of the AI system. The framework has a modular design, enabling simple integration and expansion of testing and auditing modules. The framework is intended to enable SMEs in particular to assess the performance of AI systems even without their own AI specialists.

The EU AI Act has officially come into effect – a groundbreaking regulatory framework that will have a lasting impact on the use and development of artificial intelligence (AI) in Europe. With this act, the EU aims to regulate AI to ensure transparency, safety, and ethical standards in AI technology. The act’s requirements, including those set forth in Article 4, will come into force gradually according to specific timelines. Article 4 calls on AI providers and deployers to take measures to ensure their staff possess a sufficient level of AI literacy.

Article 4

• Date of entry into force: 2 February 2025
• Mandates measure to ensure sufficient levels of AI literacy
• Poses implementation challenges for companies and organizations

We are interested in your insights regarding Article 4 and its potential impact on your company or organization. The survey aims to gather perspectives that can support the effective implementation of Article 4 of the EU AI Act by understanding how AI providers and deployers are preparing for this requirement.

Share your opinion and participate in our survey.

Participation in the anonymous survey is voluntary, takes about 10 minutes of your time and can be canceled at any time without giving reasons.

The survey will be active from November 6, 2024 to November 29, 2024.

On November 7, 2024, the 8th DGQ Quality Day 2024 took place in Frankfurt. Prof. Huber gave a presentation on the AIQualify project. He explained how machine learning (ML), as a core component of AI, is increasingly finding its way into quality inspection and how, in contrast to classic software, ML models are specified by data and generated automatically, which is why classic methods for qualification or capability assessment fall short. In this way, he made the transition to the AIQualify project, in which a framework for the qualification of AI-based quality inspection systems is being developed that takes into account the established development steps of ML models. He then provided insights into the objectives of AIQualify, current project results and industry-related use cases.

On the 11th and 12th of December 2023 the AI Quality Summit took place in Frankfurt. As part of a deep dive, we had the opportunity to present the project AIQualify and exchange ideas with many national and international representatives from research institutions and well-known companies in the field of AI development. This allowed us to expand our professional network and participate in the European debate on the quality of artificial intelligence. There were interesting presentations in the plenary session and insightful discussions from which we were able to benefit for our project. The AI Quality Summit 2023 was an enriching event that provided us with valuable insights and new contacts in the field of quality and regulation of artificial intelligence.