One-stop AI Model Marketplace: Putting Development, Testing, and Implementation Together

CONTRIBUTING TEAM： Hui-Hung Yu, Pei-Yi LU, Wei-Yu Chen, Chen-Kai Sun, Jian-Hong Tsai, Wen-Yi Chang

AI has entered a period of rapid growth with a wide variety of apps emerging quickly. As a global technology hub, the tech industry, academic institutions, and research communities have actively contributed to the development of AI. NCHC has created an AI model marketplace which aims to accelerate AI development in our country by integrating high-performance computing and high-speed networks. 

The NCHC AI Model Marketplace program was first developed in 2021 to provide an AI model sharing environment for the AI research program at the Taiwan AI Center of Excellence (Taiwan AICoE) of the National Science and Technology Council. Presently, the NCHC AI Model Marketplace is available mainly to academic and research institutions, but the platform will also be open to external use in the future. We hope that through the sharing of the infrastructure resources of HPC and storage capacity at NCHC may lower the entrance barriers for AI research and development.  


the NCHC AI Model Marketplace 

As one-stop service, the NCHC AI Model Marketplace integrates four major functions: NCHC Data Marketplace integration, model development, model training, and model management. Users may develop or upload model on this platform which provides an AI model training environment and a variety of AI development tools, builds and trains models. The MLflow tool is integrated into the platform for developers to manage model parameter experiment records, tune and test, and select the best model.

Model owners can put developed models on the platform for subscription and continue to optimize the results on it. Furthermore, users can also use APIs to link to their own systems and expand the scope of their applications. The platform is based on a PaaS architecture, where the platform itself is free to use, and computing or storage resources are charged based on demand. Users can create containers on the platform, train models with computing resources, and develop APIs through NCHC iService.


The NCHC AI Model Marketplace is the premier platform in Taiwan dedicated to meeting the needs of the academic and research community. Creating a suitable software and hardware environment for AI models requires substantial resources, which can be a heavy burden for researchers, often resulting in shelved research results at the end of projects. Leveraging NCHC's powerful HPC, advanced configuration, and rigorously certified information security mechanisms, it fully supports the development, maintenance, and application of AI models, ensuring that research outcomes can be implemented. This initiative not only facilitates practical utilization of R&D results but also contributes to the country's digital development efforts.

The NCHC AI Model Marketplace has been completed and is now offering services, and the NCHC team continues to optimize its functions.  The internal demonstration project is used as a functional test such as data model construction and shelf management, and after the initial test is completed, it will be expanded to other AI plans to learn whether the platform can meet the service management needs of users, and at the same time to adjust the allocation of computing resources.   We hope it can meet the needs of different fields for AI development, help Taiwan accelerate the pace of AI research and development, and enhance the country's competitiveness.
 

Integrate Gradio to display machine learning models visually