影像

Photonic_Workshop@CCMS.NTU has successfully developed a motorized micro-mapping system to explore and navigate samples. This system is able to acquire high resolution images to produce a sample map automatically. This map is also synchronized with the coordinates of motorized stages. This achievement allows users to explore and position their hotspots from the map, and precisely deploy the hotspot to the central field of view by motorized stages. In addition, this mapping system can combine with a laser scanning confocal spectral microscope (LSCSM) to acquire sample spectral mapping. Our result has shown the capability to improve the efficiency of hotspot positioning and data acquisition process.

Searchlight is composed to high brightness redgreen LEDs. The message of Morse code is transmitted through LED colorlengths of ”on/off” time in human-machine interface. CCD image sensor integrated with LEDs receives light signal of LED from another ship,then identify the real message through the image recognition software.

We invented a non-destructive terahertz (THz) deep-learning computed tomography system based on time-domain spectroscopy. In the method, THz time-domain signals are profiled. Multiple features are retrieved from those profiles by a trained modeltransformed to the spatial domain to reconstruct a cross-sectional tomographic image. We have also invented a 3D THz tomographic system based on multi-scale spatio-spectral feature fusion in a multi-scale manner. We believe our work will stimulate further applicable research of THz tomographic imaging with advanced computer vision techniques.

Laser material recognition technologyintelligent color compensation lighting system, with AUV to realize the function of underwater rust detectionimage color restoration, real-time acquisition of rust information through spectral analysisdisplay of true rust color on the image, so that the algorithm can be accurate Determine the health of the cylinder. The vehicle will establish the health information of the wind turbine to help the inspector make the best maintenance strategymaintain the power generation efficiency of the wind turbine in the best condition.

"The IHC staining intensity grading algorithm combines a series of complementary processes of deep learningimage processing in order to overcome the difficulties in cell boundary segmentationgrade definition,provides a cell-based IHC staining intensity gradingquantification capability. The proposed method serves as a useful assistive tool for physicians in performing accurate staining quantification in tissue microscopic images. In addition, it analyzes panoramic pathological images in order to determine the factors most strongly associated with likely disease recurrence."

The technology utilizes image continuity and contactless monitoring of blood pressure and respiration state to help patients avoid wearable pressure when detecting sleep apnea and reduce the complexity of detection. The system can help users to easily detect sleep status in their lives, contactlessly measure and make daily health records, as the real-time management monitoring of daily homecare. This technology conducts IRB clinical trials, establishes a large database, joins physician professions, and optimizes AI solutions.

This project is used for advanced driver assistance systems (ADAS)automatic driving. At present, our project will use a more sensitive CMOS single photon detector array to reduce the number of photons required for detection to less than ten, in order to break through the cost barriers of applications of LiDARestablish low-cost, high-performance LiDAR modules.

We developed a wearable ultrasound monitoring device to monitor the collapse of tongue roots of sleep respiratory patients throughout the night,completed clinical trials in the sleep center. The experimental results show that this device can effectively monitor OSA. The tongue structure changes at the timeintegrates ultrasound information into the commercial PSG system. It is expected

The chromium-doped zinc gallate, ZnGa2O4:Cr3+, material is viewed as a long-lasting luminescent phosphor which can avoid tissue autofluorescence interference for in vivo imaging detection. The cubic ZGC revealed a specific accumulation in liver0.5 Gy used at the end of X-ray excitation was sufficient for imaging of deep seated hepatic tumors.

Optical coherence tomography using an optical probe with a diameter of 0.9 mm, combined with the 14-18 gauge needle, is used for clinical needle puncture. Using the real-time image obtained from the tip of the needle in the tissue, the needle position can be identified. Combined with artificial intelligence can achieve objective, accurate and automatic identification of the tissue, which has been successfully verified in anesthesia and laparoscopic surgery.

"a.The Digital ArchivingConservation System of Cultural Relics combines various imaging techniques like catoptric imaging, 3D renderingmulti-spectral imaging, which provides multiple scientific images data for the inspection of cultural relics. b.Environment Detection System allows controlling the environmental device from a far distance."

This technology integrates 1000+ times of UAV imaging experiences with labeled rice lodging images for training. A rice lodging recognition model using deep learning reaches 90 accuracy. The recognition model can be deployed in a microcomputer mounted on UAVs to implement edge computing. While taking aerial images, the inference can be completedreveal lodging areadamage level in-time.

This technology integrates acoustic-optical sensing calculationrecognition information,uses hydrophones to estimate the state of dynamic targetsvisually recognizelocate the dynamic target for vehicle motion control. The fusion acoustic-optical sensing architecture can be used according to the target statecharacteristics. By calculatingadapting to the environmenttarget state characteristics, the exploration tasks will be performed.

We developed a Multiview 3D capturing system based on camera array for generating stereoscopic 3D printing. Based on the framework, we are capable to create well aligned 3D contentcalibrated color images. The depth perception of content can be manually adjusted for preview,for generating quality 3D stereoscopic printing.

Our devices automate the microscopic examinations, including samplinginspecting of micro-objectsmotorized stacking micrography. Sampling rate is expected to increase more than 30 with an improved product quality by a standardize procedure. Motorized stacking micrography extends back to front sharpness of a photomicrographgreatly reduce the operation timeerrors more than 50.

Nanopharmaterial is a term by combining pharmaceuticalmaterial via nanotechnology. Here we demonstrate this concept by developing a novel nanopharmaterial, so called 177Lu-Gold nanostar (AuNS). 177Lu is a therapeutic radionuclide emitting moderate-energy beta particles as well as gamma rays for SPECT/CT-based imaging diagnosis. Nanostar can target tumors by enhanced permeability retention (EPR) effectsowns the photothermal therapeutic potent. The core technology is to integrate radionuclidenanomaterial to perform a new radio-nanopharmaterial for tumor target theranostic purpose.

The principle of the image-based AFib discriminating system is based on the consistency that irregular cardiac cycles can both be detected on the waveforms of electrocardiographyrPPG. The quantity of the blood varies from time to time is captured by a general camera. Signals from RGB channels are then synthesized through the core algorithm to eliminate noisegenerate stable rPPG signals. The processed signals are then classified as AFibnot by a sample-size model. According to the IRB evaluation in En Chu Kong Hospital, the AFib can be well detected with an accuracy of 97.1.

The developed Unmanned autonomous underwater vehicles (AUV) included 3-D modeling technology, wireless power transfer between sub-system in AUV, GPS underwater locate system, low complexity frequency domain on ocean floor analyze with AI network, underwater objects detection network, image dehaze network on groundunder water, underwater color correction network, underwater objects classification network, underwater optical characteristic algorithmLED color compensation system.

Our research team has developed a short-wave infrared light gold nanoclusters as an intraoperative fluorescent imaging agent, breaking the light emission limit of the previous gold nanoclusters, shifting the light emission position to the infrared spectrum, successfully avoiding the autofluorescence between the tissuesachieve deeper penetration along with instant bio-imaging. This technology has clearerdeeper imaging benefit with the potential to become a clinical medical infrared imaging agent.

An automated agricultural machinean intelligent crop production decision-making system are developed for greenhouse asparagus growth monitoring. Automationenergy-saving machinery technologiesInternet of Things/information communication techniques are adopted to achieve the goal of "saving laboreffort"improve "management technologies". The developed machinesystem can greatly improve the qualityquantity of domestic asparagus production,achieve the dual goals of stabilizing the outputenhancing quality of harvested asparagus.

PANCREASaver contains a “PC automatic segmentation model” (image segmentation)a “PC analysis AI model” (image classification) that can read the DICOM format of postcontrast CT images directly for the automatic analysis process. After conducting prep-processing with image processing algorithms, C2FNAS is employed to illustrate the tumor position prior to the diagnosis conducted by CNN. The results can be provided to the physician for diagnostic reference so as to reduce early omissionsincrease the detection rate of pancreatic cancer.

Based on our long-term accumulated healthy brain image database, we used meta-analysismultivariate analytical algorithms to extract the cognitive biological characteristics of individual subjects. By using machine learning / artificial intelligence algorithms, these features were further calculated for capturing individual cognition according to related brain networks. This biological index could be a potential marker for evaluating individual brain health, cognitive functions,risk for neurodegenerative diseases.

1.Low-Power Processing-in-sensor CMOS Image Sensor 2.Implementation of Low-PowerLow-Latency Deep Learning Chip based on Neuromorphic Intelligence (collaborated with MOST 108-2622-8-007-009) 3.Development of Neuromorphic Chip based on The Fruit Fly VisualSpatial Sensory Systems 4.Hardware-Software Co-Design for Neuromorphic AI Chips

The main purpose of this invention is to provide a training system with the surrounding photographing unit, the display unit,a force platform. The system can immediately capture the motion of the user from various angles,measure the force of the user from both legs, in order to provide the useful biofeedback information to coachesathletes.

Dynamic vision sensors have been investigated to report motion-only images for moving object recognition. Less but essential information helps post-process recognition algorithm reduces computationimproves accuracy. Implement low powerlow latency deep Learning chip based on neuromorphic Intelligence. The neuromorphic obstacle detection algorithm integrates visualproprioceptive signals. The algorithm is characterized by its efficiencylow power consumption. We possess the next-generation in-memory computing AI chipsnext-generation UAV key softwarehardware technology

The Air/Ground cooperation for optimal rice harvesting model is established to provide a visual harvesting decision service on a cloud platform. Drones and mobile devices are employing to estimate grain moisture and forecast the variation of harvest moisture content (HMC) in the coming days by huge amounts of imagery data, deep learning algorithms, and weather forecasts. This model can benefit in several aspects, such as setting an accurate and comprehensive optimal harvest schedule, reducing the cost of agricultural apparatus and barn ovens, ensuring the rice quality, and maximizing farmers' benefits. The potential value of the model practice could be more than a billion in Taiwan.

In order to solve the undiscovered problem that caused by the fall ofelders, we develop a deep learning based systemnamed it 「SkyEye」,which includes our own sensor 「AI Falling Image Sensor」, a cloud sever that storespushes information about fall eventsa mobile app that communicates with users.

This system uses the innovative AIoT application to target annoying scalp maintenance problemsdevelops an intelligent scalp detectionmanagement system. The core of the technology is to use deep learning-based object detection models. Tens of thousands of microscopic image data sets that are labeledtrained for scalp symptoms. As a result, the scalp image recognition module is develop, such as dandruff, hair loss, oil, and inflammation, etc. Hence this system can provide scalp detection, and maintenance effectiveness tracking functions lead scalp maintenance services to a new level of intelligent management.

"The designed ultrasound gel is modified with nanocrystalnanofiber. The product is designed to be sterilizablefits well to the ultrasound probe. With such nanomaterials, our product shows great ultrasound transmission abilityenhanced mechanical strength. The highlights of the this ultrasound agent include: (1) Enhanced compressibilitytensile strength with adjustable composition. (2) Improved infection controlreduced risk of complication. (3) Improved transmission depth with certain thicknessimproved image quality within superficial region."

"For video anomaly detection, we apply pretrained models to obtain the foregroundthe optical flow as ground truth. Then our model estimates the information by taking only a single frame as input. For human behaviors, we take the human poses as inputuse a GCN-based model to predict the future poses. Both the anomaly scores of these two works are given by the error of the estimation. For defect detection, our model takes patches of the image as inputlearns to extract features. The anomaly score of each patch is given by the distance between the patchall the training patches."