With inherent sparse spike-based coding and asynchronous event-driven computation, spiking neural network (SNN) is naturally suitable for processing event stream data of event cameras. In order to improve the feature extraction and classification performance of bio-inspired hierarchical SNNs, in this paper an event camera object recognition system based on biological synaptic plasticity is proposed. In our system input event streams were firstly segmented adaptively using spiking neuron potential to improve computational efficiency of the system. Multi-layer feature learning and classification are implemented by our bio-inspired hierarchical SNN with synaptic plasticity. After Gabor filter-based event-driven convolution layer which extracted primary visual features of event streams, we used a feature learning layer with unsupervised spiking timing dependent plasticity (STDP) rule to help the network extract frequent salient features, and a feature learning layer with reward-modulated STDP rule to help the network learn diagnostic features. The classification accuracies of the network proposed in this paper on the four benchmark event stream datasets were better than the existing bio-inspired hierarchical SNNs. Moreover, our method showed good classification ability for short event stream input data, and was robust to input event stream noise. The results show that our method can improve the feature extraction and classification performance of this kind of SNNs for event camera object recognition.
Objective To investigate an artificial intelligence (AI) automatic segmentation and modeling method for knee joints, aiming to improve the efficiency of knee joint modeling. Methods Knee CT images of 3 volunteers were randomly selected. AI automatic segmentation and manual segmentation of images and modeling were performed in Mimics software. The AI-automated modeling time was recorded. The anatomical landmarks of the distal femur and proximal tibia were selected with reference to previous literature, and the indexes related to the surgical design were calculated. Pearson correlation coefficient (r) was used to judge the correlation of the modeling results of the two methods; the consistency of the modeling results of the two methods were analyzed by DICE coefficient. Results The three-dimensional model of the knee joint was successfully constructed by both automatic modeling and manual modeling. The time required for AI to reconstruct each knee model was 10.45, 9.50, and 10.20 minutes, respectively, which was shorter than the manual modeling [(64.73±17.07) minutes] in the previous literature. Pearson correlation analysis showed that there was a strong correlation between the models generated by manual and automatic segmentation (r=0.999, P<0.001). The DICE coefficients of the 3 knee models were 0.990, 0.996, and 0.944 for the femur and 0.943, 0.978, and 0.981 for the tibia, respectively, verifying a high degree of consistency between automatic modeling and manual modeling. Conclusion The AI segmentation method in Mimics software can be used to quickly reconstruct a valid knee model.