research
∙
07/27/2023
Pre-training Vision Transformers with Very Limited Synthesized Images
Formula-driven supervised learning (FDSL) is a pre-training method that ...
share
research
∙
03/02/2023
Visual Atoms: Pre-training Vision Transformers with Sinusoidal Waves
Formula-driven supervised learning (FDSL) has been shown to be an effect...
research
∙
12/19/2022
Fixed-Weight Difference Target Propagation
Target Propagation (TP) is a biologically more plausible algorithm than ...
research
∙
12/06/2022
Parameter Efficient Transfer Learning for Various Speech Processing Tasks
Fine-tuning of self-supervised models is a powerful transfer learning me...
research
∙
07/05/2022
PoF: Post-Training of Feature Extractor for Improving Generalization
It has been intensively investigated that the local shape, especially fl...
research
∙
06/18/2022
Replacing Labeled Real-image Datasets with Auto-generated Contours
In the present work, we show that the performance of formula-driven supe...
research
∙
03/24/2021
Can Vision Transformers Learn without Natural Images?
Can we complete pre-training of Vision Transformers (ViT) without natura...
research
∙
01/21/2021
Pre-training without Natural Images
Is it possible to use convolutional neural networks pre-trained without ...
research
∙
01/19/2021
Initialization Using Perlin Noise for Training Networks with a Limited Amount of Data
We propose a novel network initialization method using Perlin noise for ...
research
∙
06/08/2020
Semi-Supervised Contrastive Learning with Generalized Contrastive Loss and Its Application to Speaker Recognition
This paper introduces a semi-supervised contrastive learning framework a...
research
∙
04/16/2020
Speech Paralinguistic Approach for Detecting Dementia Using Gated Convolutional Neural Network
We propose a non-invasive and cost-effective method to automatically det...
research
∙
02/29/2020
Augmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation
Unpaired image-to-image (I2I) translation has received considerable atte...
research
∙
11/12/2018
Sequence-Level Knowledge Distillation for Model Compression of Attention-based Sequence-to-Sequence Speech Recognition
We investigate the feasibility of sequence-level knowledge distillation ...
research
∙
07/19/2018
Few-Shot Adaptation for Multimedia Semantic Indexing
We propose a few-shot adaptation framework, which bridges zero-shot lear...
research
∙
05/30/2018
A Fine-to-Coarse Convolutional Neural Network for 3D Human Action Recognition
This paper presents a new framework for human action recognition from 3D...
research
∙
04/01/2018
I-vector Transformation Using Conditional Generative Adversarial Networks for Short Utterance Speaker Verification
I-vector based text-independent speaker verification (SV) systems often ...
research
∙
03/30/2018