Tsu-Jui (Ray) Fu

I am currently a 2nd-year Ph.D. student in Computer Science at UCSB, advised by Prof. William Wang. My research topic is about Natural Language Processing (NLP) and Computer Vision (CV).

Previously, I finsh my B.S. in National Tsing-Hua University (NTHU) and be lucky to work with Prof. Shan-Hung Wu, Dr. Wei-Yun Ma, Prof. Chun-Yi Lee, and Prof. Hwann-Tzong Chen.



Research Assistant 2019 - present
Advisor: Prof. William Wang

Research Intern Summer 2020
Microsoft Research
Advisor: Dr. Yale Song and Dr. Daniel McDuff

Research Intern Summer 2019
Preferred Networks
Advisor: Dr. Yuta Tsuboi and Dr. Jason Naradowsky

Research Assistant 2017 - 2019
Academia Sinica CKIP Lab
Advisor: Dr. Wei-Yun Ma

Research Assistant 2017 - 2018
Advisor: Prof. Chun-Yi Lee

Research Collaboration 2017 - 2018
Umbo Computer Vision
Advisor: Prof. Hwann-Tzong Chen

Research Intern Summer 2017
Academia Sinica CKIP Lab
Advisor: Dr. Wei-Yun Ma


SSCR: Iterative Language-Based Image Editing via Self-Supervised Counterfactual Reasoning
Tsu-Jui Fu, Xin Eric Wang, Scott Grafton, Miguel Eckstein, and William Yang Wang
EMNLP 2020 (long)
Paper | Project | Code

Counterfactual Vision-and-Language Navigation via Adversarial Path Sampler
Tsu-Jui Fu, Xin Eric Wang, Matthew Peterson, Scott Grafton, Miguel Eckstein, and William Yang Wang
ECCV 2020 (spotlight)
Paper | Project | Model

Why Attention? Analyzing and Remedying BiLSTM Deficiency in Modeling Cross-Context for NER
Peng-Hsuan Li, Tsu-Jui Fu, and Wei-Yun Ma
AAAI 2020 (oral)
Paper | Project | Code

A Distributed Scheme for Accelerating Semantic Video Segmentation on An Embedded Cluster
Tsu-Jui Fu*, Hsuan-Kung Yang*, Kuan-Wei Ho, Po-Han Chiang and Chun-Yi Lee
ICCD 2019 (oral)
Paper | Project

Adversarial Active Exploration for Inverse Dynamics Model Learning
Zhang-Wei Hong, Tsu-Jui Fu, Tzu-Yun Shann, Yi-Hsiang Chang, and Chun-Yi Lee
CoRL 2019 (oral)
Paper | Project

GraphRel: Modeling Text as Relational Graphs for Joint Entity and Relation Extraction
Tsu-Jui Fu, Peng-Hsuan Li, and Wei-Yun Ma
ACL 2019 (long)
Paper | Project | Code

Attentive and Adversarial Learning for Video Summarization
Tsu-Jui Fu, Shao-Heng Tai, and Hwann-Tzong Chen
WACV 2019 (oral)
Paper | Project | Code

Region-Semantics Preserving Image Synthesis
Kang-Jun Liu, Tsu-Jui Fu, and Shan-Hung Wu
ACCV 2018
Paper | Project | Code

Diversity-Driven Exploration Strategy for Deep Reinforcement Learning
Zhang-Wei Hong, Tzu-Yun Shann, Shih-Yang Su, Yi-Hsiang Chang, Tsu-Jui Fu, and Chun-Yi Lee
NIPS 2018
Paper | Project

Speed Reading: Learning to Read ForBackward via Shuttle
Tsu-Jui Fu and Wei-Yun Ma
EMNLP 2018 (long)
Paper | Project | Code

Dynamic Video Segmentation Network
Yu-Syuan Xu, Tsu-Jui Fu*, Hsuan-Kung Yang*, and Chun-Yi Lee
CVPR 2018
Paper | Project | Code

Learning from Observation-Only Demonstration for Task-Oriented Language Grounding via Self-Examination
Tsu-Jui Fu, Yuta Tsuboi, Sosuke Kobayashi, and Yuta Kikuchi
NeurIPS 2019 (ViGIL workshop)
Paper | Project

H-FND: Hierarchical False-Negative Denoising for Robust Distantly-Supervised Relation Extraction
Tsu-Jui Fu and Wei-Yun Ma
EMNLP 2019 (DeepLo workshop)
Paper | Project

Visual Relationship Prediction via Label Clustering and Incorporation of Depth Information
Hsuan-Kung Yang, An-Chieh Cheng*, Kuan-Wei Ho*, Tsu-Jui Fu, and Chun-Yi Lee
ECCV 2018 (PIC workshop)
Paper | Project

Dialogue-based Diverse Travel Itinerary Recommendation System via Path Sampling
Tsu-Jui Fu, Yu-Han Chen, Huan-Cheng Chang, and Wei-Yun Ma


Teacher Assistant, Vision Learning Summer School, NTHU Summer 2018
Teacher Assistant, Deep Learning Institute, NVIDIA Taiwan Spring 2018
Teacher Assistant, CS565600 Deep Learning, NTHU Fall 2017
Teacher Assistant, CS210401 Hardware Design and Lab, NTHU Fall 2017

  Invited Talk

Counterfactual Vision-and-Language Navigation via Adversarial Path Sampler, Taiwan AI Labs 10/21/2020
Improving Data Scarcity for Vision-and-Language via Counterfactual Reasoning, Academia Sinica 10/20/2020
Introduction of Deep Learning for Language, NTHU 05/15/2020

template from jonbarron