Tianying Ji

PhD student, Tsinghua University

About Me

Hi! I am currently a PhD student at the State Key Laboratory of Intelligent Technology and Systems, Tsinghua University, advised by Prof. Fuchun Sun. I obtained my bachelor degree from Department of Computer Science, Tsinghua University in 2020.
I am broadly interested in research on the Reinforcement Learning and Robotics.

Publications and preprints

Media Image
ACE: Off-Policy Actor-Critic with Causality-Aware Entropy Regularization
Tianying Ji*, Yongyuan Liang*, Yan Zeng, Yu Luo, Guowei Xu, Jiawei Guo, Ruijie Zheng, Furong Huang, Fuchun Sun, Huazhe Xu
arXiv, 2024
project page / arXiv / bibtex
Media Image
Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Critic
Tianying Ji, Yu Luo, Fuchun Sun, Xianyuan Zhan, Jianwei Zhang, Huazhe Xu
arXiv, 2023
project page / arXiv / bibtex
Media Image
Leveraging Causal Policy-Reward Entropy for Enhanced Exploration
Tianying Ji*, Yan Zeng*, Yu Luo, Xianyuan Zhan
Tiny Papers Track @ ICLR 2024 (Present (Notable))
OpenReview / bibtex
Media Image
Goal-Conditioned Hierarchical Reinforcement Learning With High-Level Model Approximation
Yu Luo, Tianying Ji, Fuchun Sun, Huaping Liu, Jianwei Zhang, Mingxuan Jing, Wenbing Huang
IEEE Transactions on Neural Networks and Learning Systems
Paper Link / bibtex
Media Image
H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps
Haoyi Niu*, Tianying Ji*, Bingqi Liu, Haocheng Zhao, Xiangyu Zhu, Jianying Zheng, Pengfei Huang, Guyue Zhou, Jianming Hu, Xianyuan Zhan
DMLR @ ICLR 2024
project page / arXiv / bibtex
Media Image
DrM: Mastering Visual Reinforcement Learning through Dormant Ratio Minimization
Guowei Xu*, Ruijie Zheng*, Yongyuan Liang*, Xiyao Wang, Zhecheng Yuan, Tianying Ji, Yu Luo, Xiaoyu Liu, Jiaxin Yuan, Pu Hua, Shuzhen Li, Yanjie Ze, Hal Daumé III, Furong Huang, Huazhe Xu
ICLR, 2024 (Spotlight) / CoRL Workshop (CoRL23-WS-Deployable), 2023
project page / arXiv / bibtex

Media Image
When to Update Your Model: Constrained Model-based Reinforcement Learning
Tianying Ji, Yu Luo, Fuchun Sun, Mingxuan Jing, Fengxiang He, Wenbing Huang
NeurIPS, 2022 (Spotlight)
project page / arXiv / code / bibtex
Media Image
A Robust Tube-Based Smooth-MPC for Robot Manipulator Planning
Yu Luo, Mingxuan Jing, Tianying Ji, Fuchun Sun, Huaping Liu
arXiv, 2021
arXiv / bibtex
Media Image
BDAC: A Behavior-aware Dynamic Adaptive Configuration on DHCP in Wireless LANs
Congcong Miao, Jilong Wang, Tianying Ji, Hui Wang, Chao Xu, Fenghua Li, Fengyuan Ren
IEEE 27th International Conference on Network Protocols (ICNP), 2019
paper link / bibtex