Search Results for author:
Found 4 papers, 0 papers with code
XL3M: A Training-free Framework for LLM Length Extension Based on Segment-wise Inference
Under the XL3M framework, the input context will be firstly decomposed into multiple short sub-contexts, where each sub-context contains an independent segment and a common ``question'' which is a few tokens from the end of the original context.
Digital twin-assisted three-dimensional electrical capacitance tomography for multiphase flow imaging
Three-dimensional electrical capacitance tomography (3D-ECT) has shown promise for visualizing industrial multiphase flows.
Progressively Stacking 2.0: A Multi-stage Layerwise Training Method for BERT Training Speedup
In BERT training, the backward computation is much more time-consuming than the forward computation, especially in the distributed training setting in which the backward computation time further includes the communication time for gradient synchronization.
CoRe: An Efficient Coarse-refined Training Framework for BERT
In the second phase, we transform the trained relaxed BERT model into the original BERT and further retrain the model.
