Andrew Buie, who rushed for 100 yards, had a 42-yard reception on a screen play set up Bailey's second touchdown, an 18 yarder that put the Mountaineers ahead 45-7 midway through the third quarter.
Weis hoped to use a bye week to try to figure out a way to slow down Austin, but the Jayhawks had little luck.
Austin set up three first-half touchdowns with long plays. He had four catches for 110 yards, 77 rushing yards and a score and broke his own single-season school record for all-purpose yards.
Austin has 2,760 total yards this season, second in the FBS to Western Kentucky's Antonio Andrews (2,977).
West Virginia surpassed 200 rushing yards for the third straight week since Austin was inserted into the backfield as well as playing his slot receiver spot. In the three games before that, the Mountaineers failed to reach 100 yards on the ground.
"When we get the ground game going, that alleviates the pressure for (Smith)," Holgorsen said. "Us being able to run the ball makes his stats look a whole lot better."
Kansas junior James Sims had 57 yards to finish with 1,013 for the season, becoming the first 1,000-yard rusher for the Jayhawks since Brandon McAnderson in 2007.
Kansas quarterback Dayne Crist got his first start since Oct. 13, a span of six games. He threw a 41-yard pass to Andrew Turzilli on Kansas' second drive that put the Jayhawks inside the West Virginia 20. But two penalties pushed the ball back and West Virginia's Karl Joseph intercepted a tipped pass on third-and-18 to halt the threat.
Crist lasted just two series before Michael Cummings relieved him. Cummings found some success on the option read and led the Jayhawks to their only touchdown in the second quarter. Cummings and Christian Matthews took snaps in the second half.