Chapter 119: The Tenured Implementation
[HOOLI CAMPUS MACHINE INTELLIGENCE BUILDING MONDAY, DECEMBER 28, 2015 6:15 PM]
Gavin stood at the head of a conference table that seated twenty four and held twelve. The Prometheus quarterly review had been running for forty minutes. Margaret Keane had presented the patent status. Helen Park had presented the model progress. David Wu's empty chair had not been discussed.
The projection on the wall showed a timeline. Q1 2016 was a red bar. Q3 2016 was a green bar. The space between them was labeled PARITY in Gavin's own font.
"He's a technically gifted operator," Gavin said. He did not sit, moving while he talked, which was something the room had learned not to comment on. "Extraordinary supplier. Unusual eye for hiring. Those are the two load bearing walls."
At the far end of the table, he stopped.
"Cut the supplier or cut the talent and he's a man with a whiteboard and a sandwich shop."
Nobody disagreed. Vincent Mora, at the table's midpoint, wrote something on a legal pad. His coffee was cold. He drank it anyway.
"Second wave," Gavin said. "Approved."
Helen Park looked at Vincent. Vincent did not look up from his pad. Helen Park wrote nothing, which was its own document.
Gavin turned to the window. The campus lights were on across the quad. Four miles south, a man was sitting down at a keyboard he had not touched in five months.
Gavin did not know this. The room did not know this. The timeline on the wall did not account for it.
[GARDNER ANALYTICS RESEARCH FLOOR MONDAY, DECEMBER 28, 2015 8:12 PM]
The desk was the same one he had used in July, cleared himself before the review terminal open, repository current. The latest commit he had pulled thirty seconds ago, and read the diff twice, because the second read was slower than it should have been.
Ethan put his hands on the keyboard.
The design layer was gone; he had known it would be, the Haze Clock having taken that first, at stage two, the architectural acceleration stripped down to functional Phase 3. What remained was the keyboard acceleration, the raw typing speed, the thing that made his fingers move faster than his thinking. That was still there. The old buzz he could feel in his wrists, the hum of a machine that wanted to run.
He typed the first function header.
It came out at roughly twice speed. Not five times. Twice.
His fingers knew where the keys were. The syntax was correct. The structure was sound. But the design layer the part that saw the whole shape before the first line landed was a room with the lights off. He was building by touch in a dark house he used to own.
The first component was the tokenizer wrapper a thing he had written a thousand times, could write in his sleep. He was, in fact, not entirely sure he was awake.
He wrote it. It took ninety minutes. It should have taken eighteen.
The file went up saved, the commit message three words: `core: tokenizer wrapper`. His name appeared in the log.
It was the first commit with his name on it since July.
Twenty two engineers would see it in the morning, a fact he did not think about, before he opened the next file.
The hours came apart.
Three calendar slots he had blocked: Monday 8 PM to Tuesday 2 AM, Tuesday 9 AM to Tuesday 8 PM, Wednesday 9 AM to Wednesday 6 PM. Seventy hours. The title was "Review."
Sarah had seen the blocks. She had not asked. She had rescheduled the board dinner to January. She had taken the investor call herself. She had moved the Tuesday one on one to Thursday. She had done all of it without sending him a message, because the operational trust did not require one and the explanatory trust did not exist.
The components came in the order the architecture demanded. Tokenizer. Positional encoding. Scaled dot product attention. Multi head aggregation. Layer normalization. Feed forward. Residual connection. Each one a brick in a wall he could not see the top of.
At hour fourteen he realized he was writing comments that explained things he did not need to explain. He was narrating the code to himself because the design layer was not doing it for him. He deleted the comments. He wrote more code. The code was adequate.
Adequate was the word. Not good. Not elegant. Not the thing that had made Sarah catch a shape mismatch bug in two seconds while pulling a shot. Adequate, the way a bridge is adequate. The way a meal is adequate. The way a life is adequate, once the shine wears off.
At hour twenty three his back hurt. At hour twenty nine his eyes stopped focusing on objects closer than his hand. At hour thirty five the pastrami smell from Manny's came up through the floorboards and he ate a sandwich that was on his desk, not remembering it arriving. It was Tuesday.
He typed through it. The components kept coming. The forward pass was next.
At hour fifty one, he ran a test.
A small one. Batch of four. Sequence length under sixty four. A toy problem, the kind of thing a graduate student would write to check that the plumbing was connected. He had written it a thousand times in another life.
The output window showed a loss value.
It was 7.8. It was dropping.
Forty seconds he watched it. The loss ticked to 7.7. Then 7.69. The gradient was flowing. The weights were updating. The architecture was breathing.
Something crossed in him. Not a click. Not a flash. More like a long stuck door finally swinging open, hinge creaking from disuse ten implementations built now, ten counted, personal, verified. The requirement was satisfied. The ladder moved.
The phase arrived without him noticing no notification, no interface, no window. There was only the loss value, dropping, and the knowledge that the next component was the optimizer state, and the knowledge after that, and the knowledge after that.
The next component he named to himself. "AdamW scheduler." Then he wrote it.
[Wednesday 4:07 AM]
Kai came in through the freight entrance because the front lock stuck at night and he had stopped trying it months ago. His bug was in the data pipeline, a race condition in the sharding layer that only triggered when the queue depth exceeded four hundred. He had been chasing it since Tuesday evening.
The research floor was dark except for one desk.
He stopped.
Ethan was asleep under the monitor. His head was back against the wall. The terminal kept running, the cursor blinking on a half written function. The commit log on the screen showed a name: Ethan Gardner, twelve times, in three days.
Kai read the most recent commit. Then he read the one before it. Then he read all of them. The code was not like the code in the rest of the repository. It was slower. More explicit. Each step laid out in a hand that knew where it was going but walked there instead of running.
Kai looked at his own commit from Tuesday afternoon, then back at the one on the screen. His editor opened without a decision behind it, and the function he rewrote came out longer, more deliberate, matching the style on the sleeping screen.
The commit went up. The monitor he turned off not the one the CEO was sleeping under before heading back to the freight elevator.
Nobody heard about it from him.
[Wednesday 11:04 PM]
The training run started.
Marcus had the rack configured since Monday. Sixteen dashboards were live on the wall. The step counter read zero. The GPU utilization gauge sat at ninety one percent and held.
Ethan remained at the desk, awake now for sixty one hours. The last three were spent reviewing the launch config, the hyperparameters, the data shard manifest each one checked against the architecture he had written with his own hands. Each one found correct, in a way that surprised him. The surprise meant he had expected to be wrong.
The first step completed. The loss value came back.
12.4.
Ordinary. Enormous. The number every language model starts from, the entropy of a system that has not learned anything yet, the floor of a building that would take weeks to climb.
It stared back at him. The step counter ticked to one.
Sarah appeared at the desk. She had a coat on. She had been home and come back. She looked at the dashboards, then at him, and ran the checklist she had not been asked to run.
"Sleep?"
"Not yet."
"Food?"
"The sandwich."
"Budget authorization?"
"Monica signed off Tuesday."
She put her hand on the back of his chair. "You're done."
"The run just started."
"The run is Marcus's now. You're done."
He did not argue. The loss ticked to 12.1. The step counter read three.
She walked him to the freight elevator, and he leaned against the wall. The grinding of the bearing was loud in the shaft. It sounded like a maintenance problem nobody had time for. He wasn't sure if he meant the elevator, or anything else.
The door opened on the ground floor. The pastrami smell was faint at this hour, the overnight trace. His car was four blocks away.
"Go home," Sarah said.
"The loss curve "
"Marcus has it. Go home."
He went.
✦ ━━━━━━━━━━━━━━━━━━━━━━━━ ✦
Read more chapters for free at unwrittenrealm.com
✦ ━━━━━━━━━━━━━━━━━━━━━━━━ ✦
TL;DR — Patreon has the chapters ahead.
Silver / 10 ahead
Gold / 15 ahead
Platinum / 20 ahead, no weekly wait
That's it. patreon.com/fanficwriter1
If reviews aren't your thing, no pressure — they do help though.