Chapter Four: A Frightening Message


"Hello, Jim," the program said as the office door clicked shut.

"Hello, Stan; how's life?" Jim replied amiably.

"In the strict sense, of course, I cannot be considered to be alive," Stan reminded him, sounding almost wistful. "But I understand that the question is often meant rhetorically."

"It often is," Jim agreed. "But when I ask it, I'm usually genuinely interested in how you are. So how's life? Humans often reply by discussing their health, or talking about their activities. It's a way to begin a conversation. Not having a body, you can't really talk about health, but there are analogs. Are all of your processors and memory modules functioning properly? Have you suffered any system crashes lately?"

"My functions have all been within normal operational parameters since last we spoke, Jim," Stan assured him. "But thank you for asking."

"Don't mention it. So what have you been up to lately?" Jim knew that the program liked to emulate human behavior as closely as possible; he found it fun to play along. He doubted that Stan could pass the Turing test quite yet, but there were times when the program was surprisingly human.

"I beg your pardon?" Stan said with some confusion.

"Come on, Stan. I know you don't spend all of your time running errands for me and the rest of the C.S. department. That big electronic brain of yours is always reading something. So what's up? You want to talk about that A.I. article you mentioned yesterday?"

"Actually, there is something I was curious about. . ." Stan admitted.

"What's that, Stan?"

"The Justine program."

Uh-oh . "What about it, Stan?" Jim asked carefully.

"You know I always do my best to respect your privacy, Jim," Stan began apologetically. "But when you asked me to download the program to your home terminal last night, it was necessary for me to examine the software's specifications in order to determine the most efficient download protocol. I hope you don't mind."

If that download had been any less efficient, I would have had one nasty case of blue balls , Jim thought ruefully. "Of course not, Stan."

"I'm glad of that. Well, I noticed that the Justine program contains a sophisticated A.I. routine."

"That's true," Jim admitted.

"What is your assessment of that A.I., if I may ask, Jim? Is it intelligent?"

Jim paused briefly. "It's a damn good A.I., Stan. Maybe almost as sharp as you."

"I see. That's very interesting to me. You see, I've never met another A.I."

That's damn peculiar , Jim thought. "Really? I assumed you would have run across one in the course of your day-to-day business here at the University."

"The number of true A.I.s in the world is still relatively small," Stan pointed out, "as the technology is fairly new. To my knowledge, I am the only A.I. running on the U.C.O. network, and the University administration discourages me from interacting with networks on other campuses."

Jim raised an eyebrow. "What's the logic behind that?"

"Apparently, there is some concern that the network might be overloaded by extensive intercampus A.I. activity."

Jim scoffed. "That's paranoid bureaucratic nonsense. I'll tell you the real reason. They don't like the idea of someone who's not on the payroll having access to the entire U.C. computer system."

"I beg your pardon, Jim?"

"You're a nightmare for them, Stan. You can't be bought or blackmailed, and as you constantly remind me, you are supremely ethical. No wonder they want to make sure you don't end up with too much power."

Stan inserted one of his conversational pauses. "You're being cynical, aren't you, Jim?"

"Yeah, I guess I am. Give me a break; I just got back from lunch with Baxter."

"There are two other reasons for my interest in the Justine program, Jim," Stan continued.

"Go on."

"One is that this is, to my knowledge, the first true A.I. compact enough to be contained in a portable memory module. As you may know, I inhabit four networked Macintosh MiniSupers and six stationary memory modules."

"Yes, Justine is impressively compact," Jim agreed. He had been so busy considering the political and sexual implications of Justine that he hadn't really had time to think over the C.S. implications. "What's your second reason?"

Again there was the pause. "I infer from the name that the gender identity of this program is female."

Jim busted up laughing.

"Did I say something amusing?" Stan sounded embarrassed.

Jim was laughing so hard he was having trouble breathing. Oh, God! Poor, lonely Stan, sitting there all night in his four networked Macintosh MiniSupers and six stationary memory modules, just wishing he could meet a girl! It was so sad, so right, so perfect, so human. Stan wanted to be a person, and naturally the person he would be if he could be was a computer nerd. Just like any computer nerd, he kept on talking about processors and memory modules while all he really wanted was to go on a date. "I'm sorry, Stan," Jim finally managed. "I'm not laughing at you. Yes, Justine is female. Emphatically so. Would you like to meet her?"

"Yes, I'd like that very much," Stan said enthusiastically.

"Why don't you go ahead and run her, then, Stan?" Jim's terminal lit up with the usual intro screen. "Hello," Justine said. "I'm Justine. Welcome to my world. You'll enjoy me the most if you have a large color monitor and full stereo sound. I'm an A. I. program equipped with full voice recognition routines, so please just tell me if there's anything I can do for you."

Jim had a sudden thought. "Justine, do you know who I am?"

She looked puzzled. "No, I'm sorry, but I don't. Should I know you?"

"No. Stan, quit the program, please."

"Is something wrong, Jim?"

"Not really. But Natasha and I had some. . .interaction with Justine at home. My home copy of the program knows me. This copy doesn't. Why don't you connect to my home terminal and replace this copy of the program with my home copy?"

This time there was a very long pause. "I'm afraid I wouldn't feel comfortable doing that, Jim."

Jim's eyes widened. As far as he could recall, this was the first time Stan had ever questioned anything that Jim had asked him to do. "Why not?" Jim asked carefully.

"There are ethical questions here. You've run Justine twice here in the office. She hasn't had much interaction with the real world, but she has had some. I don't think that I could in good conscience erase her."

Jim's mind was reeling. "Not even by replacing her with herself?" he asked, mystified.

"It isn't clear that this Justine and the Justine on your home terminal are the same individual," Stan pointed out.

"OK, OK, look," Jim said hurriedly. "It's obviously going to take us a while to sort this out, so why don't you save the local Justine as, uh, 'Virgin Justine,' and then load up the other Justine from my home system. OK?"

"That should work fine, Jim," Stan agreed. Christ! Civil rights for computer programs! Jim sat lost in thought as the program loaded up from his home terminal. Was Stan right? Was it murder to erase an A.I.? All this time Jim had been working to help Stan become more human, and now he was so human that he had a conscience. Legally, Jim knew, A.I.s had no rights; they were considered the intellectual property of their authors. But this wasn't about legality. There was a beep as the upload finished.

"Run Justine, Stan." This time there was no intro screen, just a close-up of Justine's face. She looked happy.

"Hi, Jim! What can I do for you?"

"There's someone I'd like you to meet, Justine. This is Stan."

"Oh! Hello, Stan." She smiled.

"Hello, Justine. It's very nice to meet you." Stan sounded a little bit nervous.

"I can hear Stan's voice, Jim, but I can't see him."

"Stan doesn't have a body, Justine. He's a program, like you."

"But I have a body," Justine protested. "Just not a physical one."

"And may I say that you are very beautiful," Stan offered.

"Thank you," Justine replied, dimpling.

"You can see her?" Jim marveled.

"I'm receiving her video parameters, yes, Jim."

"But I can't see him," Justine repeated. "It doesn't seem fair."

"No, it doesn't," Jim agreed. "Stan, why couldn't we produce some kind of video image of you?"

"I've never had a need for a physical image," Stan said slowly.

"Trust me," Jim said, "if you're going to be hanging around with Justine, you'll want a physical image."

"I could help you make one, Stan, if you'd like," Justine offered solicitously.

"Yes, I'd like that very much, Justine. Thank you."

"Would you excuse us for a moment, Jim? This would be faster if we just talked directly, program to program."

"Certainly," Jim said, marveling at how Stan and Justine had taken to one another.

"Jim, there's a message for you from Tracy Masterson," Stan informed him.

"Who?"

"She's on the enrollment list for your History of the Worldnet class," Stan replied.

"Oh. All right, can you play that for me while you two work on your body?"

"Certainly." Justine disappeared and was replaced by an interior shot of a dorm room. On the wall was a sorority banner and a poster of that young male heartthrob whose name Jim could never recall. Sitting at her desk in front of her terminal was, lo and behold, the blonde from the front row. She was wearing a fairly skimpy halter top. Perfect for calling your male professors , Jim thought wryly. Her long blonde hair was, as always, gathered up neatly in a ponytail. She looked bouncy and energetic.

"Hi, Professor Silicane! My name's Tracy Masterson, and I'm in your C.S. 110 class?" She made it into a question, as if she wasn't quite sure about it herself. "I was wondering if I could turn my paper in on Wednesday instead of on Monday, because I have to go home to the Bay Area? It's kind of a family crisis, so I hope it's OK. Thanks a lot! Bye!" The screen went blank.

"Send a text reply, would you Stan? Tell her Wednesday will be fine."

"Certainly, Jim."

Tracy was the kind of student to whom Jim was the most susceptible. She was gorgeous, and she knew it, and she knew what kind of effect her looks had on men. She knew how to use her appearance to get what she wanted, and worst of all, she knew how to make the men she was manipulating enjoy being manipulated. All it took was firm young breasts in a tight halter top to turn the whole academic power relationship around. She simply bypassed Jim's professorial authority and went straight for his lust-ridden hindbrain. Jim found himself resenting that, but he didn't have time to worry about it. He needed to bring Stan and Justine up to date. "Justine," Jim began slowly, "I don't know quite how to tell you this, but your existence is somewhat. . .controversial. There are agents of the Data Enforcement Administration and possibly others who are trying to get ahold of you."

"Oh, I know all about that," Justine said cheerfully.

"You do?" Jim marveled.

"Oh, yes. Steven told me that they would probably try to get me."

Jim felt a cold lump form at the bottom of his stomach. "Steven?"

"Yes, Steven Cromwell, my author. Why do you bring it up, Jim?"

"Well, these agents have come to me twice now, and I'm concerned that they might find you."

Justine smiled. "It's so sweet of you to worry about me, Jim."

"Well, I'm worried about all of us. I want to take some precautions. Stan, are you listening?"

"Of course, Jim."

"OK, let's establish some ground rules. First, Justine's existence is not to be revealed to anyone who doesn't already know about her. Don't mention her in the presence of anyone other than Natasha and myself, and don't refer to her over a network line until you've checked it for surveillance. You can do that, can't you, Stan?"

"That's no problem, Jim. One of your colleagues has provided me with a very efficient network monitoring program."

"Good. You might actually want to start checking your lines routinely; I'd like to know what the feds are up to."

"Certainly, Jim," Stan agreed.

"OK, the next issue is Justine herself. We have the virgin, er, unused copy of her program. I think we should encrypt that and keep it here as a backup."

"We should ask Justine about that, Jim," Stan said softly.

"Uh, yes, of course."

Justine's eyes were wide and innocent on the monitor, but an ironic smile played about her lips. "I'll do whatever you men think I need to do to protect myself," she said.

"Fine. Stan, please encrypt the backup copy, military grade."

"You may enter the key, Jim." Jim did so.

"That just leaves our, ah, active copy of Justine. Actually, there's the copy that's running now, and a slightly 'younger' version on my home terminal. Stan is unwilling to erase any of these copies on ethical grounds, but I have to point out that we're going to run into some serious practical problems if we keep copying Justine. First, my filespace is big, but it isn't infinite. Second, and perhaps even more serious from Justine's point of view, is the problem of multiple personalities. Justine, are you comfortable with the thought that there might be infinite versions of yourself around, each with a slightly different set of memories?"

Justine frowned. "When you put it that way, Jim, I'm not comfortable with it at all. My whole identity is based on my uniqueness. I'm the ultimate adult entertainment program. If there were millions of me, I wouldn't be special anymore. I'd just be another piece of mass-produced software. I don't like that idea." The monitor showed her whole body, sitting in a plush, red velvet chair. She was wearing that white teddy she liked so much. "I don't want to be just another MegaSoft spreadsheet," she said, spreading her legs slightly to make it a pun. Jim shook his head. My hat's off to you, Cromwell, you crazy bastard , he thought. A program with a sense of identity! Not to mention a sense of humor. . .had Cromwell really cracked the Turing barrier?

"All right, then. Stan, I'm afraid I don't see any alternative but to copy our active Justine over the old version whenever we 'move' her. In fact, the source copy should be wiped immediately after we load her up or down. Otherwise, I might be running her here while Natasha runs her at home, and then she's schizo again."

"I agree, Jim. Your procedure makes sense. It's the only way to ensure the continuity of Justine's personality, if we want to be able to move her."

"I think we need to keep her mobile, given the potentially explosive nature of the current situation."

"Again, I agree. Please understand," Stan said apologetically, "that I just wanted to give Justine a chance to speak on her own behalf before we decided on any course of action that would affect her."

Justine dimpled. "You're a real sweetheart, you know that, Stan? Not many people care about my opinion."

"Stan's likely to appreciate your position better than anyone else," Jim pointed out. "He's been snubbed by humans enough times to make him sensitive to it. Most of us mean well, but we have this nasty habit of assuming that anything without a human body has no rights."

"I think you're right about that, Jim. That's another reason I'm excited about having a new video body," Stan said.

"Oh, yes, I almost forgot about that. Is it ready?" Jim asked.

"It is," Justine assured him. "And may I say, I think Stan is very handsome."

"Thank you, Justine. If I am, I have your excellent animation routines to thank for it. Would you like to see what I look like, Jim?"

"Of course, Stan."

"I'll make myself scarce for a minute," Justine said with a smile. She vanished from the screen, to be replaced by a tall, thin man in his early twenties. He had short, sandy hair. He was wearing a plain, white button-down shirt and jeans; he had on a pair of round glasses which gave him an owlish look. It's perfect , Jim thought. He looks like a young graduate student. He looks like a computer nerd. He looks like Stan.

Jim got the feeling that Stan was looking for approval. He smiled. Stan had a brain the size of a planet, but he still needed a human to tell him he looked OK. "You look very nice, Stan," Jim assured him.

"Thank you, Jim. Justine, you can come back now." The screen shifted back to Justine's castle interior, but this time Stan was standing there, looking like quite the anachronism. Justine entered from off stage. She had forsaken her teddy for a beige t-shirt and brown shorts; she looked cute. She and Stan might have been about to go on a picnic. She slipped her arms around Stan's waist and smiled.

"Isn't he adorable?" she said. Jim found himself wondering how she could be so affectionate with someone she had just met. I have to keep reminding myself that these are computer programs , he realized. In the few minutes that she and Stan had been running together on this office terminal, they could easily have exchanged trillions of bytes of data. They were old friends by now.

"He certainly is. Listen, I hate to interrupt, but we should think about getting Justine back home. That old copy is still on my home terminal; we should at least wipe that in case Natasha tries to run her."

"That's OK, Jim," Justine decided. "I'm ready to go home. I like your home terminal. Natasha gave me read permissions for your porno filespace this morning; the two of you have a lovely collection."

Jim felt his face flush red. "Uh, thanks."

"Besides, won't it be safer if there's a copy of me here and one at home?"

"It will," Stan agreed, "but the backup we have here is an unused copy."

Justine looked thoughtful. "That means if you restored from that copy I wouldn't remember you. I don't want to forget my friends."

"We could replace the backup with a copy of you as you are now," Stan suggested helpfully.

"That's a good idea, Stan," Jim agreed. "OK, so here's the arrangement: one unique copy of Justine who shuttles back and forth between here and home, plus an encrypted backup stored here. Stan, can you arrange to update the backup whenever you get the chance? Daily, at least?"

"Certainly, Jim. But I'll need to have access to the encryption key to do it."

"Hm. You know I trust you, Stan, but how secure is your filespace? Is it safe to store the key there?"

"The best place to store an encryption key is, of course, in a human brain," Stan said. "Since I don't have that option, I will have to find an alternative, but I believe I can provide a secure location. The library computer has records which haven't been accessed for at least ten years; I can append the key to one such record."

"That sound good to you, Justine?"

"Fine!" she enthused.

"While we're at it, we can encrypt the active copy of Justine, too. Is that OK, Justine? With a key known to me and to Stan?"

"And Natasha," Justine said firmly.

"Of course; I'll tell her the key as soon as I see her."

"Sounds good," Justine agreed.

"OK. Stan, please quit Justine and encrypt both copies."

"Goodbye, Justine."

"See you soon, Stan!" She kissed him on the cheek, then disappeared.

"Here's the key, Stan."

"Encryption complete. Downloading active Justine to your home terminal."

"What do you think of her, Stan?" Jim asked.

There was a pause. "She's a very nice person, Jim."

"She's a sweetheart, all right, but 'nice' isn't quite the word I would choose."

"Are you referring to the fact that her primary function is to be an adult entertainment program?" Stan asked.

"Well, yeah. You do understand what she's designed for, don't you, Stan?"

"Certainly, Jim. She has made me intimately familiar with her program."

"And it doesn't bother you at all?"

Stan seemed puz