Going to Hogwarts Open Finished

"Oh yeah," said Summer, nodding.

"My dad... thinks... that wizards might have created them. He'd tell you that it's almost certain that... the normal creatures came first, because... because there's so much fossil evidence of their evolution."

"Oh well, my dad's an Artificial Intelligence researcher, decision theorist, and writer, and my mum, she ah, she's a voice actress... a writer, and ah, she makes book trailers."

Her grandparents had taken her dad, Charles Hu, out of middle school because he was failing, as his natural work cycle didn't mesh with the schedule imposed on him by school. At age 16, he had learned about the concept of the Singularity, a hypothetical future event where AI becomes so advanced that it learns how to improve itself, and this leads to an infinite loop where the improved version is much better at improving itself, and the end result is supposed to be much smarter than any human. At that point, the AI would change human society forever, for better or worse.

Upon reading about this concept, Charles immediately decided this was what he was going to base his life around. However, when he learned about magic, he decided that was even more important.

"What do your parents do? I mean, do they do anything aside from farming... magical farming?"

"Well, that's pretty much it. We care for any creatures that need caring for. Including the more or less human ones." Miranda winced almost imperceptibly, as if remembering something painful. I'm being too obvious, she realized. I need to change the subject before I say too much. Mother and Father trusted me to keep the secret until I find someone I can actually trust. And I barely know Summer. Maybe one day.

"So your father wants to create AI?" she asked. "That's pretty cool. I have no idea how technology works, so I don't really understand too much, but I think I get the gist of it. It sounds kind of creepy, honestly, to think of machines being smarter than humans. On the other hand, though, I can see the appeal."

Miranda glanced out the train window, watching the rolling hills pass by like an endless wave. The sight reminded her of her home, but with less trees. I wish Cedar were here, she thought for what wasn't the first time. He'd know how to make all of this seem so much more exciting. I guess that's the only dark spot. He isn't here, and I wish he were. She sighed.

"Oh yeah," said Summer, "You don't really understand how scary it can be. Um, in fact, one of the... main... reasons my dad is in that field is because of this... this ah, thing called the paperclip maximizer. It's like a bad outcome of AI. So basically... if it... becomes smarter than humans, well, let's say that there's an a-AI created to make paperclips. If it becomes smarter than any human, it can figure out how to turn humans into paperclips, and then turn our whole planet into paperclips... and it won't have any reason not to, because it won't be motivated by things like love, or loyalty, or things like that."

"So, you know, my dad thinks it's really, really important to make sure... that the AI has our best interests in mind."

"...but, um, when my dad discovered that magic existed, he thought... that was much more important."

Summer also looked out the window. It was crazy to think that this was part of a path to a school for magic. It may seem repetitive that Summer had so many thoughts like this, but that was just part of having recently learned something that changes your entire worldview.

Miranda listened to her explanation, but was momentarily distracted by the idea of being transformed into a paperclip. Huh. "I see," she said slowly, still thinking about paperclips. "AI taking over the world does sound horrible."

She smiled again, but this time it was tinged with sadness. "Your father sounds much nicer than mine. My parents don't really care about anything my brother or I do until we get into trouble. Which, honestly, is quite often." Miranda remembered all of the crazy stunts Cedar had persuaded her to attempt. It was quite a long list. And although she didn't like the punishments, she would never pass down the chance for a good adventure. As long as it doesn't change your life forever, she murmured silently.

He always acts so sad once we're caught, and won't stop apologizing, Miranda continued thinking, trying to distract herself. And then I have to assure him that I wasn't just doing it for him, and that he should stop worrying, and no, we shouldn't try to sneak off again because they will chain us to our beds the next time. A broad smiled slowly spread across her face, and she turned slightly to look out the window, trying to mask the almost maniacal grin.

"I mean, there are also ways it could help us. I don't know what, you know, your... version of a perfect world would look like, but... but AI could also help bring that about."

Summer then said, "But in order to do that, um, we need to make sure it has the right programming, you know, it has the right goals written into it."

This was called AI alignment or the AI control problem. Introduced by Nick Bostrom, the main problem with it was that it was ridiculously complex. There were so many rules and variables you had to give the AI (because Summer's dad and Nick Bostrom's idea of an AI as intelligent as humans followed every command it was created with literally) in order for it to create any particular person's vision of a perfect world. It was like a genie which interpreted your wishes in ways you didn't want.

This was all theoretical, of course. The world was still a long way from creating this sort of AI.

The conversation topic shifted, and she said, "I'm sorry to hear that about your parents."

Miranda was right; her parents were pretty nice. Her dad was laid-back, smart, and sarcastic. Her mum was cheerful, kind of crazy, and affectionate. Both of them loved Summer fiercely.

"It's fine," Miranda replied. "I'm used to it by now. And besides, I have my brother to play with. And my books. And, I guess, some of the animals. The friendly ones, anyways." She sighed, and her gaze wandered towards the compartment door, then back again. "I stay far away from the more dangerous ones now." There was something about the way she said those words that made your think she was implying something more. Especially the emphasize on the 'now'.

I wonder what life would be like if Father actually paid attention to me, she mused. Although, then maybe Cedar and I wouldn't be as close. I guess there are good and bad reasons for everything, even that. She'd thought about that before, even made a pros and cons list about whether it would be better if she had nice parents, or if they stayed the way they were. It was quite lengthy, as you can imagine. In fact, she made similar lists for any kind of controversy she encountered. It was almost like her version of a to-do list. Almost.

"So I guess you're looking forwards to Transfiguration the most?" she asked Summer. "because I'm pretty sure that one has the most science included in it. You know, physics and all that."

"Honestly, I don't know. I guess transfiguration might be... the most useful in the long term... but that class that's about protecting against the Dark Arts sounds really cool."

If there was no specific "scientist" type of job in the Wizarding World, maybe she could become the transfiguration teacher at Hogwarts one day. That would probably be the the job, other than scientist, which offered her the most opportunity to learn the nature of magic. Either that or Magical Theory teacher. (She had a book for that, so she assumed it was a class.)

If her plans worked out, she might eventually learn what the source of magic was (on the physical level - there had to be a reason people could defy physics at will). Learning that might unlock the secret to omnipotence, and with that, the ability to solve all of the world's problems. At least, those were her father's thoughts.

Were these really Summer's plans? Had her father been leading her into this against her will? Well, Summer figured that everyone was influenced by the ideas of their parents, and she agreed with her father that this did seem particularly important. But sometimes she did dread failing and disappointing her father. Even if she knew he didn't want her to feel that way.

"Yeah, Defense Against the Dark Arts is probably my favorite first year class. You know, since we can't take Care for Magical Creatures until our third year." Miranda shrugged. "Both of them incorporate magical beasts at least a little bit. Some of them are dark, though, but they're still animals, and that's what counts." She paused for a moment, as if deciding whether to continue.

"It would also be useful to know how to drive off dark creatures before they can hurt you, or any other innocents," Miranda finally continued. "At least, that's what I think."

She hoped Summer agreed, or at least wasn't opposed to her ideal. Otherwise things would start getting very awkward very fast, and Miranda wasn't sure if she was up to that.

Cedar would agree with me, she thought with a pang of sadness for her brother. Of course he would. Her mind shied away from the way she wanted to finish that thought. Best not to think about that. You managed at home. You can do it here, as long as you...just distract yourself enough.

Miranda glanced up at the window, watching as a bird almost careened into the glass pane, before flapping off again in another direction.

"Oh yeah, yeah, completely!" Summer said nodding. "It's important to be able to protect, er, people."

"Care of magical creatures sounds pretty cool too! I like animals."

"Hey... you're talking about these things like it's so normal, you know like, magical creatures like centaurs and stuff. But do you realize how completely mad this sounds to a muggle? 99% of muggles would not believe what I've been learning so far, if you told it to them. I mean, I realize this is something you probably know, but I mean, I don't think it's possible to have a true perspective on it unless you have the experience. Plus, I... you were just talking about it like it was normal and it, and it was weird to me. I guess all of them would, you know, other wizards and witches and..." Summer trailed off.

"I mean, I was raised to believe... that we might all get turned into paperclips. I'm just saying, I guess I already had beliefs I knew other people would reject, but this is a whole 'nother order of magnitude... Come to think of it, being turned into paperclips in the future... sounds like something most wizards wouldn't believe, am I right? I mean, without magic. Being turned into paperclips without magic."

"Come to think of it, being turned into paperclips in the future... sounds like something most wizards wouldn't believe, am I right? I mean, without magic. Being turned into paperclips without magic," Summer said, and Miranda couldn't help laughing.

"You're right," she replied. "Being turned into paperclips is not exactly something most wizards or witches thing a muggle-made machine can do to us. Of course, there may be one or two who have nightmares about that. You know, being permanently transformed into small bent-up wire tools." Miranda chuckled slightly. "I can't say I'm a part of those few, but that may change in the future, as muggle tech continues to evolve." She smiled, mostly joking. Although, a small part of her worried over whether such a thing might actually ever come to pass.

"Sorry, I just find that funny. I've been raised to think that all problems are solvable. And, no offense, that most muggles are far behind when it comes to science and all that." She realized after she said that that Summer probably would take offense. I shouldn't have said anything, she mentally berated herself. Now she'll probably hate me. Or at least think I' prejudiced toward muggles. Which I most certainly am NOT.

Miranda shot Summer a tentative look, trying to decide whether her expression was one of annoyance, hatred or disgust, but she couldn't tell. The only face she could read was her brother, and that wasn't exactly a difficult feat, with his basic range of emotions and vivid facial expressions. She'd always used to call him her "open book" as a joke.