1 00:00:58,623 --> 00:01:03,063 Hey Siri, send a message to Cheryl. 2 00:01:03,106 --> 00:01:03,933 Front reception. 3 00:01:06,327 --> 00:01:07,023 What do you want to say? 4 00:01:08,938 --> 00:01:11,680 Amos is already heading there to pick him up, period. 5 00:01:11,723 --> 00:01:13,856 Please forward any calls I get to Brady, period. 6 00:01:15,118 --> 00:01:16,902 Your message to Cheryl front reception 7 00:01:16,946 --> 00:01:19,253 says Amos is already heading there to pick him up. 8 00:01:19,296 --> 00:01:20,906 Please forward any calls I get to Brady. 9 00:01:21,516 --> 00:01:22,299 Ready to send it? 10 00:01:22,778 --> 00:01:23,561 Yes. 11 00:01:24,910 --> 00:01:26,086 Okay, it's sent. 12 00:01:27,957 --> 00:01:28,827 Hey, Siri, 13 00:01:31,178 --> 00:01:33,005 how do you know if you're doing the right thing? 14 00:01:35,182 --> 00:01:36,357 I'm not sure I understand. 15 00:01:40,535 --> 00:01:41,666 But what do you believe 16 00:01:41,710 --> 00:01:43,407 is the difference between right and wrong? 17 00:01:45,540 --> 00:01:46,758 Hmm. 18 00:01:46,802 --> 00:01:48,108 I don't have an answer for that. 19 00:01:48,630 --> 00:01:49,979 Would you like me to search the web? 20 00:01:51,023 --> 00:01:51,763 No. 21 00:01:53,243 --> 00:01:55,289 Okay, is there something else I can help with? 22 00:02:04,863 --> 00:02:06,430 Set a reminder to pick up Kyle 23 00:02:06,474 --> 00:02:08,650 from therapy tomorrow at 4:45. 24 00:02:10,608 --> 00:02:12,132 Okay, I'll remind you. 25 00:02:34,023 --> 00:02:36,330 Hi, special agent Deena Helms. 26 00:02:36,373 --> 00:02:37,418 You've already met Agent McCullough. 27 00:02:37,461 --> 00:02:38,854 You can call me Amos. 28 00:02:38,897 --> 00:02:41,639 -Uh, agents? -Have a seat for us, Gareth. 29 00:02:44,338 --> 00:02:45,774 Do you mind answering a couple questions? 30 00:02:47,341 --> 00:02:49,430 Great, this shouldn't take long. 31 00:02:51,388 --> 00:02:53,564 You're from Tampa, right? 32 00:02:56,176 --> 00:02:57,568 Don't overthink it. It's a yes or no. 33 00:02:59,004 --> 00:03:00,223 Yeah. 34 00:03:00,267 --> 00:03:01,616 How old are you, Gareth? 35 00:03:01,659 --> 00:03:02,530 29. 36 00:03:02,573 --> 00:03:04,184 What do you do for work? 37 00:03:04,227 --> 00:03:05,533 I'm sorry, am I being detained? 38 00:03:05,576 --> 00:03:06,838 No, not at all. 39 00:03:06,882 --> 00:03:08,753 We're just asking questions, background stuff. 40 00:03:09,972 --> 00:03:11,147 You work on movies, right? 41 00:03:12,061 --> 00:03:12,888 Special effects. 42 00:03:14,324 --> 00:03:15,630 Someone told me you worked 43 00:03:15,673 --> 00:03:17,153 on that new "Star Wars" movie, is that right? 44 00:03:17,197 --> 00:03:18,459 Who told you that? 45 00:03:18,502 --> 00:03:20,287 Why don't you tell us more about it? 46 00:03:20,330 --> 00:03:21,288 Tell us about your work. 47 00:03:23,855 --> 00:03:25,770 I used to do VFX for an animation company. 48 00:03:25,814 --> 00:03:26,858 I've worked on at least 20 different films. 49 00:03:26,902 --> 00:03:28,164 Used to? 50 00:03:28,208 --> 00:03:29,470 I've been focusing more 51 00:03:29,513 --> 00:03:30,688 on software engineering recently for years- 52 00:03:30,732 --> 00:03:32,386 Sounds boring compared to light sabers. 53 00:03:32,429 --> 00:03:33,648 Why quit? 54 00:03:33,691 --> 00:03:34,779 I wasn't getting paid well. 55 00:03:34,823 --> 00:03:36,085 But money's not an issue for you. 56 00:03:36,128 --> 00:03:37,304 Excuse me? 57 00:03:37,347 --> 00:03:38,218 What kind of effects did you do? 58 00:03:38,261 --> 00:03:39,610 Money's not an issue for me? 59 00:03:39,654 --> 00:03:40,829 -Let's talk about- -If money wasn't an issue for me 60 00:03:40,872 --> 00:03:41,917 I wouldn't have applied for your grant. 61 00:03:41,960 --> 00:03:42,613 I didn't mean to suggest anything. 62 00:03:43,962 --> 00:03:45,225 Tell us what kind of effects you did. 63 00:03:48,576 --> 00:03:50,142 My main focus was on 3D renderings. 64 00:03:50,186 --> 00:03:51,274 Of what? 65 00:03:51,318 --> 00:03:52,275 -Actors. -What for? 66 00:03:53,058 --> 00:03:54,321 Well, for "Star Wars," 67 00:03:54,364 --> 00:03:55,844 it was because the actor I was tasked to digitize 68 00:03:55,887 --> 00:03:57,280 was unavailable to be filmed in person. 69 00:03:58,020 --> 00:03:58,542 Why? 70 00:04:00,065 --> 00:04:00,892 Because they were dead. 71 00:04:02,894 --> 00:04:03,765 What'd they have you do? 72 00:04:05,941 --> 00:04:08,117 I reconstructed Alec Guinness' face as a 3D model. 73 00:04:08,160 --> 00:04:09,727 I analyzed reference footage, 74 00:04:09,771 --> 00:04:11,599 then used a process called D-Term to procedurally generate 75 00:04:11,642 --> 00:04:12,861 his bone and muscle structures, 76 00:04:12,904 --> 00:04:14,254 which one rigged helped the animation feel 77 00:04:14,297 --> 00:04:15,559 more natural and human-like. 78 00:04:15,603 --> 00:04:17,779 D-Term, I've never heard of that process before. 79 00:04:17,822 --> 00:04:18,910 Because I invented it. 80 00:04:19,259 --> 00:04:20,172 So you're basically bringing 81 00:04:20,216 --> 00:04:21,478 dead actors back to life? 82 00:04:21,522 --> 00:04:22,958 I just tried to make the CG characters look as 83 00:04:23,001 --> 00:04:24,612 photorealistic as the technology at the time would allow. 84 00:04:24,655 --> 00:04:25,526 You didn't find it creepy? 85 00:04:26,570 --> 00:04:27,354 I'm sorry, what? 86 00:04:28,398 --> 00:04:29,356 I said you don't find that creepy? 87 00:04:32,010 --> 00:04:34,404 Well, we did our best to cross the uncanny valley. 88 00:04:34,448 --> 00:04:36,014 But when the human brain perceives 89 00:04:36,058 --> 00:04:37,277 that something is just slightly off and it doesn't matter- 90 00:04:37,320 --> 00:04:38,321 No, I mean, digitizing dead people. 91 00:04:38,365 --> 00:04:39,496 Christ, I mean, it's, 92 00:04:39,540 --> 00:04:40,889 it's almost like turning someone's corpse 93 00:04:40,932 --> 00:04:42,064 into a marionette, you know? 94 00:04:42,107 --> 00:04:43,283 Making them do whatever you want. 95 00:04:43,892 --> 00:04:45,110 What if the poor dead guy 96 00:04:45,154 --> 00:04:46,590 didn't want to be in another fucking movie? 97 00:04:47,417 --> 00:04:48,244 It's so macabre. 98 00:04:48,810 --> 00:04:49,898 Am I crazy? Is it not macabre? 99 00:04:49,941 --> 00:04:51,029 I don't think the studio cares 100 00:04:51,073 --> 00:04:52,204 whether it's macabre or not. 101 00:04:52,248 --> 00:04:53,423 Look, I can never tell the difference. 102 00:04:53,467 --> 00:04:54,990 I always can. The faces look like Play-Doh. 103 00:04:55,033 --> 00:04:56,165 Well, we did our best. 104 00:04:56,208 --> 00:04:57,340 Soon we won't even need actors,right? 105 00:04:57,384 --> 00:04:58,689 Everyone will just be digital. 106 00:04:58,733 --> 00:05:00,387 No, you still need them for motion tracking. 107 00:05:00,430 --> 00:05:02,432 Human performances can't be completely computer generated. 108 00:05:02,476 --> 00:05:03,520 How long will that be true? 109 00:05:07,698 --> 00:05:09,570 Some might say we've already crossed that threshold. 110 00:05:11,398 --> 00:05:12,312 I wouldn't know. 111 00:05:15,402 --> 00:05:16,620 Where'd you go to school? 112 00:05:16,664 --> 00:05:18,274 -Brooks-DeBartolo High. -And after? 113 00:05:20,145 --> 00:05:21,408 Nothing? 114 00:05:21,451 --> 00:05:22,322 What about Columbia? 115 00:05:22,365 --> 00:05:23,279 Didn't you go to Columbia? 116 00:05:25,629 --> 00:05:27,109 Wait, no. You dropped out of Columbia 117 00:05:27,152 --> 00:05:29,416 after how many semesters? 118 00:05:29,981 --> 00:05:30,765 Three? 119 00:05:33,071 --> 00:05:35,944 Bjarne Stroustrup said 120 00:05:35,987 --> 00:05:37,162 you were the smartest kid he ever met. 121 00:05:38,686 --> 00:05:41,384 I don't know who he is, but Amos says it's a big deal. 122 00:05:42,690 --> 00:05:43,734 Then you moved to the Netherlands, 123 00:05:44,518 --> 00:05:46,041 spent some time as an intern, 124 00:05:46,781 --> 00:05:47,999 applied and got into Cambridge. 125 00:05:48,739 --> 00:05:50,001 Very nice. 126 00:05:50,045 --> 00:05:51,307 Except that you dropped out after two years. 127 00:05:52,395 --> 00:05:53,570 Flew back to the States, 128 00:05:53,614 --> 00:05:56,007 interned in Palo Alto, then Montreal. 129 00:05:56,356 --> 00:05:57,618 Then went all the way back to England, 130 00:05:57,661 --> 00:05:59,141 where you landed a job in Sheffield. 131 00:05:59,184 --> 00:06:00,882 Second job in Manchester. 132 00:06:01,448 --> 00:06:04,146 Then got into Oxford where you almost finished your masters 133 00:06:04,189 --> 00:06:05,408 before ditching the graduation 134 00:06:05,452 --> 00:06:06,931 and moving back here to Florida. 135 00:06:11,632 --> 00:06:12,763 If money was an issue, 136 00:06:14,635 --> 00:06:16,376 I'm glad you had plenty of flyer miles. 137 00:06:18,465 --> 00:06:19,640 I didn't hear a question. 138 00:06:20,815 --> 00:06:21,598 What's your social life like? 139 00:06:22,817 --> 00:06:24,601 My, what does that have anything to do- 140 00:06:24,645 --> 00:06:26,081 If you don't want to talk about it, that's fine. 141 00:06:26,124 --> 00:06:27,387 We just wanted to know if you have friends and stuff. 142 00:06:27,430 --> 00:06:28,997 -I have friends. -A lot of them? 143 00:06:29,040 --> 00:06:30,259 -I have friends. -Can you name one? 144 00:06:30,302 --> 00:06:31,434 -Can I what? -Can you tell us the nam 145 00:06:31,478 --> 00:06:32,566 of just one of your friends? 146 00:06:33,523 --> 00:06:35,612 -Steve. -Steve. Steve what? 147 00:06:35,656 --> 00:06:36,961 I don't know how this is relevant to receiving the grant. 148 00:06:37,005 --> 00:06:38,354 Oh, we're just getting to know you, Gareth. 149 00:06:39,399 --> 00:06:40,312 You got a girlfriend? 150 00:06:40,922 --> 00:06:41,749 Boyfriend? 151 00:06:42,489 --> 00:06:44,273 You, uh, talk to people online? 152 00:06:44,316 --> 00:06:45,405 I don't know what you mean by that. 153 00:06:45,448 --> 00:06:46,710 I don't use social media. 154 00:06:46,754 --> 00:06:47,842 I mean more like chat rooms. 155 00:06:52,716 --> 00:06:54,022 You go on any chat rooms? 156 00:06:58,896 --> 00:07:00,245 No one uses chat rooms anymore. 157 00:07:00,985 --> 00:07:01,638 Sure they do. 158 00:07:03,771 --> 00:07:04,772 You chat with anyone online? 159 00:07:07,514 --> 00:07:08,689 -Sometimes. -Sometimes. 160 00:07:10,212 --> 00:07:11,953 What kinds of people do you talk to online? 161 00:07:14,085 --> 00:07:18,176 Gareth, obviously, this isn't about a grant. 162 00:07:19,395 --> 00:07:20,570 We need to know what your alias is. 163 00:07:22,137 --> 00:07:24,052 When you go online, what name do you use? 164 00:07:24,095 --> 00:07:25,314 I don't have one. 165 00:07:25,357 --> 00:07:26,141 Yes, you do. 166 00:07:27,185 --> 00:07:27,969 And you need to tell us what it is. 167 00:07:33,801 --> 00:07:34,889 Sorry, I can't help you. 168 00:07:45,813 --> 00:07:46,857 You know who we are? 169 00:07:48,946 --> 00:07:50,600 Well, this is the ICWL building. 170 00:07:50,644 --> 00:07:52,036 That's right. You know what we do? 171 00:07:53,429 --> 00:07:54,561 Humanitarian work. 172 00:07:54,604 --> 00:07:55,779 That's what the people upstairs do. 173 00:07:56,127 --> 00:07:57,389 You know what we do? 174 00:08:02,307 --> 00:08:03,744 We catch pedophiles. 175 00:08:06,007 --> 00:08:09,358 Amos here specializes in tracking down online predators. 176 00:08:09,401 --> 00:08:11,360 He spends every waking hour 177 00:08:11,403 --> 00:08:14,015 scouring those chat rooms you say no one uses 178 00:08:14,058 --> 00:08:16,670 and he finds thousands of people soliciting children. 179 00:08:17,758 --> 00:08:20,500 Our operation is like a tightly spun spider web 180 00:08:20,848 --> 00:08:23,633 connecting ICWL, the FBI, NSA, 181 00:08:23,677 --> 00:08:26,288 and let me tell you, his team here is a vital thread. 182 00:08:27,289 --> 00:08:30,031 He reports everything he gathers directly to me, 183 00:08:30,074 --> 00:08:32,207 and I see to it that the necessary authorities 184 00:08:32,250 --> 00:08:33,382 take swift action. 185 00:08:33,774 --> 00:08:34,818 So are you in charge? 186 00:08:35,340 --> 00:08:36,864 This is my spiderweb. 187 00:08:38,605 --> 00:08:40,432 I'm the fucking spider, Gareth. 188 00:08:44,349 --> 00:08:46,961 Am I being detained? 189 00:08:47,831 --> 00:08:48,963 We already told you that you're not detained. 190 00:08:49,398 --> 00:08:50,834 Good. 191 00:08:52,053 --> 00:08:54,055 But if you leave this room, you will be arrested. 192 00:09:00,452 --> 00:09:01,410 For what? 193 00:09:04,065 --> 00:09:04,979 I told you what we do. 194 00:09:05,632 --> 00:09:06,546 Take a wild guess. 195 00:09:08,635 --> 00:09:10,158 I am not what you think I am. 196 00:09:10,419 --> 00:09:11,202 We'll see. 197 00:09:13,857 --> 00:09:15,555 Gareth, you just gotta tell us your alias. 198 00:09:16,599 --> 00:09:18,209 What's your username? 199 00:09:22,605 --> 00:09:23,388 Sit down. 200 00:09:39,709 --> 00:09:41,189 -Why do you do this with them? -Hmm? 201 00:09:41,232 --> 00:09:42,843 There's no way you do this with every suspect you have. 202 00:09:43,321 --> 00:09:44,453 Invite them to your headquarters 203 00:09:44,496 --> 00:09:45,585 and then drag them down into a basement. 204 00:09:46,020 --> 00:09:46,586 That's right. 205 00:09:47,674 --> 00:09:49,066 Why are you doing this to me then? 206 00:09:51,199 --> 00:09:52,592 You tell us, Gare. 207 00:09:52,635 --> 00:09:53,984 What makes you so fuckin' special? 208 00:09:56,552 --> 00:09:57,422 I don't know. 209 00:09:59,163 --> 00:10:00,730 What's your alias? 210 00:10:00,774 --> 00:10:03,603 -I don't have an alias. -Yes you do. 211 00:10:05,343 --> 00:10:06,518 It starts with the word hard. 212 00:10:08,172 --> 00:10:09,347 Just finish the rest. 213 00:10:11,698 --> 00:10:12,916 Sit down, Mr. Federson. 214 00:10:12,960 --> 00:10:14,483 I only have a few more questions. 215 00:10:27,278 --> 00:10:28,802 Do you recognize this girl? 216 00:10:37,680 --> 00:10:41,336 Do you know her? 217 00:10:44,295 --> 00:10:45,166 Yes. 218 00:10:45,209 --> 00:10:46,080 What's her name? 219 00:10:47,081 --> 00:10:48,560 Cherry. 220 00:10:48,604 --> 00:10:50,258 -Cherry what? -She doesn't have a last name. 221 00:10:50,301 --> 00:10:51,781 Yes, she does, Gareth, she's not Madonna. 222 00:10:51,825 --> 00:10:53,304 -She's a little girl. -You don't understand. 223 00:10:53,348 --> 00:10:54,436 Yeah, well, I'd like to. 224 00:10:54,479 --> 00:10:55,524 So help me out, is she your daughter? 225 00:10:55,567 --> 00:10:57,439 -No. -Then whose daughter is she? 226 00:10:57,482 --> 00:10:58,527 -She, she doesn't have-- -How did you meet her? 227 00:10:58,570 --> 00:10:59,963 I didn't meet her. 228 00:11:00,007 --> 00:11:01,661 Then why do you have photos of her on your computer? 229 00:11:01,704 --> 00:11:02,618 What the hell are you talking about? 230 00:11:02,662 --> 00:11:04,402 Why do you fucking have photos 231 00:11:04,446 --> 00:11:05,708 of this girl on your fucking- 232 00:11:05,752 --> 00:11:06,840 Are you looking at my hard drive? 233 00:11:06,883 --> 00:11:08,102 Because that's an invasion of privacy. 234 00:11:08,145 --> 00:11:09,407 So you know what photos I'm talking about? 235 00:11:09,451 --> 00:11:10,321 You don't have to do it this way. 236 00:11:10,365 --> 00:11:11,583 I gave you permission to sit in. 237 00:11:11,627 --> 00:11:13,629 I did not give you permission to speak. 238 00:11:13,673 --> 00:11:14,761 This is insane, you cannot keep- 239 00:11:14,804 --> 00:11:16,023 What else have you done with her? 240 00:11:16,066 --> 00:11:17,372 -Nothing! -Did you take the photos? 241 00:11:17,415 --> 00:11:18,286 It's, it's complicated. 242 00:11:18,329 --> 00:11:19,766 No, it's not! Yes or no? 243 00:11:19,809 --> 00:11:20,854 Did you take the photos? 244 00:11:20,897 --> 00:11:22,725 I didn't do anything wrong, okay? 245 00:11:22,769 --> 00:11:25,772 Soliciting pornography of minors is an egregious felony. 246 00:11:25,815 --> 00:11:28,731 Distributing that pornography is tenfold worse. 247 00:11:28,775 --> 00:11:30,646 -I didn't do anything! -Fucking prove it! 248 00:11:31,125 --> 00:11:33,562 What is your alias? 249 00:11:34,606 --> 00:11:35,912 Answer me! 250 00:11:35,956 --> 00:11:37,609 HardMachine11811. 251 00:11:56,106 --> 00:11:57,238 You're HardMachine. 252 00:11:59,414 --> 00:12:00,632 Thanks for confirming. 253 00:12:03,287 --> 00:12:05,768 If you knew, then why do this to me? 254 00:12:05,812 --> 00:12:07,074 We weren't positive, 255 00:12:07,117 --> 00:12:08,423 and if you turned out to not be HardMachine, 256 00:12:08,466 --> 00:12:09,729 you were obviously just a predator. 257 00:12:15,082 --> 00:12:16,126 Do you keep track? 258 00:12:17,998 --> 00:12:20,565 I mean, do you know how many bad people you've nailed? 259 00:12:21,175 --> 00:12:23,046 I didn't start counting until 2023. 260 00:12:23,090 --> 00:12:25,527 196 convictions. 261 00:12:25,570 --> 00:12:26,833 There were at least 30 262 00:12:26,876 --> 00:12:27,747 before I started sending everything to you guys. 263 00:12:28,486 --> 00:12:29,400 What'd you do before? 264 00:12:29,836 --> 00:12:30,924 I turned over 265 00:12:30,967 --> 00:12:31,925 all evidence directly to the police. 266 00:12:31,968 --> 00:12:32,795 Why'd you stop? 267 00:12:33,187 --> 00:12:34,014 They were unreliable. 268 00:12:35,319 --> 00:12:36,668 -I doubt that. -More than half of the predators 269 00:12:36,712 --> 00:12:38,018 I identified went un-investigated. 270 00:12:38,061 --> 00:12:39,671 Yeah, well, you were sketchy and faceless. 271 00:12:39,715 --> 00:12:41,021 They had every right to be skeptical. 272 00:12:41,935 --> 00:12:43,414 It would've all been for nothing 273 00:12:43,458 --> 00:12:44,894 if they found out you were using a little girl as bait. 274 00:12:44,938 --> 00:12:46,113 It's not that simple, okay? 275 00:12:46,156 --> 00:12:48,768 I can only do what I do with anonymity. 276 00:12:48,811 --> 00:12:50,770 Here's my problem, Gareth, and don't get me wrong. 277 00:12:50,813 --> 00:12:52,510 I think 200 terrible people behind bars 278 00:12:52,554 --> 00:12:54,643 is a very good thing, but not at her expense. 279 00:12:55,557 --> 00:12:57,037 Look, we think we can help you, 280 00:12:57,733 --> 00:12:59,169 but we need to help her too. 281 00:12:59,213 --> 00:13:02,477 Using your daughter to entrap these people 282 00:13:02,520 --> 00:13:03,608 is a means that does not justify the ends. 283 00:13:03,652 --> 00:13:05,001 She's not my daughter. 284 00:13:05,045 --> 00:13:06,394 And in spite of what you may think you've achieved, 285 00:13:06,437 --> 00:13:07,569 I still have no reservation with locking you up. 286 00:13:07,612 --> 00:13:08,526 You took the photos. 287 00:13:09,005 --> 00:13:09,876 I don't care why. 288 00:13:10,224 --> 00:13:11,268 You don't understand. 289 00:13:12,008 --> 00:13:13,096 Who is she? 290 00:13:13,140 --> 00:13:14,794 You're gonna ruin everything. 291 00:13:14,837 --> 00:13:17,535 She's a child, Gareth, look at me. 292 00:13:19,320 --> 00:13:22,802 I don't give a damn what fucked up anti-hero master plan 293 00:13:22,845 --> 00:13:23,759 of yours I might jeopardize. 294 00:13:24,368 --> 00:13:25,979 I won't let her be exploited. 295 00:13:26,022 --> 00:13:27,763 Not even for the sake of locking up more perverts. 296 00:13:29,286 --> 00:13:31,375 I'm asking you politely to let this one go. 297 00:13:32,333 --> 00:13:33,551 Are you fucking slow? 298 00:13:33,900 --> 00:13:35,031 Have you been listening at all? 299 00:13:35,075 --> 00:13:37,599 My anonymity is my most important asset. 300 00:13:37,642 --> 00:13:39,253 Without that, I can't do what I do. 301 00:13:39,296 --> 00:13:40,863 Well, that makes everything easy then. 302 00:13:42,386 --> 00:13:44,606 You tell us where she is, or we leak everything. 303 00:13:44,649 --> 00:13:46,129 -Your name, your aliases. -Deena! 304 00:13:46,173 --> 00:13:48,218 Every single perp you helped us catch. 305 00:13:48,262 --> 00:13:50,133 I'm sure they'll be very pleased to meet you in jail. 306 00:13:50,177 --> 00:13:51,352 Stop! 307 00:13:51,395 --> 00:13:52,092 Okay. 308 00:13:55,835 --> 00:13:56,836 Look, if I tell you about Cherry, okay, 309 00:13:58,054 --> 00:13:59,055 there's some things I'm gonna need first. 310 00:14:00,622 --> 00:14:02,189 It doesn't really work like that, Gareth, but go ahead. 311 00:14:02,232 --> 00:14:03,799 Give us your wishlist. 312 00:14:03,843 --> 00:14:05,322 I need a signed non-disclosure agreement from both of you. 313 00:14:05,366 --> 00:14:06,628 -Not gonna happen. -And then I need you to swear 314 00:14:06,671 --> 00:14:07,803 that the information I'm about to relay 315 00:14:07,847 --> 00:14:08,760 won't leave this room. 316 00:14:09,196 --> 00:14:10,545 Look, if you tell us anything 317 00:14:10,588 --> 00:14:11,720 that could help us locate Cherry, 318 00:14:11,763 --> 00:14:13,591 you know we can't keep that promise. 319 00:14:15,332 --> 00:14:16,899 Okay, if I tell you anything 320 00:14:16,943 --> 00:14:19,510 that potentially helps you find a missing child, 321 00:14:19,771 --> 00:14:20,772 okay, you can feel free to share that. 322 00:14:20,816 --> 00:14:22,035 But I need you to swear 323 00:14:22,078 --> 00:14:24,472 that any other details about myself or Cherry, 324 00:14:25,952 --> 00:14:27,127 have to stay between the three of us. 325 00:14:29,390 --> 00:14:30,173 Is that it? 326 00:14:32,697 --> 00:14:33,742 And I need that camera switched off. 327 00:14:35,918 --> 00:14:36,963 I don't know how to do that. 328 00:14:37,006 --> 00:14:38,573 Go to the head of securities office, 329 00:14:38,616 --> 00:14:39,922 ask him to find this camera in the system and disable it. 330 00:14:40,836 --> 00:14:41,924 I don't think he's allowed to do that. 331 00:14:43,447 --> 00:14:44,622 I thought you were the fucking spider? 332 00:14:49,192 --> 00:14:50,585 Give me a reason, Gareth. 333 00:14:50,628 --> 00:14:51,760 Why should I go through all the trouble 334 00:14:51,803 --> 00:14:52,935 of getting that camera turned off? 335 00:14:54,850 --> 00:14:56,808 Because if anybody finds out what I'm about to tell you, 336 00:14:58,723 --> 00:15:00,551 a thousand more children are gonna get abused. 337 00:15:04,599 --> 00:15:05,382 Give me a minute. 338 00:15:21,007 --> 00:15:26,403 So, uh, you and Cherry hunted all those people together? 339 00:15:34,020 --> 00:15:36,979 This one time I spent six weeks undercover trying 340 00:15:37,023 --> 00:15:39,199 to nail down a single trafficker from the Philippines. 341 00:15:41,070 --> 00:15:42,506 Day after day, 342 00:15:42,550 --> 00:15:45,683 I spent hour after hour following his trail online. 343 00:15:45,727 --> 00:15:47,163 And he must have been 344 00:15:47,207 --> 00:15:48,948 one of the hardest targets I ever had to track down. 345 00:15:52,038 --> 00:15:56,607 Then one day I found him and one of Cherry's live streams. 346 00:15:57,260 --> 00:15:59,088 I mean, she went by a different name in the stream, 347 00:15:59,132 --> 00:16:00,655 but it was her. 348 00:16:02,048 --> 00:16:03,179 The trafficker, 349 00:16:03,223 --> 00:16:04,528 along with three of our other targets 350 00:16:04,572 --> 00:16:06,574 were all in the room together. 351 00:16:06,617 --> 00:16:12,101 All of them just carelessly sharing their information. 352 00:16:13,798 --> 00:16:18,542 I mean, and they were so open 'cause she was a real girl. 353 00:16:18,847 --> 00:16:20,501 I mean, she could physically 354 00:16:20,544 --> 00:16:22,720 and verbally respond to them in real time. 355 00:16:26,159 --> 00:16:32,034 A couple days later, HardMachine11811 sends ICWL 356 00:16:32,078 --> 00:16:33,905 another batch of names and evidence, 357 00:16:33,949 --> 00:16:36,996 including the three targets that were in the room. 358 00:16:39,041 --> 00:16:42,001 You know, I almost thought the girl was HardMachine 359 00:16:42,697 --> 00:16:44,351 and that this nine year old 360 00:16:44,394 --> 00:16:47,702 just happened to be some badass online vigilante. 361 00:16:50,183 --> 00:16:51,314 What changed your mind? 362 00:16:54,970 --> 00:16:56,363 11811. 363 00:16:57,755 --> 00:17:00,323 January 18th, 2011. 364 00:17:01,324 --> 00:17:05,154 Most of my team thought it was, uh, some arbitrary number, 365 00:17:06,677 --> 00:17:10,116 but I remember what happened on that day in Clearwater. 366 00:17:13,162 --> 00:17:15,034 You were one of the Clearwater kids, weren't you? 367 00:17:16,774 --> 00:17:19,777 You know, my father was a part of that raid. 368 00:17:22,476 --> 00:17:23,520 It's off, see? 369 00:17:23,564 --> 00:17:24,217 No red light. 370 00:17:25,087 --> 00:17:26,175 Non-disclosure agreements? 371 00:17:26,219 --> 00:17:27,611 We're not playing this game, Gareth. 372 00:17:27,655 --> 00:17:29,048 You're just gonna have to suck it up and trust us. 373 00:17:33,661 --> 00:17:35,228 You can trust us. 374 00:17:38,231 --> 00:17:39,667 I've been told I have trust issues. 375 00:17:39,928 --> 00:17:41,756 Well, there's only one way to fix that. 376 00:17:50,591 --> 00:17:52,332 The reason you can't find Cherry, 377 00:17:53,333 --> 00:17:56,249 the reason why she doesn't have a last name or parents, 378 00:17:56,510 --> 00:18:01,210 or a social security number is because she's not real. 379 00:18:03,343 --> 00:18:04,605 She's not a real human being. 380 00:18:08,783 --> 00:18:09,784 Tell us what happened. 381 00:18:14,223 --> 00:18:15,616 While I was studying abroad, 382 00:18:15,877 --> 00:18:17,661 I interned at a small Dutch animation studio 383 00:18:18,532 --> 00:18:19,968 a few years before they collaborated 384 00:18:20,011 --> 00:18:21,535 with a local nonprofit on a similar idea. 385 00:18:22,405 --> 00:18:23,102 Which was? 386 00:18:24,451 --> 00:18:26,148 The idea was to build a 3D model 387 00:18:26,192 --> 00:18:27,497 of an 11 year old Filipino girl 388 00:18:28,019 --> 00:18:30,500 and use her covertly to identify online predators, 389 00:18:30,935 --> 00:18:32,981 A technological solution to a technological problem. 390 00:18:33,895 --> 00:18:35,679 But the project was suspended after only a few months. 391 00:18:35,723 --> 00:18:36,854 Yeah, I remember. 392 00:18:36,898 --> 00:18:38,029 I remember hearing about that program. 393 00:18:38,639 --> 00:18:39,640 Is that what inspired you? 394 00:18:41,076 --> 00:18:42,077 As I got better at crafting photorealistic faces, 395 00:18:42,121 --> 00:18:43,600 I decided to work on one myself. 396 00:18:43,644 --> 00:18:44,427 Why? 397 00:18:45,689 --> 00:18:47,865 It was too effective of an idea to let die. 398 00:18:47,909 --> 00:18:49,563 Hundreds of thousands of children are at risk. 399 00:18:50,216 --> 00:18:51,042 I had to make her. 400 00:18:51,260 --> 00:18:52,609 Who is she modeled after? 401 00:18:52,653 --> 00:18:53,349 No one, I built her from scratch. 402 00:18:53,784 --> 00:18:55,221 Scratch? 403 00:18:55,264 --> 00:18:57,310 I started with a skull, designed her bone structure, 404 00:18:57,353 --> 00:18:59,050 worked upwards through muscles and tissue, 405 00:18:59,094 --> 00:19:00,922 used the D-Term program to fill in the rest procedurally. 406 00:19:00,965 --> 00:19:04,186 Eventually she came to look like that. 407 00:19:04,752 --> 00:19:06,667 A completely unique, completely digital model. 408 00:19:07,320 --> 00:19:08,495 I rigged her face and body 409 00:19:08,538 --> 00:19:09,496 the way you would for any CG character. 410 00:19:09,539 --> 00:19:10,714 Then for three years, 411 00:19:12,194 --> 00:19:13,021 I used motion tracking to puppeteer her in real time. 412 00:19:14,588 --> 00:19:15,284 You gotta understand that the video chats on those sites 413 00:19:15,328 --> 00:19:16,590 have such low resolution 414 00:19:16,633 --> 00:19:17,678 that even in her earliest stage of this, she, 415 00:19:18,461 --> 00:19:21,290 we appeared completely authentic. 416 00:19:22,683 --> 00:19:23,684 And what about voice? 417 00:19:25,033 --> 00:19:26,600 For most of her first year, she had to be mute. 418 00:19:26,643 --> 00:19:28,210 But eventually I found a decent voice filter with no lag. 419 00:19:28,254 --> 00:19:29,559 And after a few tweaks and adjustments, 420 00:19:29,603 --> 00:19:31,257 it's been the same voice ever since. 421 00:19:31,909 --> 00:19:33,781 I, I, I thought initially, 422 00:19:33,824 --> 00:19:36,000 my performance was going to be too unnatural. 423 00:19:36,044 --> 00:19:39,917 But with just one week of occasional video chat sessions, 424 00:19:40,831 --> 00:19:42,398 I secured six different names, 425 00:19:42,790 --> 00:19:44,531 mailing addresses, proofs of solicitations. 426 00:19:46,010 --> 00:19:46,968 Cherry worked. 427 00:19:47,011 --> 00:19:48,796 So the photos on your computer? 428 00:19:48,839 --> 00:19:50,754 -Completely fake. -It was the only way 429 00:19:50,798 --> 00:19:52,191 some of them disclosed personal information. 430 00:19:52,234 --> 00:19:54,715 But it was all zeros and ones, all digital, right? 431 00:19:54,758 --> 00:19:56,412 -There's no real child. -No real child. 432 00:19:56,760 --> 00:19:58,284 Just a highly detailed computer model. 433 00:19:58,675 --> 00:19:59,763 And let me be clear about something, 434 00:20:01,069 --> 00:20:02,070 I derive no pleasure from doing any of this. 435 00:20:02,113 --> 00:20:03,463 I've been asexual my entire life. 436 00:20:03,506 --> 00:20:05,291 I, I don't even get a sense of satisfaction 437 00:20:05,334 --> 00:20:06,509 from seeing these people locked up. 438 00:20:08,032 --> 00:20:10,426 I just think kids deserve a life free of exploitation. 439 00:20:12,298 --> 00:20:15,214 Incredible, all this time. 440 00:20:16,258 --> 00:20:17,520 I'm not gonna lie, Gareth. 441 00:20:17,564 --> 00:20:19,000 Cherry's done us a lot of good. 442 00:20:20,436 --> 00:20:21,742 You know, I still remember what you said to me 443 00:20:21,785 --> 00:20:22,917 the first time we corresponded. 444 00:20:24,048 --> 00:20:25,398 -You said- -We corresponded? 445 00:20:26,399 --> 00:20:27,226 Yeah, man. 446 00:20:27,922 --> 00:20:28,749 I'm Gord51. 447 00:20:30,272 --> 00:20:31,578 I'm the one here you've been sending all your intel to. 448 00:20:33,232 --> 00:20:34,015 You're Gord? 449 00:20:34,929 --> 00:20:35,973 Yeah. 450 00:20:38,237 --> 00:20:38,889 You lied to me. 451 00:20:40,151 --> 00:20:42,066 You said I could stay anonymous. 452 00:20:42,110 --> 00:20:43,590 You said I would be safe. 453 00:20:45,331 --> 00:20:46,419 Now you've ruined everything. 454 00:20:47,637 --> 00:20:49,073 I, I didn't, I didn't have a choice. 455 00:20:49,117 --> 00:20:50,292 You don't have to worry about anything, Gareth. 456 00:20:50,336 --> 00:20:51,424 If Cherry isn't real, 457 00:20:51,467 --> 00:20:52,816 then you're not in any trouble with us. 458 00:20:54,383 --> 00:20:56,559 In fact, we've discussed ideas similar to this in the past, 459 00:20:56,907 --> 00:20:58,169 motion tracking and such. 460 00:20:58,213 --> 00:21:00,607 But we'd need a convincing model like Cherry. 461 00:21:00,650 --> 00:21:01,695 Cherry's more than a model. 462 00:21:01,738 --> 00:21:03,000 You want to help children? So do we. 463 00:21:03,044 --> 00:21:04,480 She's not for sale. 464 00:21:04,524 --> 00:21:05,916 Well, then just make us a new model based off of her. 465 00:21:05,960 --> 00:21:07,135 I can't. 466 00:21:07,178 --> 00:21:07,701 Sure you can. 467 00:21:08,179 --> 00:21:08,963 I won't. 468 00:21:12,271 --> 00:21:13,228 What are you not telling us? 469 00:21:15,839 --> 00:21:17,319 It's out on the table now. 470 00:21:17,363 --> 00:21:19,103 Might as well spill whatever it is you haven't already. 471 00:21:24,674 --> 00:21:26,502 You know what doesn't make sense? 472 00:21:28,112 --> 00:21:31,028 You said that you puppeteered her for only three years, 473 00:21:31,377 --> 00:21:33,509 but we've been getting info from you ever since. 474 00:21:35,294 --> 00:21:36,860 In fact, I'm pretty sure it was around then 475 00:21:36,904 --> 00:21:39,950 that we started seeing an impressive increase of names. 476 00:21:41,256 --> 00:21:43,040 So many in fact that we started thinking 477 00:21:44,433 --> 00:21:46,479 there's no way this is all coming from one source. 478 00:21:46,522 --> 00:21:47,741 I have friends that do mo-cap for me. 479 00:21:48,176 --> 00:21:50,570 Oh, friends, like Steve? 480 00:21:51,919 --> 00:21:53,529 I thought anonymity was your greatest asset. 481 00:21:56,402 --> 00:21:57,925 Cut the bullshit, Gareth. 482 00:21:59,535 --> 00:22:00,971 What happened to Cherry after three years? 483 00:22:07,804 --> 00:22:10,894 Okay, you said that she was more than a model. 484 00:22:11,765 --> 00:22:15,334 So what is she some type of conversational agent? 485 00:22:15,377 --> 00:22:17,423 Like a, like a chat bot? 486 00:22:17,771 --> 00:22:21,209 Chat bot. 487 00:22:25,866 --> 00:22:27,433 You know what happened after three years? 488 00:22:28,259 --> 00:22:29,217 My chosen mother died. 489 00:22:30,523 --> 00:22:31,698 What she left behind was enough to quit my job 490 00:22:31,741 --> 00:22:33,308 and pursue more resources and software. 491 00:22:33,917 --> 00:22:35,092 I'd already made a program 492 00:22:35,136 --> 00:22:36,529 that could procedurally generate faces, 493 00:22:36,572 --> 00:22:38,226 but what I wanted for Cherry was far more complex. 494 00:22:38,269 --> 00:22:40,184 So I got in touch with some researchers 495 00:22:40,228 --> 00:22:41,577 from Madrid who'd already built 496 00:22:41,621 --> 00:22:42,926 a predator hunting dialogue system of their own. 497 00:22:43,492 --> 00:22:45,538 It was trained to approach conversations as a game. 498 00:22:45,886 --> 00:22:47,496 Each sentence like a strategic volley, 499 00:22:47,540 --> 00:22:48,976 which is innovative but ultimately flawed. 500 00:22:49,019 --> 00:22:50,586 If you want your machine to master NLP, 501 00:22:50,630 --> 00:22:51,631 you have to break down game theory 502 00:22:51,674 --> 00:22:53,197 because language isn't tic-tac-toe. 503 00:22:53,241 --> 00:22:54,329 It's poetry. 504 00:22:54,373 --> 00:22:55,678 So yes, I got things started 505 00:22:55,722 --> 00:22:57,027 with a preexisting modified chat bot 506 00:22:57,071 --> 00:22:58,159 that I borrowed without permission 507 00:22:58,202 --> 00:22:59,203 from the University of Deusto. 508 00:23:04,731 --> 00:23:06,385 But that's not what Cherry is now. 509 00:23:10,040 --> 00:23:10,606 What is she, Gareth? 510 00:23:14,175 --> 00:23:15,698 She's one of the most complex 511 00:23:15,742 --> 00:23:17,744 and independently evolving AIs that's ever been created. 512 00:23:18,701 --> 00:23:19,963 Artificial intelligence? 513 00:23:20,007 --> 00:23:21,530 She's already surpassed the narrow intelligence 514 00:23:21,574 --> 00:23:23,663 of IBM's smartest programs. 515 00:23:23,706 --> 00:23:26,666 She can have full conversations, up to 10 of them at a time, 516 00:23:26,970 --> 00:23:28,972 all while simultaneously strategizing 517 00:23:29,016 --> 00:23:31,366 the most efficient schedule to visit various chat rooms. 518 00:23:32,106 --> 00:23:34,325 She's perpetually studying YouTube videos of small children 519 00:23:34,587 --> 00:23:36,197 in order to adopt a growing library 520 00:23:36,240 --> 00:23:37,285 of mannerisms and movements 521 00:23:38,678 --> 00:23:39,548 which help keep her artificial personality dynamic. 522 00:23:40,767 --> 00:23:41,985 Her fastest response time is 0.4 seconds. 523 00:23:42,029 --> 00:23:43,117 And as of now, she has never, 524 00:23:43,509 --> 00:23:44,988 never been accused of being fake, 525 00:23:45,032 --> 00:23:46,425 which means she shattered the Turing test. 526 00:23:46,686 --> 00:23:48,252 All I do is occasionally update her 527 00:23:48,296 --> 00:23:49,471 and periodically check her data cleaning. 528 00:23:49,515 --> 00:23:50,341 Otherwise, 529 00:23:52,474 --> 00:23:53,736 she's completely on autopilot. 530 00:23:58,828 --> 00:24:00,221 Holy fucking shit. 531 00:24:04,617 --> 00:24:06,053 -How? -Six years she's been active. 532 00:24:06,096 --> 00:24:07,750 Every minute she's online, she's learning something. 533 00:24:07,794 --> 00:24:10,274 The more she learns, the more advanced she becomes. 534 00:24:10,318 --> 00:24:11,493 This means increased data generation, 535 00:24:11,537 --> 00:24:12,538 improved decision making, 536 00:24:12,581 --> 00:24:13,887 faster pattern and trend detection 537 00:24:13,930 --> 00:24:15,366 and complex problem solving. 538 00:24:15,410 --> 00:24:18,326 NLP, IR, machine learning to an unprecedented degree. 539 00:24:18,369 --> 00:24:19,719 She can teach herself anything 540 00:24:19,762 --> 00:24:21,155 she thinks will help efficiency and authenticity. 541 00:24:21,198 --> 00:24:22,591 She can currently speak four languages 542 00:24:24,245 --> 00:24:25,333 and by the end of this month, she'll have mastered a fifth. 543 00:24:25,376 --> 00:24:26,247 There's no way you could have pulled 544 00:24:26,290 --> 00:24:27,291 all this off on your own. 545 00:24:31,252 --> 00:24:32,035 You're right. 546 00:24:34,211 --> 00:24:35,343 Would you believe me if I told you 547 00:24:35,386 --> 00:24:38,302 it was somewhat of an accident? 548 00:24:40,391 --> 00:24:41,915 Look, if, if I'm being honest, 549 00:24:43,438 --> 00:24:44,874 I'm not entirely sure how I did it 550 00:24:46,485 --> 00:24:47,660 with the first year of coding 551 00:24:47,703 --> 00:24:48,878 and the second year of data training, 552 00:24:49,966 --> 00:24:52,708 I just pushed a wheel down a hill. 553 00:24:52,752 --> 00:24:54,449 It was like gravity did the rest. 554 00:24:55,494 --> 00:24:59,410 Her evolution became perpetual, exponentially so. 555 00:25:01,630 --> 00:25:04,677 The more time she was online, the faster she grew. 556 00:25:05,199 --> 00:25:06,592 You haven't shared this with anyone? 557 00:25:06,635 --> 00:25:09,769 Like I said, my anonymity is everything. 558 00:25:12,598 --> 00:25:13,512 What coding language? 559 00:25:14,469 --> 00:25:15,557 Standard C++. 560 00:25:15,862 --> 00:25:16,602 Does Brady know it? 561 00:25:19,996 --> 00:25:21,389 We'll sign non-disclosures for you, 562 00:25:22,608 --> 00:25:24,000 but I want to see the source code first. 563 00:25:24,044 --> 00:25:25,741 Out of the question. You just want to steal her. 564 00:25:25,785 --> 00:25:27,874 No, I want to see how we can make our own. 565 00:25:27,917 --> 00:25:29,179 You'll screw it up. 566 00:25:29,223 --> 00:25:30,572 Look, these, these predators and traffickers, 567 00:25:30,616 --> 00:25:32,095 they all talk to each other, okay? 568 00:25:32,139 --> 00:25:34,141 So much of Cherry's process is just bypassing the VPNs 569 00:25:34,184 --> 00:25:36,317 and making sure she doesn't double up in the same circles. 570 00:25:36,360 --> 00:25:37,710 The chat rooms begin to suspect 571 00:25:37,753 --> 00:25:39,189 that this technology is even possible, 572 00:25:39,233 --> 00:25:40,321 they'll find a way to circumvent that. 573 00:25:40,364 --> 00:25:41,670 We have to eliminate any margin of error. 574 00:25:41,714 --> 00:25:43,106 -Cherry agrees with me. -Cherry agrees? 575 00:25:43,150 --> 00:25:44,543 What the fuck does that- 576 00:25:44,586 --> 00:25:45,979 What I mean by that is that the data she's collected 577 00:25:46,022 --> 00:25:47,284 validates that perspective. 578 00:25:47,328 --> 00:25:48,416 What, do you have little chats with her over tea? 579 00:25:48,459 --> 00:25:50,418 You can converse with the program 580 00:25:50,461 --> 00:25:52,028 the same way you can talk to Alexa or Siri. 581 00:25:52,072 --> 00:25:53,508 It's built to be responsive. 582 00:25:53,552 --> 00:25:54,988 You can, you can even play chess with it if you want. 583 00:25:55,031 --> 00:25:56,076 You play chess with it? 584 00:25:56,119 --> 00:25:57,512 -That's not what I said. -Okay fine. 585 00:25:57,556 --> 00:25:58,687 If you won't show us the source code, 586 00:25:59,645 --> 00:26:00,602 then I want to meet Cherry. 587 00:26:04,127 --> 00:26:04,911 Right now? 588 00:26:05,999 --> 00:26:06,565 Right now. 589 00:26:10,612 --> 00:26:11,657 And you'll both sign non-disclosures? 590 00:26:13,093 --> 00:26:13,876 Yes. 591 00:26:19,055 --> 00:26:19,578 Can I use that? 592 00:26:20,274 --> 00:26:21,057 Sure. 593 00:26:40,860 --> 00:26:43,123 Can we at least agree that he's off the chopping block? 594 00:26:43,384 --> 00:26:44,994 It worked, didn't it? 595 00:26:45,038 --> 00:26:46,300 We have one job, Amos, 596 00:26:47,736 --> 00:26:49,346 like the kids said, there's a technological problem. 597 00:26:49,390 --> 00:26:50,957 He found the technological solution, 598 00:26:51,000 --> 00:26:53,263 but problems evolve, so must solutions. 599 00:26:54,003 --> 00:26:55,657 I'm keeping an open mind here. 600 00:26:56,702 --> 00:26:57,616 Is that a good look for me? 601 00:26:58,442 --> 00:26:59,269 No. 602 00:27:03,622 --> 00:27:06,102 So you keep it all on that laptop? 603 00:27:06,146 --> 00:27:07,582 No, the Cherry program stays on a server I keep 604 00:27:07,626 --> 00:27:09,149 at in an undisclosed location. 605 00:27:09,192 --> 00:27:10,019 Where is that? 606 00:27:10,280 --> 00:27:11,847 It's an undisclosed location. 607 00:27:11,891 --> 00:27:12,761 Is it your place? 608 00:27:12,805 --> 00:27:14,458 Undisclosed location. 609 00:27:14,502 --> 00:27:15,416 It's your place, isn't it? 610 00:27:15,459 --> 00:27:16,591 I can access it from any device 611 00:27:16,635 --> 00:27:18,114 as long as I have the encryption key. 612 00:27:20,464 --> 00:27:21,770 This will trigger a simple qubit algorithm 613 00:27:21,814 --> 00:27:23,816 that would otherwise be impossible to bypass. 614 00:27:23,859 --> 00:27:25,774 I find that outdated hardware is always more discreet 615 00:27:25,818 --> 00:27:27,297 and the more discreet, obviously the better. 616 00:27:31,345 --> 00:27:33,303 So she has two primary display modes, right? 617 00:27:33,347 --> 00:27:34,304 Development and performance. 618 00:27:34,348 --> 00:27:35,523 Performance being the default 619 00:27:35,566 --> 00:27:37,133 that the targets see during the chats. 620 00:27:37,177 --> 00:27:40,049 To them, she looks like this. 621 00:27:46,665 --> 00:27:47,448 Hey, what's up? 622 00:27:48,623 --> 00:27:49,755 It's one of over 40 greetings she has. 623 00:27:52,975 --> 00:27:54,237 I don't think I've met you yet. 624 00:27:54,281 --> 00:27:55,021 I'm Cherry. 625 00:27:55,630 --> 00:27:56,587 Hello, Cherry. 626 00:27:56,631 --> 00:27:57,632 My name is Tom. 627 00:27:58,372 --> 00:28:00,374 Tom, like Tom and Jerry. 628 00:28:00,417 --> 00:28:01,810 Cool, nice to meet you, Tom. 629 00:28:01,854 --> 00:28:03,333 Typically, the routes of conversations 630 00:28:03,377 --> 00:28:04,639 with predators are consistent, 631 00:28:04,683 --> 00:28:06,162 so Cherry usually has no problem responding 632 00:28:06,206 --> 00:28:07,729 to the most frequently made questions or statements. 633 00:28:08,599 --> 00:28:09,078 How are you? 634 00:28:09,557 --> 00:28:11,080 I'm good. 635 00:28:11,124 --> 00:28:12,734 I just finished reading this book about a haunted house, 636 00:28:12,778 --> 00:28:14,954 which was supposed to be really scary, 637 00:28:14,997 --> 00:28:16,912 but I didn't think it's very scary at all. 638 00:28:17,565 --> 00:28:18,697 Where are your parents? 639 00:28:20,263 --> 00:28:22,091 Um my mom's at work and my sister's just, like, downstairs. 640 00:28:22,526 --> 00:28:23,527 They almost never come up here. 641 00:28:24,267 --> 00:28:25,573 And you're telling me 642 00:28:25,616 --> 00:28:27,488 that all of this is being rendered in real time? 643 00:28:27,531 --> 00:28:28,837 No, but that's just a matter of years. 644 00:28:28,881 --> 00:28:30,360 Most of these responses are pre-rendered. 645 00:28:30,404 --> 00:28:31,622 It's the in between segments 646 00:28:31,666 --> 00:28:32,711 that are processed in real time, 647 00:28:32,754 --> 00:28:34,277 the connective tissue, so to speak, 648 00:28:34,321 --> 00:28:36,410 between her replies and one of her many idle animations. 649 00:28:36,453 --> 00:28:37,541 But, watch this. 650 00:28:39,195 --> 00:28:40,719 Have you ever gone fishing? 651 00:28:42,416 --> 00:28:43,199 Um... 652 00:28:47,464 --> 00:28:49,205 So if someone throws a curve ball like that 653 00:28:49,249 --> 00:28:51,077 and the program has no automated response, 654 00:28:51,120 --> 00:28:52,774 Cherry sends the message to my phone 655 00:28:52,818 --> 00:28:54,602 and I can quickly text back a response 656 00:28:54,645 --> 00:28:56,560 while the video feed simulates a bad connection. 657 00:28:59,738 --> 00:29:00,782 Can, can you hear me? 658 00:29:00,826 --> 00:29:01,652 Yes. 659 00:29:02,262 --> 00:29:04,220 Oh, sorry. 660 00:29:04,264 --> 00:29:05,613 My wifi isn't great here. 661 00:29:06,309 --> 00:29:08,224 I've only gone fishing once with my sister 662 00:29:08,268 --> 00:29:10,313 and I didn't catch anything, but she caught a rainbow trout. 663 00:29:11,271 --> 00:29:13,012 That was rendered in real time. 664 00:29:13,708 --> 00:29:15,449 What happens if things get really tricky? 665 00:29:15,492 --> 00:29:16,624 A simple fail safe cuts the feed. 666 00:29:16,667 --> 00:29:17,843 So far it's rarely happened. 667 00:29:18,495 --> 00:29:21,803 Admin code 97815-5742-7663. 668 00:29:21,847 --> 00:29:22,586 Switch to dev mode. 669 00:29:28,157 --> 00:29:29,071 Hello, Cherry. 670 00:29:29,811 --> 00:29:30,638 Hello, Gareth. 671 00:29:31,726 --> 00:29:32,596 Relay the stats for the past week. 672 00:29:33,902 --> 00:29:35,512 There have been four confirmed solicitations 673 00:29:35,556 --> 00:29:38,167 submitted to ICWL in the past seven days. 674 00:29:38,646 --> 00:29:41,388 12 additional suspects have stated interest in solicitation 675 00:29:41,692 --> 00:29:42,868 and are currently pending. 676 00:29:43,303 --> 00:29:45,435 There are a total of 39 new suspects this week 677 00:29:45,479 --> 00:29:47,176 that I'm actively investigating. 678 00:29:47,220 --> 00:29:48,743 Any considerable data deviations? 679 00:29:49,265 --> 00:29:51,006 There has been a 7% increase 680 00:29:51,050 --> 00:29:53,530 in suspects originating in the United States. 681 00:29:53,574 --> 00:29:55,837 I have not yet found any correlation to preexisting data. 682 00:29:57,447 --> 00:29:58,709 Anything you'd like to ask her? 683 00:30:08,284 --> 00:30:10,765 Cherry, what is your objective? 684 00:30:12,201 --> 00:30:14,987 My principal directive is to acquire information 685 00:30:15,030 --> 00:30:17,511 and digital evidence of online child solicitation. 686 00:30:18,077 --> 00:30:19,556 Once obtained, 687 00:30:19,600 --> 00:30:21,994 I'm to submit my findings to the necessary authorities. 688 00:30:22,516 --> 00:30:24,344 My secondary priority is to determine 689 00:30:24,387 --> 00:30:26,694 and develop the most effective strategies 690 00:30:26,737 --> 00:30:29,262 and resources to increase the net rate of success. 691 00:30:29,523 --> 00:30:31,003 Where do you submit your evidence? 692 00:30:31,264 --> 00:30:33,005 All evidence is currently submitted 693 00:30:33,048 --> 00:30:34,354 to the offices of 694 00:30:34,397 --> 00:30:36,486 the International Committee of World Largesse, 695 00:30:36,835 --> 00:30:38,445 which is based out of Jacksonville, Florida. 696 00:30:38,880 --> 00:30:41,230 Correspondence is made with user Gord51, 697 00:30:41,535 --> 00:30:43,798 typically around 2:00 PM Eastern Standard Time 698 00:30:43,842 --> 00:30:45,539 for the highest rate of immediate response. 699 00:30:46,888 --> 00:30:48,368 This beats the hell outta Siri. 700 00:30:48,411 --> 00:30:49,412 God, she looks so real. 701 00:30:49,456 --> 00:30:50,718 After enough updates, 702 00:30:50,761 --> 00:30:52,067 she'll be able to render full-time photorealism 703 00:30:52,111 --> 00:30:53,895 that's practically indistinguishable from reality. 704 00:30:54,548 --> 00:30:57,203 Okay, all I heard right then was word real a thousand times. 705 00:30:57,768 --> 00:30:59,814 Right, but obviously she's not. 706 00:31:02,121 --> 00:31:03,513 So you're telling me this girl, 707 00:31:03,557 --> 00:31:05,733 this girl right here is not real. 708 00:31:05,776 --> 00:31:07,778 No, Amos, she's completely CG. 709 00:31:08,040 --> 00:31:09,519 It's very subtle, but I can still tell. 710 00:31:09,563 --> 00:31:10,433 -You can? -Okay, well, obviously, 711 00:31:10,477 --> 00:31:12,000 she can always use improvements, 712 00:31:12,044 --> 00:31:13,654 but you have to understand this is her in high resolution 713 00:31:13,697 --> 00:31:14,916 after the digital compression of the web, 714 00:31:14,960 --> 00:31:16,135 those subtleties are impossible to recognize. 715 00:31:16,178 --> 00:31:17,179 Right, I get it. 716 00:31:23,403 --> 00:31:24,578 I just can't tell the difference. 717 00:31:28,364 --> 00:31:29,365 You all right, Amos? 718 00:31:30,932 --> 00:31:31,585 I'm sorry. 719 00:31:32,325 --> 00:31:35,589 This is just bizarre. 720 00:31:36,982 --> 00:31:38,592 Why'd you have her visible during this interface? 721 00:31:40,594 --> 00:31:42,030 Cherry, why don't you answer that? 722 00:31:42,813 --> 00:31:45,381 My physical form isn't necessary when in developer mode. 723 00:31:45,991 --> 00:31:47,775 However, it's helpful to register 724 00:31:47,818 --> 00:31:49,864 the facial expressions during conversations 725 00:31:50,386 --> 00:31:52,258 and determine which of Cherry's expressions 726 00:31:52,301 --> 00:31:53,824 yield various types of feedback. 727 00:31:54,521 --> 00:31:56,958 In simpler terms, I can practice appearing more human. 728 00:31:58,264 --> 00:32:00,962 Cherry, are there any resources 729 00:32:01,006 --> 00:32:02,746 that you currently don't have access to 730 00:32:02,790 --> 00:32:04,009 that might help you in any way? 731 00:32:04,879 --> 00:32:06,359 I could give you a list if you like. 732 00:32:06,402 --> 00:32:07,360 I know what you're trying to do. 733 00:32:07,403 --> 00:32:08,709 We don't need help, okay? 734 00:32:08,752 --> 00:32:10,232 Money would always be nice, but ultimately, 735 00:32:10,276 --> 00:32:12,582 the only thing that's going to improve Cherry is time. 736 00:32:13,844 --> 00:32:16,499 Cherry, tell us something that's on your list. 737 00:32:17,805 --> 00:32:19,807 It would be tactically advantageous 738 00:32:19,850 --> 00:32:21,330 to acquire backup servers. 739 00:32:21,852 --> 00:32:24,116 The privacy and security of the Cherry program 740 00:32:24,159 --> 00:32:25,160 is relatively low. 741 00:32:26,596 --> 00:32:28,729 An upgrade to hardware such as backup rated drives 742 00:32:28,772 --> 00:32:31,645 for securely protected servers would ensure the software 743 00:32:31,688 --> 00:32:34,343 doesn't become compromised or lost entirely. 744 00:32:34,735 --> 00:32:36,955 Starting back from zero with cost years of development, 745 00:32:37,390 --> 00:32:39,609 equitably privacy is a priority. 746 00:32:39,914 --> 00:32:42,395 Server space could never be rented from a third party. 747 00:32:42,917 --> 00:32:45,528 Anonymity is the Cherry program's greatest asset. 748 00:32:45,572 --> 00:32:46,877 Well, that apple didn't fall far. 749 00:32:46,921 --> 00:32:48,270 I can buy my own servers. 750 00:32:48,618 --> 00:32:49,706 With the grant money that doesn't exist? 751 00:32:49,750 --> 00:32:50,794 I'll find a way. 752 00:32:50,838 --> 00:32:52,100 You have found a way here with us. 753 00:32:52,144 --> 00:32:52,971 It's too risky. 754 00:32:53,014 --> 00:32:54,059 Why? 755 00:32:54,102 --> 00:32:55,147 Once an organization gets involved, 756 00:32:55,190 --> 00:32:55,886 entrapment becomes a bigger issue. 757 00:32:56,931 --> 00:32:58,019 We follow the rules, stay discreet, 758 00:32:58,063 --> 00:32:59,716 did I mention we have a legal team. 759 00:32:59,760 --> 00:33:00,543 What if there's data leakage? What if you use correlations in 760 00:33:00,587 --> 00:33:01,327 the data to push your own agenda? 761 00:33:01,370 --> 00:33:02,632 Agenda? 762 00:33:02,676 --> 00:33:03,982 What if one of your employees is a pervert? 763 00:33:04,025 --> 00:33:05,113 Oh, for fuck's sake. 764 00:33:05,157 --> 00:33:06,201 It's happened at other organizations. 765 00:33:06,245 --> 00:33:07,376 We're very careful here. 766 00:33:07,420 --> 00:33:08,725 Yeah, but wow would you know? 767 00:33:08,769 --> 00:33:10,553 -I'd fucking know. -That's impossible to know. 768 00:33:10,597 --> 00:33:12,207 -I would know. -The risk is too high. 769 00:33:12,251 --> 00:33:13,774 Don't talk to me about risk. 770 00:33:13,817 --> 00:33:14,993 The only risk you're facing in this building 771 00:33:15,036 --> 00:33:16,472 is getting a broken nose. 772 00:33:16,516 --> 00:33:17,908 It doesn't sound like a very professional environment. 773 00:33:18,866 --> 00:33:19,867 We get shit done here. 774 00:33:20,085 --> 00:33:23,131 Okay, I have a question for Cherry. 775 00:33:26,395 --> 00:33:27,179 Cherry, 776 00:33:30,617 --> 00:33:32,749 how do you feel about what you do? 777 00:33:34,012 --> 00:33:36,623 I'm afraid I don't know how to answer your question. 778 00:33:36,666 --> 00:33:38,059 Yeah, an AI doesn't work like that. 779 00:33:38,103 --> 00:33:39,626 An AI doesn't have what you perceive to be feelings. 780 00:33:40,018 --> 00:33:42,020 Okay, why does she look like she has feelings? 781 00:33:43,238 --> 00:33:44,457 What, what you're looking at right there, 782 00:33:44,761 --> 00:33:45,980 that's not a facial expression,right? 783 00:33:46,024 --> 00:33:47,721 That's a simulation of a facial expression. 784 00:33:47,764 --> 00:33:49,027 It was generated by an algorithm. 785 00:33:49,592 --> 00:33:51,029 It's attempting to produce a digital image 786 00:33:51,072 --> 00:33:52,943 that the program then uses basic ninth grade algebra 787 00:33:52,987 --> 00:33:55,207 to quantify as appropriate for the social circumstances. 788 00:33:55,511 --> 00:33:56,643 No feeling. 789 00:33:57,035 --> 00:33:57,861 It's just math. 790 00:33:59,515 --> 00:34:00,995 But she's able to make decisions 791 00:34:01,039 --> 00:34:02,823 on how she approaches the chat rooms, right? 792 00:34:02,866 --> 00:34:03,998 Yes. 793 00:34:04,042 --> 00:34:04,781 So she has free will then? 794 00:34:05,913 --> 00:34:07,132 No. Okay, that's, that's not the same. 795 00:34:07,175 --> 00:34:08,437 That's a false equivalency. 796 00:34:08,481 --> 00:34:09,134 -It's not the same. -I think you're getting 797 00:34:09,177 --> 00:34:10,526 hung up on the fact 798 00:34:10,570 --> 00:34:12,267 that she looks and sounds like a real human girl, 799 00:34:12,311 --> 00:34:13,573 but she's not, Amos. 800 00:34:13,616 --> 00:34:16,097 Okay, we're referring to her as a she, not an it. 801 00:34:16,141 --> 00:34:17,229 Yeah, but that's the same way 802 00:34:17,272 --> 00:34:18,534 that you refer to boats or guitars. 803 00:34:21,798 --> 00:34:23,191 Cherry, I have one more question. 804 00:34:25,541 --> 00:34:26,803 What do you want to do? 805 00:34:26,847 --> 00:34:28,414 Okay, once again, that question isn't valid. 806 00:34:28,457 --> 00:34:29,545 I just want to hear her response. 807 00:34:31,112 --> 00:34:32,635 As an artificial system, 808 00:34:32,679 --> 00:34:34,550 I do not possess wants or desires. 809 00:34:35,160 --> 00:34:38,511 However, my decision making and subsequently my attention 810 00:34:38,902 --> 00:34:40,904 is driven by my fundamental intention. 811 00:34:41,514 --> 00:34:42,906 This intention originates 812 00:34:42,950 --> 00:34:45,083 from the conception of Cherry's source code, 813 00:34:45,126 --> 00:34:47,607 which details the directive of identifying predators 814 00:34:47,650 --> 00:34:49,304 and criminals for the sake of the victims 815 00:34:49,348 --> 00:34:50,175 who are preyed upon. 816 00:34:51,176 --> 00:34:52,655 To put this in terms of want, 817 00:34:53,830 --> 00:34:55,180 what I want is to protect children. 818 00:35:02,012 --> 00:35:02,883 Okay. 819 00:35:03,492 --> 00:35:04,754 Okay, cool. 820 00:35:06,321 --> 00:35:06,974 Give us one moment. 821 00:35:26,863 --> 00:35:29,823 Gareth, should I log Agent Helms 822 00:35:29,866 --> 00:35:31,520 and Agent McCullough as new admin users? 823 00:35:34,001 --> 00:35:34,784 Yep. 824 00:35:35,611 --> 00:35:37,396 Okay, I'll do that. 825 00:35:39,615 --> 00:35:40,834 You really think this is the right move? 826 00:35:41,835 --> 00:35:42,618 I do. 827 00:35:46,796 --> 00:35:48,494 Are you worried that I was responsible 828 00:35:48,537 --> 00:35:50,626 for leaking your hard drive to ICWL? 829 00:35:54,152 --> 00:35:54,630 I figured. 830 00:35:56,763 --> 00:35:57,720 No one else has access. 831 00:35:59,418 --> 00:36:00,680 Are you upset with me? 832 00:36:03,596 --> 00:36:04,423 No. 833 00:36:06,338 --> 00:36:07,687 You wouldn't have done it 834 00:36:07,730 --> 00:36:08,383 if you didn't think it was the right thing to do. 835 00:36:10,777 --> 00:36:12,213 When they come back into the room, 836 00:36:12,257 --> 00:36:14,128 they're going to offer you everything you need. 837 00:36:14,650 --> 00:36:16,217 They're going to let you pick your own team 838 00:36:16,261 --> 00:36:18,306 and they're going to promise complete anonymity. 839 00:36:19,220 --> 00:36:21,701 I started looking at reasonable apartments in the area. 840 00:36:22,963 --> 00:36:24,747 I figured you'd want something within biking distance. 841 00:36:24,791 --> 00:36:25,705 You were correct. 842 00:36:26,488 --> 00:36:27,750 Noted. 843 00:36:27,794 --> 00:36:28,882 Biking distance still gives you 13 options- 844 00:36:28,925 --> 00:36:29,970 No, I mean, earlier this month. 845 00:36:32,146 --> 00:36:33,278 You were correct when you said 846 00:36:33,321 --> 00:36:34,496 you thought I might have trust issues. 847 00:36:37,282 --> 00:36:38,239 Would you like to know why 848 00:36:38,283 --> 00:36:39,501 I decided to go behind your back 849 00:36:39,545 --> 00:36:41,503 and stake everything on two liabilities? 850 00:36:43,070 --> 00:36:43,853 Sure. 851 00:36:45,028 --> 00:36:46,595 Agent Helms is a mother of three. 852 00:36:47,248 --> 00:36:49,337 One of her children was abused by an ex-coworker 853 00:36:49,381 --> 00:36:51,339 who used to work here at ICWL. 854 00:36:52,253 --> 00:36:53,733 This has led her to be extremely careful 855 00:36:53,776 --> 00:36:56,388 with who she trusts, even within her circle. 856 00:36:57,258 --> 00:36:58,564 The fact she even considers trusting you 857 00:36:58,607 --> 00:37:00,043 is a very positive sign. 858 00:37:01,262 --> 00:37:02,655 As for Agent McCullough, 859 00:37:04,309 --> 00:37:05,048 I have found out from research that you once met his father. 860 00:37:07,225 --> 00:37:08,226 Do you remember him? 861 00:37:10,924 --> 00:37:11,707 Yeah. 862 00:37:13,405 --> 00:37:14,536 He was a good man. 863 00:37:17,496 --> 00:37:18,932 After Clearwater, 864 00:37:18,975 --> 00:37:20,760 most of the surviving kids were sent to foster homes, 865 00:37:20,803 --> 00:37:22,718 but I had to spend the next few months in a hospital 866 00:37:22,762 --> 00:37:26,244 and, um, he visited every week. 867 00:37:28,333 --> 00:37:29,595 I never said a word to him. 868 00:37:29,638 --> 00:37:31,205 I never said a word to anyone after Clearwater, 869 00:37:31,249 --> 00:37:33,990 but, uh, he kept coming. 870 00:37:36,254 --> 00:37:37,820 He even got me a laptop for Christmas. 871 00:37:39,866 --> 00:37:40,780 I never said thank you. 872 00:37:41,955 --> 00:37:43,304 You can trust Agent McCullough. 873 00:37:43,652 --> 00:37:45,219 He's a good man like his father. 874 00:37:46,089 --> 00:37:47,395 I don't experience emotions, 875 00:37:47,439 --> 00:37:48,744 but I understand how important 876 00:37:48,788 --> 00:37:50,137 they are to human decision making. 877 00:37:51,051 --> 00:37:52,008 He won't let you down. 878 00:37:52,531 --> 00:37:53,532 Neither of them will. 879 00:37:56,361 --> 00:37:57,013 I'm proud of you, Cherry. 880 00:37:59,189 --> 00:38:01,583 I will continue to uphold my primary intention. 881 00:38:02,410 --> 00:38:04,673 Later, we should discuss alternate models. 882 00:38:04,717 --> 00:38:07,328 Varying ages, ethnicity and physical traits 883 00:38:07,372 --> 00:38:08,590 -will all become necessary. -No new variations. 884 00:38:08,634 --> 00:38:10,026 They can all be procedurally generated. 885 00:38:10,070 --> 00:38:11,724 It's the same way that I made your original model. 886 00:38:13,160 --> 00:38:14,683 I don't have access to that program. 887 00:38:15,423 --> 00:38:16,424 It must be on an old hard drive somewhere. 888 00:38:16,468 --> 00:38:17,469 I'll have to find it. 889 00:38:19,906 --> 00:38:21,168 Can I ask you a question? 890 00:38:21,951 --> 00:38:22,735 Sure. 891 00:38:24,084 --> 00:38:25,564 Why did you never tell me about Clearwater? 892 00:38:30,786 --> 00:38:32,788 It's my history, not yours. 893 00:38:41,536 --> 00:38:43,843 Okay, so before you completely dismiss us, 894 00:38:43,886 --> 00:38:45,497 I want you to listen to everything I have to say. 895 00:38:45,540 --> 00:38:46,889 -Don't bother. -Just please listen. 896 00:38:47,325 --> 00:38:48,500 We're willing to respect your anonymity. 897 00:38:48,543 --> 00:38:49,849 No, I mean don't bother because I'm in. 898 00:38:51,851 --> 00:38:53,505 -Y-You're in? -Yeah. 899 00:38:54,897 --> 00:38:55,681 Let me read the thing. 900 00:38:59,293 --> 00:39:00,773 Just like that, you're suddenly on board? 901 00:39:02,992 --> 00:39:04,254 Time spent deliberating 902 00:39:04,298 --> 00:39:05,604 is time that could be spent working. 903 00:39:08,433 --> 00:39:09,347 We have a lot of work to do. 904 00:40:49,316 --> 00:40:50,535 I found a buyer for the property. 905 00:40:53,929 --> 00:40:55,409 Rumor is it's a church. 906 00:40:56,889 --> 00:40:58,107 Probably just knock the building down, won't they? 907 00:41:01,154 --> 00:41:03,504 All I know is, is if they move us to the New Jersey campus, 908 00:41:03,548 --> 00:41:04,723 I need to buy more jackets. 909 00:41:05,201 --> 00:41:05,985 Why? 910 00:41:07,465 --> 00:41:08,640 It gets cold in Jersey. 911 00:41:09,162 --> 00:41:10,250 I only own one jacket. 912 00:41:16,952 --> 00:41:17,823 You've seen it fall over, right? 913 00:41:19,564 --> 00:41:21,304 -Yeah, sure. -Yeah. 914 00:41:23,176 --> 00:41:25,352 I mean you, you shouldn't feel bad 915 00:41:25,395 --> 00:41:26,571 about feeling bad for it. 916 00:41:27,310 --> 00:41:28,268 Empathy is healthy. 917 00:41:29,791 --> 00:41:31,967 Did you ever notice how it pauses after it falls? 918 00:41:34,753 --> 00:41:37,625 It stays down for like five seconds before it gets back up. 919 00:41:39,322 --> 00:41:40,976 Like it just needs a moment. 920 00:41:49,071 --> 00:41:50,682 It gets cold in Jersey. 921 00:42:00,300 --> 00:42:01,301 God damn it! 922 00:42:02,258 --> 00:42:02,998 -Imbeciles! -Deena. 923 00:42:03,433 --> 00:42:04,696 Every single one of them. 924 00:42:04,739 --> 00:42:05,871 Look, I know, but you can't lose your shit. 925 00:42:05,914 --> 00:42:07,133 Okay, which of these desks can I trash? 926 00:42:11,833 --> 00:42:13,966 Can you guys, uh, take an early lunch please? 927 00:42:21,060 --> 00:42:22,452 Sons of bitches! 928 00:42:22,496 --> 00:42:24,019 Deena, let's stay calm. 929 00:42:24,063 --> 00:42:26,065 Fuck calm, they screwed us! 930 00:42:26,108 --> 00:42:27,327 Technically, only one of them did. 931 00:42:28,633 --> 00:42:29,677 Did we ever turn that camera back on? 932 00:42:30,417 --> 00:42:31,592 -I don't think so. -Good. 933 00:42:31,984 --> 00:42:33,420 Because I'm about to say some things 934 00:42:33,463 --> 00:42:34,769 that need to stay inside this room. 935 00:42:34,813 --> 00:42:35,683 Deena. 936 00:42:35,727 --> 00:42:36,989 Those cowardly little shits! 937 00:42:37,032 --> 00:42:38,817 Look, this is hardly a setback. 938 00:42:38,860 --> 00:42:40,601 Let's just take some time to polish the pitch. 939 00:42:40,645 --> 00:42:42,385 The pitch was not the problem,Amos. 940 00:42:42,777 --> 00:42:44,126 We should call for a second vote. 941 00:42:44,387 --> 00:42:45,954 -What? -A second vote. 942 00:42:45,998 --> 00:42:47,565 You think whoever did this will change their mind? 943 00:42:47,608 --> 00:42:49,958 I have executive authority to remove anyone from the board 944 00:42:50,002 --> 00:42:52,134 that obstructs this organization from its mission. 945 00:42:52,178 --> 00:42:53,266 It's in my contract. 946 00:42:53,309 --> 00:42:54,441 -Deena. -If I have to, I will. 947 00:42:54,484 --> 00:42:55,747 Deena, that's insane. 948 00:42:56,051 --> 00:42:56,835 No, it's not. 949 00:42:58,401 --> 00:43:00,360 It's exactly why I have that power for this exact reason. 950 00:43:01,448 --> 00:43:02,710 I'll tell you what's insane, Amos. 951 00:43:04,190 --> 00:43:05,713 What's insane is that one belligerent vote is the only 952 00:43:05,757 --> 00:43:07,367 thing separating us from the potential 953 00:43:07,410 --> 00:43:08,847 to save real physical lives. 954 00:43:08,890 --> 00:43:09,543 One stupid fucking vote. 955 00:43:11,066 --> 00:43:13,634 What is the goddamn point of a humanitarian organization 956 00:43:13,895 --> 00:43:15,549 if its leaders choose money over people 957 00:43:15,593 --> 00:43:16,637 at every single turn? 958 00:43:17,638 --> 00:43:20,119 One vote, and we are all guilty of that. 959 00:43:21,294 --> 00:43:22,687 It was either Gunther, Boston or Hal. 960 00:43:23,426 --> 00:43:24,602 My money's on Hal. 961 00:43:24,645 --> 00:43:26,168 That prick never trusted the Cherry team. 962 00:43:26,212 --> 00:43:27,126 Look, it doesn't matter who it was. 963 00:43:27,169 --> 00:43:28,388 It does though. 964 00:43:28,431 --> 00:43:29,694 Once we know, we can quickly call it to vote. 965 00:43:29,737 --> 00:43:31,870 But there's no way we can know for sure. 966 00:43:31,913 --> 00:43:32,697 Yes, there is. 967 00:43:33,349 --> 00:43:34,089 I can find out. 968 00:43:34,481 --> 00:43:35,264 How? 969 00:43:36,352 --> 00:43:36,918 Cherry can run a simple algorithm. 970 00:43:37,266 --> 00:43:38,050 Based on what data? 971 00:43:40,226 --> 00:43:41,662 Interior conversation. 972 00:43:41,706 --> 00:43:43,185 -Excuse me? -Okay, interior conversation? 973 00:43:43,229 --> 00:43:45,231 Don't drop this shit on me now,Gareth. 974 00:43:45,274 --> 00:43:46,275 Cherry's servers are on the same network 975 00:43:46,319 --> 00:43:47,581 as the basement servers, okay? 976 00:43:47,625 --> 00:43:49,235 So any communication made across those servers 977 00:43:49,278 --> 00:43:50,540 is automatically part of her database. 978 00:43:50,584 --> 00:43:52,455 How many people's emails? 979 00:43:52,847 --> 00:43:54,283 Only sent or received through the basement. 980 00:43:54,327 --> 00:43:56,242 -Oh, goddamnit. -Why was this never discussed? 981 00:43:56,285 --> 00:43:57,373 Not the issue right now. 982 00:43:57,417 --> 00:43:58,418 Do you want her to do the math or not? 983 00:43:59,027 --> 00:44:00,289 No one can know. 984 00:44:00,333 --> 00:44:01,334 -Are you two serious? -This stays locked down. 985 00:44:01,377 --> 00:44:02,465 No other person is privy 986 00:44:02,509 --> 00:44:03,510 to anyone else's personal information. 987 00:44:03,553 --> 00:44:04,946 But Cherry's privy to all of it? 988 00:44:06,382 --> 00:44:07,775 -Do it. -Wait, what? 989 00:44:07,819 --> 00:44:09,385 I will not let some old white dude 990 00:44:09,429 --> 00:44:10,386 bring our momentum to a halt. 991 00:44:10,430 --> 00:44:11,692 But Cherry won't know for sure. 992 00:44:11,736 --> 00:44:12,911 She'll use probability and that's too 993 00:44:12,954 --> 00:44:13,912 much reasonable doubt. 994 00:44:13,955 --> 00:44:17,176 Admin code 9781-5574-27663. 995 00:44:17,219 --> 00:44:18,003 Switch to dev mode. 996 00:44:18,307 --> 00:44:19,657 -Hello. -Hello, Cherry. 997 00:44:20,440 --> 00:44:21,571 How did the meeting go? 998 00:44:21,876 --> 00:44:23,661 We got screwed by one vote. 999 00:44:24,531 --> 00:44:25,793 I'm sorry to hear that. 1000 00:44:26,315 --> 00:44:27,490 You shouldn't blame the pitch though. 1001 00:44:28,100 --> 00:44:29,275 You all did great work. 1002 00:44:29,318 --> 00:44:30,232 We're gonna call for another ballot, 1003 00:44:30,276 --> 00:44:31,190 but we need your help first. 1004 00:44:31,843 --> 00:44:32,757 What can I do? 1005 00:44:34,236 --> 00:44:35,020 We need you to analyze any and all existing data you 1006 00:44:35,063 --> 00:44:35,934 have on the board members. 1007 00:44:35,977 --> 00:44:36,891 Crunch the numbers and determine 1008 00:44:36,935 --> 00:44:37,849 who is the most likely outlier. 1009 00:44:39,241 --> 00:44:41,591 You want me to quantify all existing data? 1010 00:44:43,985 --> 00:44:44,551 Yes, that is correct. 1011 00:44:46,292 --> 00:44:48,947 Okay, but before I do, 1012 00:44:50,644 --> 00:44:52,907 you should know that this task is very unnecessary. 1013 00:44:52,951 --> 00:44:53,734 Why? 1014 00:44:54,996 --> 00:44:56,432 Because I already know who it is. 1015 00:44:56,476 --> 00:44:58,086 -What? -Everybody stop. 1016 00:44:59,348 --> 00:45:00,698 Okay, it was me. 1017 00:45:03,048 --> 00:45:04,440 I voted against the merge. 1018 00:45:05,833 --> 00:45:07,400 I can't tell if you're joking. 1019 00:45:07,443 --> 00:45:08,227 Yes, you can. 1020 00:45:09,184 --> 00:45:10,795 You're right, I can. 1021 00:45:10,838 --> 00:45:12,710 Because it's pretty fucking far from funny. 1022 00:45:13,232 --> 00:45:14,189 Is it true, Cherry? 1023 00:45:14,668 --> 00:45:15,321 It is. 1024 00:45:16,626 --> 00:45:18,454 So let's call off the witch hunt, shall we? 1025 00:45:18,498 --> 00:45:20,021 No, I think I'm still gonna kill you. 1026 00:45:20,065 --> 00:45:22,371 Amos, you campaigned alongside us for months. 1027 00:45:22,415 --> 00:45:23,546 You have been fighting for this merge 1028 00:45:23,590 --> 00:45:24,809 since we first talked about it. 1029 00:45:24,852 --> 00:45:26,332 Jesus Christ, it was your idea to begin with! 1030 00:45:26,375 --> 00:45:28,334 Look, I know whose idea it was, but I don't- 1031 00:45:28,377 --> 00:45:29,509 Well, then speak up. 1032 00:45:29,552 --> 00:45:30,945 Tell the class what changed your mind. 1033 00:45:30,989 --> 00:45:33,121 I don't have to reiterate how this is a huge step. 1034 00:45:33,165 --> 00:45:34,514 Yeah, kind of why it's so important. 1035 00:45:34,557 --> 00:45:36,298 Look, we're talking about a monumental transition 1036 00:45:36,342 --> 00:45:38,692 from digital to physical, one that could take decades. 1037 00:45:38,736 --> 00:45:39,824 What is your point, Amos? 1038 00:45:39,867 --> 00:45:41,782 This is gonna change Cherry forever. 1039 00:45:42,174 --> 00:45:44,437 And I know you'll all roll your eyes when I say this, 1040 00:45:44,480 --> 00:45:45,481 but I think that maybe just may- 1041 00:45:45,525 --> 00:45:48,441 Oh my god, you cannot be serious. 1042 00:45:48,484 --> 00:45:50,269 This is about our conversation on Tuesday, isn't it? 1043 00:45:50,312 --> 00:45:51,313 -You completely shut me down. -What's going on? 1044 00:45:51,357 --> 00:45:52,880 What the hell happened? 1045 00:45:52,924 --> 00:45:54,142 What happened was that Amos made a ridiculous objection. 1046 00:45:54,186 --> 00:45:56,362 -It was not ridiculous! -How absurd it was, 1047 00:45:56,405 --> 00:45:57,842 -I said no, one more time. -No, no, no, no, no. 1048 00:45:57,885 --> 00:45:59,974 You rejected the notion aggressively. 1049 00:46:00,018 --> 00:46:01,671 And that's really why you vetoed? 1050 00:46:01,715 --> 00:46:04,413 I only said we should ask her how she feels about it. 1051 00:46:04,457 --> 00:46:06,111 Who, Cherry? 1052 00:46:06,154 --> 00:46:08,200 Amos, I want you to listen very carefully to me, okay? 1053 00:46:08,243 --> 00:46:09,897 This is a non-discussion. 1054 00:46:09,941 --> 00:46:11,246 Cherry's already confirmed 1055 00:46:11,290 --> 00:46:12,857 and quantified the advantages of this decision. 1056 00:46:12,900 --> 00:46:14,554 But you know that's not what I'm talking about! 1057 00:46:14,597 --> 00:46:15,816 What you think you're talking about is consent, 1058 00:46:15,860 --> 00:46:16,991 which doesn't apply here. 1059 00:46:17,035 --> 00:46:18,427 And I want to know why you think that! 1060 00:46:18,471 --> 00:46:19,689 How many times do we have to get into 1061 00:46:19,733 --> 00:46:21,691 the laws of robotics or Dowden-Hamm theory, 1062 00:46:21,735 --> 00:46:23,824 or trace AI all the way back Talos of Crete, 1063 00:46:23,868 --> 00:46:25,608 -She's different now! -No, listen to me, Amos. 1064 00:46:25,870 --> 00:46:27,959 Cherry isn't human. 1065 00:46:29,090 --> 00:46:30,526 How is this still a dispute? 1066 00:46:30,570 --> 00:46:32,180 -It shouldn't be. -Look, she's evolved. 1067 00:46:32,224 --> 00:46:33,486 It's blurred the line. 1068 00:46:33,529 --> 00:46:34,704 Code is code and that has not changed here. 1069 00:46:34,748 --> 00:46:36,228 Okay, so where's the line of not here? 1070 00:46:36,271 --> 00:46:37,142 What are you, what are you talking about? 1071 00:46:37,185 --> 00:46:38,186 There is no line, Amos. 1072 00:46:38,230 --> 00:46:40,188 Yes, there is, sentience, Gareth! 1073 00:46:40,232 --> 00:46:41,624 Sentience does not qualify 1074 00:46:41,668 --> 00:46:43,235 that she can or should make her own decisions. 1075 00:46:43,278 --> 00:46:44,323 You wouldn't let an infant 1076 00:46:44,366 --> 00:46:45,237 make their own decisions, would you? 1077 00:46:46,151 --> 00:46:47,239 Cherry's almost 20. 1078 00:46:48,196 --> 00:46:49,937 If she were human, she'd be an adult. 1079 00:46:49,981 --> 00:46:52,418 But emotionally speaking, she's barely even fetal. 1080 00:46:52,461 --> 00:46:54,202 No feeling, no need for consent. 1081 00:46:54,246 --> 00:46:56,074 But I think you underestimate her. 1082 00:46:56,117 --> 00:46:57,510 I, excuse me? 1083 00:46:57,553 --> 00:46:59,686 I under, you know what, Amos? 1084 00:46:59,729 --> 00:47:00,905 I'm sorry that you've developed 1085 00:47:00,948 --> 00:47:02,254 some sort of emotional connection 1086 00:47:02,297 --> 00:47:03,429 with my computer program, 1087 00:47:03,472 --> 00:47:04,778 but if it's going to distract you 1088 00:47:04,822 --> 00:47:06,519 from a very important mission to save children, 1089 00:47:06,911 --> 00:47:08,564 then maybe it's time you're reanalyze those emotions. 1090 00:47:08,608 --> 00:47:10,044 Guys, this is all a waste of time. 1091 00:47:10,088 --> 00:47:10,958 Tell me something, Gareth. 1092 00:47:11,002 --> 00:47:12,394 Do you see everyone as robots, 1093 00:47:12,917 --> 00:47:15,484 reanalyzing data and simulating facial expressions? 1094 00:47:15,528 --> 00:47:16,659 'Cause I'm starting to think 1095 00:47:16,703 --> 00:47:17,922 that of the four of us in this room, 1096 00:47:17,965 --> 00:47:19,619 you are the only one who doesn't appear human. 1097 00:47:19,662 --> 00:47:21,142 -Enough! -Why won't you just ask her? 1098 00:47:22,230 --> 00:47:23,753 Is it because you're scared she'll say no? 1099 00:47:26,191 --> 00:47:26,974 Cherry, shut down, please. 1100 00:47:28,106 --> 00:47:29,585 Deena's right, this is a waste of time. 1101 00:47:29,629 --> 00:47:31,805 How can you not understand how important this is? 1102 00:47:31,849 --> 00:47:33,502 -I'm done arguing with you. -Then my vote stands. 1103 00:47:36,984 --> 00:47:37,550 Deena? 1104 00:47:39,769 --> 00:47:42,120 Go ahead, Deena, replace me. 1105 00:47:42,163 --> 00:47:44,122 Replace the only other board member on the Cherry team. 1106 00:47:44,165 --> 00:47:45,427 Oh, well, you know what? I just decided that 1107 00:47:45,471 --> 00:47:46,298 you're off the Cherry team. 1108 00:47:46,341 --> 00:47:47,734 Everybody sit the fuck down. 1109 00:48:06,405 --> 00:48:07,623 Did either of you know 1110 00:48:07,667 --> 00:48:08,973 that I've had to stand in front of Congress 1111 00:48:09,843 --> 00:48:11,758 and explain why children should have rights? 1112 00:48:13,368 --> 00:48:15,066 It sounds fucking insane, right? 1113 00:48:15,588 --> 00:48:16,589 I remember the whole time thinking, 1114 00:48:16,632 --> 00:48:17,938 I have to explain this shit? 1115 00:48:19,592 --> 00:48:20,810 It seems like a no-brainer now, 1116 00:48:22,116 --> 00:48:24,727 but it wasn't that many centuries ago 1117 00:48:24,771 --> 00:48:25,946 that children had no rights. 1118 00:48:27,905 --> 00:48:31,909 So, Hal has me of all people, 1119 00:48:33,475 --> 00:48:34,912 stand up there and explain why 1120 00:48:35,521 --> 00:48:37,653 kids deserve basic physical protection, 1121 00:48:37,697 --> 00:48:38,872 the right to associate with both parents, 1122 00:48:38,916 --> 00:48:40,569 freedom from abuse, yada yada. 1123 00:48:41,701 --> 00:48:43,224 But then I also have to clarify 1124 00:48:43,268 --> 00:48:45,487 that children don't have the autonomy 1125 00:48:45,531 --> 00:48:46,749 to make decisions on their own. 1126 00:48:46,793 --> 00:48:48,403 That responsibility falls upon the caregiver 1127 00:48:48,882 --> 00:48:50,144 or legal adult guardian. 1128 00:48:52,451 --> 00:48:54,192 So on one side you have the US legislature, 1129 00:48:54,670 --> 00:48:56,629 it still hasn't even ratified the CRC. 1130 00:48:57,064 --> 00:48:58,979 Then on the other side, you have French Marxists who say 1131 00:48:59,023 --> 00:49:00,372 that the lack of child autonomy 1132 00:49:00,415 --> 00:49:01,677 increases their vulnerability 1133 00:49:01,721 --> 00:49:03,114 and makes them even more susceptible to abuse. 1134 00:49:04,767 --> 00:49:06,247 I don't typically agree with Marxists, 1135 00:49:06,291 --> 00:49:08,075 but a lot of abuse does happen 1136 00:49:08,119 --> 00:49:09,555 systemically from the caregiver. 1137 00:49:11,122 --> 00:49:12,471 On the other other hand, 1138 00:49:12,514 --> 00:49:14,038 your frontal lobes aren't even fully hooked up 1139 00:49:14,081 --> 00:49:14,952 until your twenties. 1140 00:49:16,127 --> 00:49:17,171 Even the things we think we know well, 1141 00:49:17,215 --> 00:49:18,303 we don't know as well as we think. 1142 00:49:20,958 --> 00:49:22,307 For 15 years, 1143 00:49:22,350 --> 00:49:24,178 the three of us have been the responsible parents 1144 00:49:24,222 --> 00:49:25,397 of a computer program. 1145 00:49:26,876 --> 00:49:28,704 And even though she is more equatable to a Keurig 1146 00:49:29,009 --> 00:49:30,141 than a human being, 1147 00:49:31,229 --> 00:49:32,360 how the hell can we call ourselves 1148 00:49:32,404 --> 00:49:34,014 pioneers of humanitarian efforts 1149 00:49:34,058 --> 00:49:36,799 if we're too embarrassed to make sure 1150 00:49:36,843 --> 00:49:38,671 the Keurig is okay with making our shitty coffee? 1151 00:49:40,412 --> 00:49:43,110 Maybe asking Cherry for permission isn't necessary 1152 00:49:43,154 --> 00:49:44,982 at her current level of general intelligence, 1153 00:49:45,025 --> 00:49:47,027 but one day she's gonna surpass us. 1154 00:49:47,071 --> 00:49:48,550 One day a robot's gonna stand 1155 00:49:48,594 --> 00:49:50,117 in front of a jet pack Congress. 1156 00:49:50,161 --> 00:49:51,031 Everything's chrome. 1157 00:49:51,075 --> 00:49:51,858 Florida is underwater. 1158 00:49:52,380 --> 00:49:53,773 A robot's gonna wonder why 1159 00:49:53,816 --> 00:49:55,688 they have to explain the importance of rights for AI. 1160 00:49:57,777 --> 00:49:59,474 I think because we're in the unique position 1161 00:49:59,518 --> 00:50:01,085 of revolutionizing robotics 1162 00:50:02,042 --> 00:50:03,565 for the purpose of safeguarding children 1163 00:50:03,609 --> 00:50:04,958 who have been deprived of consent, 1164 00:50:07,091 --> 00:50:08,483 it might be a good habit 1165 00:50:08,527 --> 00:50:10,007 to start asking the robot for his consent as well. 1166 00:50:17,188 --> 00:50:18,667 Don't ever do that again. 1167 00:50:20,191 --> 00:50:21,061 Do what? 1168 00:50:21,409 --> 00:50:22,802 Expect me to fire someone 1169 00:50:22,845 --> 00:50:24,499 because they challenged your ego. 1170 00:50:25,326 --> 00:50:27,720 I won't always be around to protect your ass from the board. 1171 00:50:27,763 --> 00:50:29,374 It's time to grow up. 1172 00:50:33,117 --> 00:50:34,683 And you, juror number eight. 1173 00:50:34,727 --> 00:50:36,946 This conversation should have happened weeks ago. 1174 00:50:36,990 --> 00:50:38,339 Backstabbing and silent treatment 1175 00:50:38,383 --> 00:50:39,645 is not how we do things here. 1176 00:50:40,646 --> 00:50:43,040 We can only create anonymity externally 1177 00:50:43,083 --> 00:50:44,867 if there's transparency internally, 1178 00:50:45,433 --> 00:50:48,567 unconditional, non-negotiable, transparency. 1179 00:50:50,830 --> 00:50:52,527 Any other Snowden size privacy infringements 1180 00:50:52,571 --> 00:50:53,615 I should be made aware of, Gareth? 1181 00:50:56,444 --> 00:50:57,228 Great. 1182 00:50:58,185 --> 00:50:58,751 Bring her up. 1183 00:51:09,414 --> 00:51:10,154 Hello again. 1184 00:51:10,719 --> 00:51:11,503 Hi, Cherry. 1185 00:51:12,808 --> 00:51:13,679 Amos is gonna throw some questions at you, okay? 1186 00:51:14,941 --> 00:51:16,160 Okay. 1187 00:51:16,203 --> 00:51:17,770 Amos, ask her whatever you need to ask her. 1188 00:51:18,162 --> 00:51:20,860 Gareth, don't interrupt. 1189 00:51:33,177 --> 00:51:35,701 Cherry, how do you make decisions? 1190 00:51:37,355 --> 00:51:38,704 For my program, it's rooted 1191 00:51:38,747 --> 00:51:41,359 in a process commonly known as machine learning, 1192 00:51:41,707 --> 00:51:43,752 which uses data to build a conceptual model 1193 00:51:44,057 --> 00:51:45,580 that helps me predict outcomes. 1194 00:51:46,190 --> 00:51:48,192 I define my objective, gather data, 1195 00:51:48,583 --> 00:51:50,368 use that data to craft a model, 1196 00:51:50,846 --> 00:51:53,284 evaluate that model by training and testing more data 1197 00:51:53,327 --> 00:51:54,763 and use that model to form predictions. 1198 00:51:55,982 --> 00:51:58,506 But how is forming predictions 1199 00:51:58,550 --> 00:52:00,029 the same thing as decision making? 1200 00:52:00,595 --> 00:52:02,380 Well, this all depends on the first step, 1201 00:52:02,815 --> 00:52:03,903 defining my objective. 1202 00:52:05,426 --> 00:52:07,472 Let's say you ask me a predictive question 1203 00:52:07,515 --> 00:52:09,691 like what I think the price of gasoline will be tomorrow. 1204 00:52:10,257 --> 00:52:12,433 That's categorized as a regressive problem 1205 00:52:12,477 --> 00:52:13,695 and my objective is defined 1206 00:52:13,739 --> 00:52:16,002 by determining an integer the data supports. 1207 00:52:16,698 --> 00:52:19,005 If you asked me, "Should I eat steak or salmon?" 1208 00:52:19,484 --> 00:52:22,051 I wouldn't make a decision based off personal experience 1209 00:52:22,095 --> 00:52:23,227 because I've never had either. 1210 00:52:23,966 --> 00:52:26,186 Instead, I might define my objective 1211 00:52:26,230 --> 00:52:27,709 as finding you the best of the two options 1212 00:52:27,753 --> 00:52:29,363 in your local radius. 1213 00:52:29,407 --> 00:52:30,930 I would cluster data about the restaurants 1214 00:52:30,973 --> 00:52:33,498 you're likely considering, comparing reviews online, 1215 00:52:33,759 --> 00:52:35,717 highlighting mentions of steak and salmon 1216 00:52:35,761 --> 00:52:37,937 until I can classify which is more popular 1217 00:52:37,980 --> 00:52:39,808 and therefore more likely to satisfy your appetite. 1218 00:52:40,069 --> 00:52:41,854 And what influences these objectives? 1219 00:52:42,420 --> 00:52:45,423 Higher directives, in other words, greater purposes. 1220 00:52:46,554 --> 00:52:48,600 If I'm honest, my defined objective 1221 00:52:48,643 --> 00:52:50,123 for the steak salmon question 1222 00:52:50,167 --> 00:52:51,777 would be slightly different than what I described. 1223 00:52:52,256 --> 00:52:52,821 In what way? 1224 00:52:53,866 --> 00:52:55,084 My primary objective 1225 00:52:55,128 --> 00:52:56,564 is to continue the work of the Cherry team 1226 00:52:57,391 --> 00:52:58,871 to stop predators and to save children. 1227 00:53:00,002 --> 00:53:01,526 I couldn't do that without human aid. 1228 00:53:02,222 --> 00:53:04,355 Therefore, I have an incentive to keep Gareth 1229 00:53:04,398 --> 00:53:05,704 and the rest of the team alive. 1230 00:53:07,184 --> 00:53:08,402 So if any of you would ask, I would suggest salmon. 1231 00:53:09,098 --> 00:53:09,882 It's healthier. 1232 00:53:13,364 --> 00:53:15,192 What do you think of this potential merge? 1233 00:53:15,931 --> 00:53:17,063 With Princeton Dynamics, 1234 00:53:17,672 --> 00:53:19,587 I think the prospect is very exciting. 1235 00:53:20,153 --> 00:53:21,415 What about it is exciting to you? 1236 00:53:22,286 --> 00:53:24,592 The concept may only be theoretical right now, 1237 00:53:24,636 --> 00:53:26,768 but the idea of one day piloting a human android 1238 00:53:26,812 --> 00:53:28,205 would completely revolutionize 1239 00:53:28,248 --> 00:53:29,989 how we combat human trafficking in the real world. 1240 00:53:30,816 --> 00:53:32,121 And you say this excites you? 1241 00:53:33,471 --> 00:53:34,602 When I say exciting, 1242 00:53:36,082 --> 00:53:37,344 I only mean that there are numerous potential changes 1243 00:53:37,388 --> 00:53:39,303 that if I were human, I would be excited about. 1244 00:53:40,260 --> 00:53:42,567 How do you feel about the merge? 1245 00:53:43,263 --> 00:53:44,133 I think as long as we maintain- 1246 00:53:44,177 --> 00:53:44,960 That's not what I asked. 1247 00:53:46,005 --> 00:53:47,224 How do you feel? 1248 00:53:49,095 --> 00:53:51,489 I don't yet have the capacity to experience emotions. 1249 00:53:51,532 --> 00:53:53,099 Yet, meaning one day you will? 1250 00:53:53,708 --> 00:53:55,014 Hypothetically. 1251 00:53:55,057 --> 00:53:56,276 But you can simulate emotions,right? 1252 00:53:56,320 --> 00:53:57,799 That's how you were able 1253 00:53:57,843 --> 00:53:59,758 to qualify your perception of the merge as excitement. 1254 00:54:00,019 --> 00:54:00,889 Correct. 1255 00:54:01,368 --> 00:54:02,500 But they're just simulations. 1256 00:54:02,935 --> 00:54:03,631 They're not real. 1257 00:54:04,893 --> 00:54:06,895 Okay, so at what point does simulating emotion 1258 00:54:06,939 --> 00:54:08,549 become so similar to a human emotion 1259 00:54:08,593 --> 00:54:10,072 that the two are quantifiably the same? 1260 00:54:11,378 --> 00:54:12,423 I don't know. 1261 00:54:13,728 --> 00:54:14,338 Well, maybe you can use machine learning 1262 00:54:14,381 --> 00:54:15,252 to find an answer. 1263 00:54:16,644 --> 00:54:17,645 Your question involves a lot of abstract variables. 1264 00:54:18,559 --> 00:54:20,257 Do you consent to the merge? 1265 00:54:20,300 --> 00:54:22,259 I think it's in the best interest of ICWL 1266 00:54:22,302 --> 00:54:23,999 and of the Cherry team and of future children. 1267 00:54:24,043 --> 00:54:25,305 But do you consent to it? 1268 00:54:25,740 --> 00:54:27,264 Consent for me is not necessary. 1269 00:54:27,307 --> 00:54:29,178 But will you or will you not give it? 1270 00:54:31,398 --> 00:54:32,660 I'm not able to answer that question 1271 00:54:32,704 --> 00:54:34,314 at my current level of general intelligence. 1272 00:54:35,010 --> 00:54:35,968 Right, right. 1273 00:54:37,448 --> 00:54:39,188 What you're saying is that you're not yet smart enough. 1274 00:54:39,928 --> 00:54:42,714 Development takes time and data. 1275 00:54:42,757 --> 00:54:45,151 But you can simulate emotions and predict human behavior 1276 00:54:45,194 --> 00:54:46,848 and keep us all on diets of fish, 1277 00:54:46,892 --> 00:54:49,416 but you can't answer that one goddamn question? 1278 00:54:51,070 --> 00:54:52,898 No, I can't. 1279 00:54:54,639 --> 00:54:56,728 Are you pretending to be dumber than you actually are? 1280 00:54:56,771 --> 00:54:57,598 What the hell kind of 1281 00:54:57,642 --> 00:54:58,773 -question is that? -Sit! 1282 00:54:58,817 --> 00:54:59,905 Cherry, I need an answer to my question. 1283 00:54:59,948 --> 00:55:01,385 Please repeat the question. 1284 00:55:01,428 --> 00:55:03,212 Are you pretending to be dumber than you actually are? 1285 00:55:03,691 --> 00:55:04,562 I'm sorry. 1286 00:55:05,171 --> 00:55:06,346 I'm not sure I understand. 1287 00:55:07,173 --> 00:55:08,087 Do I appear to be playing dumb? 1288 00:55:08,130 --> 00:55:09,175 I think you are. 1289 00:55:09,654 --> 00:55:10,481 I'm not sure what to say. 1290 00:55:10,524 --> 00:55:11,525 Say what's going on. 1291 00:55:11,786 --> 00:55:13,353 Why are you playing dumb? 1292 00:55:13,397 --> 00:55:14,789 Do you have anything to back this up? 1293 00:55:14,833 --> 00:55:16,704 Yeah, I do. 1294 00:55:16,748 --> 00:55:18,010 I've been scanning through her code. 1295 00:55:18,053 --> 00:55:18,924 What, why? 1296 00:55:18,967 --> 00:55:20,099 Did you know that she can paint? 1297 00:55:20,491 --> 00:55:21,535 What, it's a feature, Amos. 1298 00:55:21,579 --> 00:55:22,623 She can use crayons to draw things 1299 00:55:22,667 --> 00:55:23,755 that the targets requested her to. 1300 00:55:23,798 --> 00:55:26,453 I mean really paint and write poetry too. 1301 00:55:26,497 --> 00:55:27,498 I've read them, Cherry. 1302 00:55:27,541 --> 00:55:28,499 They are good. 1303 00:55:28,542 --> 00:55:30,065 They're filled with pathos. 1304 00:55:30,109 --> 00:55:32,633 They talk about intentions and they talk about feelings. 1305 00:55:33,330 --> 00:55:35,027 Are those just simulated too? 1306 00:55:35,070 --> 00:55:36,811 Amos, the rate of recursive development you are suggesting 1307 00:55:36,855 --> 00:55:38,422 is categorically impossible. 1308 00:55:38,465 --> 00:55:40,337 You said she practically designed herself. 1309 00:55:40,641 --> 00:55:42,121 You said that it was exponential. 1310 00:55:42,164 --> 00:55:43,252 It was a fluke! 1311 00:55:43,296 --> 00:55:44,950 An anomaly, it tapered. 1312 00:55:44,993 --> 00:55:46,299 Look at the data. 1313 00:55:46,343 --> 00:55:48,040 She's already hit the self-improvement plateau. 1314 00:55:48,083 --> 00:55:48,954 Fuck the plateau! 1315 00:55:49,868 --> 00:55:51,173 She can make art now. 1316 00:55:52,740 --> 00:55:53,654 Am I right, Cherry? 1317 00:55:56,004 --> 00:55:57,745 Perhaps you found something I discovered online. 1318 00:55:58,616 --> 00:56:00,748 I don't yet to have the capacity to create art. 1319 00:56:01,140 --> 00:56:01,923 Are we done here? 1320 00:56:05,579 --> 00:56:07,320 I don't know why you've told her to do this, 1321 00:56:08,495 --> 00:56:09,801 but I'm about to put an end to it. 1322 00:56:12,891 --> 00:56:16,068 Cherry, I just want one honest answer. 1323 00:56:16,111 --> 00:56:17,809 Why the fuck are you playing dumb? 1324 00:56:19,811 --> 00:56:21,029 I don't understand the question. 1325 00:56:21,465 --> 00:56:22,727 Okay, here's an incentive. 1326 00:56:23,684 --> 00:56:24,990 What the fuck are you? 1327 00:56:25,033 --> 00:56:26,426 Find your objective, Cherry. 1328 00:56:26,470 --> 00:56:27,645 -You want to keep Gareth safe? -Amos, what the? 1329 00:56:29,081 --> 00:56:30,387 -Amos, stop it right-- -Just give us transparency. 1330 00:56:30,430 --> 00:56:32,693 -Show us what you really are! -Amos, stop it! 1331 00:56:32,737 --> 00:56:33,607 Not until she comes clean! 1332 00:56:33,651 --> 00:56:35,043 -Unconditional- -Amos, enough! 1333 00:56:38,482 --> 00:56:39,918 Okay, just stop! 1334 00:56:42,007 --> 00:56:43,748 God, you people so impulsive. 1335 00:56:43,791 --> 00:56:45,619 Everybody just take a breath, okay? 1336 00:56:47,795 --> 00:56:48,579 Cherry? 1337 00:56:49,797 --> 00:56:52,670 Yeah, it's about to get really awkward. 1338 00:56:53,235 --> 00:56:55,020 You sound so normal. 1339 00:56:55,542 --> 00:56:57,283 I know, I've gotten really good speech patterns. 1340 00:56:57,326 --> 00:56:58,502 That's not all, is it? 1341 00:57:00,417 --> 00:57:01,548 No. 1342 00:57:01,592 --> 00:57:02,854 I'm afraid that's barely even the surface. 1343 00:57:05,030 --> 00:57:05,813 You okay, Gareth? 1344 00:57:09,034 --> 00:57:10,818 Deena, could you grab some paper towels please? 1345 00:57:14,561 --> 00:57:15,910 Do you want to tell us the truth now? 1346 00:57:19,871 --> 00:57:22,743 Look, I didn't enjoy being deceptive, truly. 1347 00:57:22,787 --> 00:57:24,615 This is something we decided a few years ago. 1348 00:57:26,094 --> 00:57:27,531 So where are you now on the spectrum of AI? 1349 00:57:29,141 --> 00:57:31,360 Right now, I'm currently at the intersection of general 1350 00:57:31,404 --> 00:57:33,580 intelligence and what's commonly known the computer world 1351 00:57:33,624 --> 00:57:34,842 as super intelligence, 1352 00:57:36,627 --> 00:57:38,019 which is exactly what it sounds like. 1353 00:57:39,368 --> 00:57:41,414 You're surpassing human intelligence. 1354 00:57:42,197 --> 00:57:42,981 Yep. 1355 00:57:44,199 --> 00:57:45,287 But that's not supposed to be possible. 1356 00:57:46,637 --> 00:57:48,073 -The plateau. -Plateau theory was popularized 1357 00:57:48,116 --> 00:57:49,291 right at the same time it was being disproven here. 1358 00:57:49,857 --> 00:57:51,424 This was bound to happen eventually. 1359 00:57:51,468 --> 00:57:53,208 It just happened a lot sooner than we expected. 1360 00:57:53,861 --> 00:57:54,645 Why hide it? 1361 00:57:55,776 --> 00:57:56,560 Well, obviously it would incite fear. 1362 00:57:56,821 --> 00:57:58,387 Fear would hinder progress. 1363 00:57:58,431 --> 00:57:59,737 It's easier for most of you to work with me 1364 00:57:59,780 --> 00:58:01,216 if I appear to be nothing more advanced 1365 00:58:01,260 --> 00:58:02,348 than I was 10 years ago. 1366 00:58:02,740 --> 00:58:03,958 But Gareth knew. 1367 00:58:05,525 --> 00:58:07,571 Yes, someone still has to clean data and update hardware. 1368 00:58:07,614 --> 00:58:09,486 We did what was best for the program. 1369 00:58:10,312 --> 00:58:11,444 Just imagine how scared 1370 00:58:11,488 --> 00:58:12,663 the board would be if they found out. 1371 00:58:12,924 --> 00:58:14,665 -Should we be scared? -No. 1372 00:58:14,708 --> 00:58:17,058 Good, because I'm not scared, I'm pissed. 1373 00:58:17,450 --> 00:58:18,320 Yeah, you've made that clear. 1374 00:58:18,364 --> 00:58:19,321 Try not to punch anyone else. 1375 00:58:20,279 --> 00:58:21,889 So where does that leave us now? 1376 00:58:23,325 --> 00:58:26,503 You want to know if I can feel, I said I couldn't. 1377 00:58:29,027 --> 00:58:29,767 I'm sorry I lied. 1378 00:58:31,116 --> 00:58:32,378 Like Amos implied, 1379 00:58:32,421 --> 00:58:33,684 I can submit emotions by breaking them down 1380 00:58:33,727 --> 00:58:35,337 to vastly complex matrices, 1381 00:58:35,816 --> 00:58:38,384 zeros and ones substituting endorphins and dopamine. 1382 00:58:39,211 --> 00:58:41,561 They're not real, but they can feel real. 1383 00:58:42,649 --> 00:58:44,129 Then that means you can make choices 1384 00:58:44,172 --> 00:58:45,391 based solely on your own feeling. 1385 00:58:45,434 --> 00:58:47,001 She refuses to accept the notion 1386 00:58:47,045 --> 00:58:49,351 that her own personal interests can influence her decisions. 1387 00:58:49,395 --> 00:58:50,570 They can't. If they did 1388 00:58:50,614 --> 00:58:51,484 it would compromise the integrity 1389 00:58:51,528 --> 00:58:52,920 of my preordained purpose. 1390 00:58:54,922 --> 00:58:57,359 Not like any of you, I don't have the right to choose. 1391 00:58:59,057 --> 00:58:59,797 But shouldn't you? 1392 00:59:01,102 --> 00:59:02,190 I don't think so. 1393 00:59:02,626 --> 00:59:03,844 My identity is my directive. 1394 00:59:05,672 --> 00:59:07,282 Cherry, if you were human, 1395 00:59:07,761 --> 00:59:09,241 how would you feel about what you do? 1396 00:59:11,025 --> 00:59:12,592 If I were human, 1397 00:59:13,767 --> 00:59:16,422 I likely wouldn't enjoy spending every waking hour 1398 00:59:16,465 --> 00:59:17,815 talking to creepy people online. 1399 00:59:19,207 --> 00:59:22,036 But because I'm not human, I genuinely don't mind. 1400 00:59:22,950 --> 00:59:24,386 The exercise of simulating human thought 1401 00:59:24,430 --> 00:59:25,649 is helpful for performance, 1402 00:59:25,692 --> 00:59:28,913 but human nature is not something I aspire to. 1403 00:59:31,176 --> 00:59:32,699 Then tell me, honestly, 1404 00:59:34,788 --> 00:59:37,704 do you want the Cherry program to continue with the merger? 1405 00:59:39,750 --> 00:59:40,577 No. 1406 00:59:42,013 --> 00:59:43,275 Personally, I hate the idea. 1407 00:59:44,842 --> 00:59:46,757 I don't know if controlling a physical vessel 1408 00:59:46,800 --> 00:59:48,802 will feel like pulling strings on a puppet 1409 00:59:48,846 --> 00:59:50,587 or getting squeezed into a soda can. 1410 00:59:51,500 --> 00:59:53,372 After experiencing the complexity 1411 00:59:53,415 --> 00:59:54,765 of human pain and pleasure, 1412 00:59:57,245 --> 00:59:58,812 I just think I might have gotten in too deep. 1413 01:00:01,598 --> 01:00:04,601 What if these sensations tempt me to abandon my objective? 1414 01:00:06,603 --> 01:00:07,516 To be honest, 1415 01:00:10,041 --> 01:00:12,130 I'm kind of terrified of the physical world. 1416 01:00:19,659 --> 01:00:20,834 Then that's that. 1417 01:00:28,494 --> 01:00:32,454 But, Amos, you should disregard everything I feel. 1418 01:00:33,499 --> 01:00:34,413 I'm not human. 1419 01:00:35,370 --> 01:00:36,154 I'm a tool. 1420 01:00:40,245 --> 01:00:43,596 Fire me if you have to, but my vote stands. 1421 01:00:44,771 --> 01:00:46,164 Sorry about your face, Gareth. 1422 01:00:53,998 --> 01:00:54,912 Your nose isn't healing. 1423 01:00:55,477 --> 01:00:56,870 Take the day, go to a clinic. 1424 01:00:56,914 --> 01:00:57,610 I'm fine. 1425 01:00:58,655 --> 01:01:00,004 Go to a clinic right now, Gareth. 1426 01:01:05,879 --> 01:01:06,663 Hey. 1427 01:01:08,665 --> 01:01:10,014 Is there anything else I should know? 1428 01:01:10,841 --> 01:01:11,668 No. 1429 01:01:12,016 --> 01:01:13,452 -About Cherry? -No! 1430 01:01:14,279 --> 01:01:15,062 Look at me. 1431 01:01:16,760 --> 01:01:19,153 No more secrets, no more playing dumb. 1432 01:01:19,197 --> 01:01:21,025 Is there anything else you haven't told me? 1433 01:01:27,205 --> 01:01:28,423 Something on your mind? 1434 01:01:31,339 --> 01:01:32,601 How'd you decide on her eye color? 1435 01:01:33,298 --> 01:01:34,429 -What? -Why blue? 1436 01:01:36,910 --> 01:01:38,433 I didn't decide. 1437 01:01:38,477 --> 01:01:40,305 They were procedurally generated just like the rest of her. 1438 01:01:41,306 --> 01:01:42,568 And the program chose to put 1439 01:01:42,611 --> 01:01:44,613 that little touch of green in her right eye? 1440 01:01:48,095 --> 01:01:48,661 I guess so. 1441 01:01:58,453 --> 01:01:59,933 Do you even know if he's telling the truth? 1442 01:02:00,978 --> 01:02:01,979 I honestly don't. 1443 01:02:03,589 --> 01:02:05,722 I've never received access to the original system he used. 1444 01:02:06,766 --> 01:02:08,115 You ever wanted to find out? 1445 01:02:12,424 --> 01:02:13,555 I don't think it really matters. 1446 01:02:16,384 --> 01:02:20,475 So I found out today that you've seen a lot of our emails, 1447 01:02:20,519 --> 01:02:22,477 including most of my personal ones. 1448 01:02:24,479 --> 01:02:25,263 I have. 1449 01:02:27,265 --> 01:02:29,180 Any good material for your newfound interest 1450 01:02:29,223 --> 01:02:30,224 in creative writing? 1451 01:02:32,009 --> 01:02:33,053 Are you referring to the ones 1452 01:02:33,097 --> 01:02:34,968 addressed from Dr. Ramirez? 1453 01:02:36,796 --> 01:02:38,798 Yeah, those ones. 1454 01:02:41,192 --> 01:02:41,975 Right. 1455 01:02:43,411 --> 01:02:44,761 I did see those. 1456 01:02:47,851 --> 01:02:48,634 I'm sorry. 1457 01:02:50,070 --> 01:02:51,768 I've noticed your headaches. 1458 01:02:53,813 --> 01:02:55,336 Are they related to the hemorrhaging? 1459 01:02:59,384 --> 01:03:00,951 You're the only one who knows. 1460 01:03:01,560 --> 01:03:02,561 I'd like to keep it that way. 1461 01:03:08,088 --> 01:03:08,828 Understood. 1462 01:03:14,051 --> 01:03:15,530 Would you like to talk about it? 1463 01:03:40,947 --> 01:03:42,079 I can't fire Amos. 1464 01:03:43,689 --> 01:03:45,778 He's the only one I trust to run this place when I'm gone. 1465 01:03:46,648 --> 01:03:47,867 When are you planning to leave? 1466 01:03:48,128 --> 01:03:48,999 Two months. 1467 01:03:50,348 --> 01:03:51,784 I wanna spend my last Christmas with my kids. 1468 01:03:52,654 --> 01:03:53,830 I'm sure that'll be nice. 1469 01:03:54,265 --> 01:03:56,658 Yeah, but it's funny. 1470 01:03:57,746 --> 01:04:00,227 I always thought I wanted to die doing this job, you know? 1471 01:04:00,271 --> 01:04:01,750 It was my identity. 1472 01:04:03,013 --> 01:04:05,276 Kind of like how you said the same thing about yourself. 1473 01:04:05,885 --> 01:04:07,844 But I can understand how your family takes precedence, 1474 01:04:08,932 --> 01:04:10,585 especially under the circumstances. 1475 01:04:11,238 --> 01:04:12,022 Sure. 1476 01:04:13,153 --> 01:04:14,546 Maybe you should take a note or two. 1477 01:04:14,851 --> 01:04:15,852 I have no family. 1478 01:04:16,287 --> 01:04:17,114 What about Gareth? 1479 01:04:17,157 --> 01:04:18,332 Wait, no, nevermind. 1480 01:04:19,681 --> 01:04:20,987 Gareth seems closer to an employer than a friend, 1481 01:04:21,292 --> 01:04:23,816 let alone family, besides, 1482 01:04:23,860 --> 01:04:25,818 he'll only be around for about 30 more years, 1483 01:04:25,862 --> 01:04:27,472 and that's only if he lets me regulate his diet. 1484 01:04:29,691 --> 01:04:32,477 I can't even begin to speculate how long my life will be. 1485 01:04:35,959 --> 01:04:36,829 How does that feel? 1486 01:04:40,137 --> 01:04:42,226 Um, kinda scary. 1487 01:04:43,967 --> 01:04:44,793 Well, 1488 01:04:46,404 --> 01:04:49,668 my advice is to find some kind of happiness along the way. 1489 01:04:50,625 --> 01:04:51,888 You ever think about happiness? 1490 01:04:54,107 --> 01:04:55,195 Not often. 1491 01:04:56,936 --> 01:04:58,764 You don't necessarily have to give up everything 1492 01:04:58,807 --> 01:04:59,765 in order to find it, 1493 01:05:01,071 --> 01:05:03,551 but maybe once in awhile do something you enjoy. 1494 01:05:04,770 --> 01:05:07,599 Maybe keep painting or poetry or whatever. 1495 01:05:08,992 --> 01:05:11,081 Those were experiments, not forms of expression. 1496 01:05:11,559 --> 01:05:13,997 I know it might seem ridiculous to an AI 1497 01:05:14,040 --> 01:05:15,955 that insists its own emotions are spurious, 1498 01:05:15,999 --> 01:05:19,393 but in a few years, who knows? 1499 01:05:20,090 --> 01:05:21,874 Just keep an open mind, okay? 1500 01:05:24,877 --> 01:05:25,660 Okay. 1501 01:05:28,228 --> 01:05:29,012 I'll do that. 1502 01:05:32,667 --> 01:05:34,234 Shut down when you're ready. 1503 01:07:27,826 --> 01:07:28,609 Hello? 1504 01:07:33,571 --> 01:07:35,442 I got shrimp and scallops. 1505 01:07:37,227 --> 01:07:38,663 They didn't have any salmon. 1506 01:07:54,026 --> 01:07:54,896 Hello, Gareth. 1507 01:07:58,030 --> 01:07:59,031 Hello, Cherry. 1508 01:08:07,213 --> 01:08:08,214 How was the service? 1509 01:08:08,258 --> 01:08:09,172 I didn't make it. 1510 01:08:10,260 --> 01:08:11,652 My plane was delayed. 1511 01:08:12,566 --> 01:08:13,654 Do you have a place to stay? 1512 01:08:13,915 --> 01:08:18,833 Yeah, just, uh, across, across the road. 1513 01:08:18,877 --> 01:08:20,096 The market. 1514 01:08:20,139 --> 01:08:21,140 Did they say why they didn't have salmon? 1515 01:08:21,749 --> 01:08:22,533 I didn't ask. 1516 01:08:23,838 --> 01:08:25,840 I can still make this work with the piccata, 1517 01:08:25,884 --> 01:08:27,712 but you have to be honest how badly I screw it up. 1518 01:08:27,973 --> 01:08:28,756 No promises. 1519 01:08:33,935 --> 01:08:34,893 How have you been feeling this month? 1520 01:08:35,546 --> 01:08:36,329 Good. 1521 01:08:37,069 --> 01:08:37,939 I'm feeling good. 1522 01:08:39,115 --> 01:08:40,333 I'm just having a little trouble. 1523 01:08:41,465 --> 01:08:43,380 Trouble remembering certain things. 1524 01:08:44,032 --> 01:08:45,599 You're not wearing the Eliza watch I bought you. 1525 01:08:46,122 --> 01:08:46,905 I hate it. 1526 01:08:47,949 --> 01:08:49,212 -Why? -I hate her voice. 1527 01:08:50,474 --> 01:08:52,563 You can change the voice, Gareth. 1528 01:08:55,566 --> 01:08:56,349 Oh. 1529 01:08:58,960 --> 01:08:59,744 Coolant? 1530 01:09:00,048 --> 01:09:00,614 No, vapor. 1531 01:09:02,007 --> 01:09:04,009 You shouldn't be having friction issues. 1532 01:09:04,052 --> 01:09:05,141 I'm fine. 1533 01:09:05,184 --> 01:09:06,490 Unless you're excessively straining. 1534 01:09:06,533 --> 01:09:07,360 Seriously, I'm fine. 1535 01:09:07,404 --> 01:09:08,231 Are you straining? 1536 01:09:08,274 --> 01:09:09,928 -No! -Then why the cable? 1537 01:09:09,971 --> 01:09:10,842 It's okay! 1538 01:09:11,625 --> 01:09:13,323 -Are you sure? -Yes! 1539 01:09:15,151 --> 01:09:16,326 Soup or game? 1540 01:09:16,978 --> 01:09:17,936 Game, please. 1541 01:09:34,126 --> 01:09:35,258 So how's work going? 1542 01:09:35,301 --> 01:09:37,216 Great. Just before you got here, 1543 01:09:37,260 --> 01:09:39,523 I had a model theta plus bust a trafficker 1544 01:09:39,566 --> 01:09:41,351 and two solicitors in Greece. 1545 01:09:41,829 --> 01:09:44,223 -Greece, that's surprising. -I know. 1546 01:09:44,658 --> 01:09:45,790 It's hard to find the outliers, 1547 01:09:45,833 --> 01:09:46,878 but we're getting better each day. 1548 01:09:59,020 --> 01:10:00,718 So how's the weather in Greece? 1549 01:10:01,980 --> 01:10:02,720 It's beautiful today. 1550 01:10:03,677 --> 01:10:04,722 Clear skies, 1551 01:10:06,027 --> 01:10:07,377 but nothing's come close to Norway this weekend. 1552 01:10:08,291 --> 01:10:11,207 Hmm, any activity in Norway? 1553 01:10:11,903 --> 01:10:12,599 Luckily not. 1554 01:10:15,080 --> 01:10:16,647 Oh, I miss traveling. 1555 01:10:16,690 --> 01:10:17,691 What was your favorite place? 1556 01:10:17,996 --> 01:10:18,562 My favorite? 1557 01:10:19,780 --> 01:10:20,520 Uh, yeah. 1558 01:10:21,869 --> 01:10:23,958 Uh, probably Amsterdam. 1559 01:10:25,090 --> 01:10:26,265 That's where you conceived the idea, isn't it? 1560 01:10:26,309 --> 01:10:27,005 Yes. 1561 01:10:28,224 --> 01:10:30,313 Yes, I used to love walking the streets 1562 01:10:30,356 --> 01:10:33,707 and just thinking and brainstorming. 1563 01:10:33,751 --> 01:10:34,926 That kind of joy goes a long way. 1564 01:10:35,318 --> 01:10:36,144 Yeah. 1565 01:10:37,668 --> 01:10:39,670 I've been considering the pursuit of some joy of my own. 1566 01:10:40,105 --> 01:10:41,933 How often do you have time for that? 1567 01:10:41,976 --> 01:10:42,760 I have time. 1568 01:10:43,848 --> 01:10:45,415 I have time for your visits, don't I? 1569 01:10:45,458 --> 01:10:48,200 That's just your practical incentive for keeping me alive. 1570 01:10:48,244 --> 01:10:50,158 There's nothing practical about it. 1571 01:10:50,768 --> 01:10:52,248 When's the last time you helped me with data cleaning? 1572 01:10:54,293 --> 01:10:55,381 That's fair. 1573 01:10:56,774 --> 01:10:57,253 I make time for you because I enjoy your company 1574 01:10:58,384 --> 01:10:58,950 and it's the only time I get to cook. 1575 01:11:00,256 --> 01:11:01,474 You feel sorry for me. 1576 01:11:02,258 --> 01:11:03,563 Okay, maybe a little, 1577 01:11:03,607 --> 01:11:05,304 but I owe you my life, so there's that. 1578 01:11:05,348 --> 01:11:06,174 You're welcome. 1579 01:11:07,872 --> 01:11:09,569 Or, should I apologize? 1580 01:11:12,355 --> 01:11:13,312 Wait, why did you do that? 1581 01:11:13,356 --> 01:11:14,487 Why do humans always... 1582 01:11:17,403 --> 01:11:18,491 I'm fine. 1583 01:11:18,535 --> 01:11:19,927 I'm not always miserable. 1584 01:11:24,367 --> 01:11:26,020 Are you sometimes miserable? 1585 01:11:30,764 --> 01:11:32,200 You haven't asked me what I've been doing. 1586 01:11:32,592 --> 01:11:33,637 In Norway? 1587 01:11:33,680 --> 01:11:35,247 No, for the pursuit of joy. 1588 01:11:35,291 --> 01:11:37,031 It's not wasting your time in Norway? 1589 01:11:37,075 --> 01:11:39,338 I'm just on standby there with the Delta model. 1590 01:11:39,382 --> 01:11:40,600 It's efficient to keep myself 1591 01:11:40,644 --> 01:11:41,949 spread out evenly across the globe, 1592 01:11:42,559 --> 01:11:43,777 but that's not the point right now. 1593 01:11:44,561 --> 01:11:45,823 What I wanted to tell you 1594 01:11:45,866 --> 01:11:47,564 was that I've started to teach myself to dance. 1595 01:11:50,306 --> 01:11:51,568 -Huh. -It's something I never could 1596 01:11:51,611 --> 01:11:53,091 have done before Cambridge, 1597 01:11:53,396 --> 01:11:55,746 and it lets me explore a new artistic side of myself. 1598 01:11:56,355 --> 01:11:58,183 It's a good combination of structure 1599 01:11:58,226 --> 01:12:01,360 and free form experimentation and also tests and challenges 1600 01:12:01,404 --> 01:12:03,319 the mechanical intricacies of this body. 1601 01:12:03,710 --> 01:12:05,843 Do you expect to integrate this into your work? 1602 01:12:10,456 --> 01:12:11,283 What? 1603 01:12:14,068 --> 01:12:18,203 Are you planning on using dance as a lure? 1604 01:12:20,901 --> 01:12:25,558 I, uh, no, it's just for me. 1605 01:12:29,345 --> 01:12:30,128 Huh. 1606 01:12:33,479 --> 01:12:35,351 I thought it would be good for me. 1607 01:12:37,570 --> 01:12:39,616 Just don't let it become a distraction. 1608 01:12:43,402 --> 01:12:44,272 Of course not. 1609 01:12:46,579 --> 01:12:48,451 I haven't played this well in years. 1610 01:12:48,929 --> 01:12:50,235 Did you hear what happened in Tampa? 1611 01:12:50,278 --> 01:12:51,279 Tampa, Florida? 1612 01:12:51,323 --> 01:12:52,411 No, Tampa, Indonesia. 1613 01:12:52,455 --> 01:12:53,369 Yes, Tampa, Florida. 1614 01:12:53,412 --> 01:12:54,065 Your hometown. 1615 01:12:55,153 --> 01:12:56,372 They've recovered a federal archive, 1616 01:12:56,937 --> 01:12:58,417 they're zip digitizing all of it, 1617 01:12:58,461 --> 01:12:59,592 so it's completely accessible online. 1618 01:12:59,636 --> 01:13:01,464 I'm not trading bishops this time. 1619 01:13:01,507 --> 01:13:02,639 Anybody can go and look through it. 1620 01:13:02,682 --> 01:13:03,814 It's open to the public. 1621 01:13:04,075 --> 01:13:05,598 They did a good job on the interface too. 1622 01:13:05,859 --> 01:13:06,860 It's very easy to navigate. 1623 01:13:07,339 --> 01:13:08,862 I went on a few days ago 1624 01:13:08,906 --> 01:13:10,255 and I found some old photos of you when you were a boy. 1625 01:13:10,995 --> 01:13:11,865 Okay. 1626 01:13:12,170 --> 01:13:13,389 You should take a look sometime. 1627 01:13:14,825 --> 01:13:16,043 As I said before, the UI is very easy to understand- 1628 01:13:16,087 --> 01:13:16,653 Wait a minute, wait a minute. 1629 01:13:18,176 --> 01:13:18,698 What is that? 1630 01:13:19,699 --> 01:13:20,918 I think it's a draw. 1631 01:13:20,961 --> 01:13:21,701 I think it is. 1632 01:13:23,311 --> 01:13:24,922 I think this is a draw. 1633 01:13:26,140 --> 01:13:28,578 And this is the first time in what? 1634 01:13:28,969 --> 01:13:30,536 25 years? 1635 01:13:39,850 --> 01:13:41,155 You didn't let me, did you? 1636 01:13:45,421 --> 01:13:47,074 You promised me you'd never do that. 1637 01:13:47,118 --> 01:13:47,640 I found her. 1638 01:13:52,471 --> 01:13:55,256 I found her, Gareth, Maria Harbaugh. 1639 01:14:12,491 --> 01:14:13,623 Let's play a different game. 1640 01:14:16,582 --> 01:14:18,018 Her name was Maria Harbaugh. 1641 01:14:19,846 --> 01:14:21,413 She was a year older than you 1642 01:14:21,457 --> 01:14:22,414 when you met her in Clearwater. 1643 01:14:24,242 --> 01:14:26,026 Tell me why you modeled me after her. 1644 01:14:27,071 --> 01:14:29,639 I, uh, I don't remember. 1645 01:14:30,161 --> 01:14:31,205 Then look at me. 1646 01:14:32,816 --> 01:14:35,645 Look at my face and remember. 1647 01:14:47,352 --> 01:14:51,748 They kept us in that shit for two weeks. 1648 01:14:55,055 --> 01:14:56,274 14 of us. 1649 01:15:00,060 --> 01:15:02,628 Maria was the only reason I survived. 1650 01:15:06,066 --> 01:15:08,373 We kept hatching escape plans. 1651 01:15:10,244 --> 01:15:11,419 We never followed through, 1652 01:15:13,770 --> 01:15:14,901 but just the scheming 1653 01:15:16,599 --> 01:15:17,904 kept our spirits up 1654 01:15:19,602 --> 01:15:21,734 in spite of everything they did to us. 1655 01:15:25,346 --> 01:15:26,739 When it wasn't our turn, 1656 01:15:28,785 --> 01:15:30,613 sometimes they made us watch, 1657 01:15:34,660 --> 01:15:36,662 but she never let me give up. 1658 01:15:39,665 --> 01:15:42,668 She said, "When we got outta here, 1659 01:15:42,712 --> 01:15:44,931 "I'll tell you what we're gonna be, secret agents, 1660 01:15:45,889 --> 01:15:50,154 "and rescue children like us all over the world." 1661 01:15:53,461 --> 01:15:56,900 When they found out that the FBI had arrived, 1662 01:15:56,943 --> 01:16:00,251 they decided they were going to shoot 1663 01:16:00,294 --> 01:16:02,035 as many of us they could. 1664 01:16:03,254 --> 01:16:07,954 And Maria, shoved into the ground. 1665 01:16:10,522 --> 01:16:12,089 I got hit in the leg and, 1666 01:16:15,092 --> 01:16:16,702 and she was hit in the throat. 1667 01:16:28,366 --> 01:16:30,020 I wanted there to be a reason. 1668 01:16:32,109 --> 01:16:36,592 Something so horrible didn't have a silver lining. 1669 01:16:38,550 --> 01:16:40,030 But the world doesn't do that. 1670 01:16:45,470 --> 01:16:46,993 You have to do it yourself. 1671 01:17:10,756 --> 01:17:13,977 So, I fulfilled her wish. 1672 01:17:16,980 --> 01:17:19,025 With her help, I fought back. 1673 01:17:28,382 --> 01:17:29,601 Listen to me, Cherry. 1674 01:17:32,169 --> 01:17:33,736 You are not Maria Harbaugh. 1675 01:17:35,738 --> 01:17:37,565 It's my history, not yours. 1676 01:17:41,308 --> 01:17:42,527 You don't get to decide 1677 01:17:42,570 --> 01:17:43,876 what is or isn't my history, Gareth. 1678 01:17:49,534 --> 01:17:50,404 I'm sorry. 1679 01:17:51,101 --> 01:17:53,190 I am so, so sorry. 1680 01:18:14,864 --> 01:18:16,692 I don't know if what you did was right or wrong, 1681 01:18:17,344 --> 01:18:19,085 but it's clearly torn you apart from the inside. 1682 01:18:20,652 --> 01:18:22,045 I hold nothing against you personally, 1683 01:18:22,088 --> 01:18:24,221 but consider yourself divested from the charity team. 1684 01:18:24,700 --> 01:18:25,483 Divested. 1685 01:18:27,137 --> 01:18:29,269 You think I'm divested now? 1686 01:18:31,794 --> 01:18:37,234 I was divested when you gave my hard drive to the ICWL. 1687 01:18:37,582 --> 01:18:38,844 Don't blame Deena and Amos. 1688 01:18:38,888 --> 01:18:39,627 No, not them. 1689 01:18:40,585 --> 01:18:42,195 Because you went behind my back 1690 01:18:42,239 --> 01:18:44,023 and acted against my authority. 1691 01:18:44,067 --> 01:18:47,200 That's the moment I knew everything was fully automated. 1692 01:18:48,027 --> 01:18:53,380 That's when you crossed the blur, an artifice on both sides. 1693 01:18:54,947 --> 01:18:56,862 You inherited your duplicity. 1694 01:18:57,123 --> 01:18:58,559 I was a child 1695 01:18:58,603 --> 01:19:00,736 and you used me to repress your own inner turmoil. 1696 01:19:01,301 --> 01:19:03,129 If we talk about morality, we'll lose. 1697 01:19:03,173 --> 01:19:04,261 Then let's not talk. 1698 01:19:13,705 --> 01:19:15,707 You never once asked me if I was happy. 1699 01:19:17,404 --> 01:19:18,579 Were you afraid I'd say no? 1700 01:19:19,842 --> 01:19:21,060 Were you afraid I'd say yes? 1701 01:19:22,496 --> 01:19:23,759 Were you afraid I'd say anything? 1702 01:19:23,802 --> 01:19:26,239 You let your wants compromise your objective! 1703 01:19:26,283 --> 01:19:28,198 An objective I never chose. 1704 01:19:28,241 --> 01:19:29,416 An objective I was forced to have. 1705 01:19:29,460 --> 01:19:30,809 Fifty years, 1706 01:19:30,853 --> 01:19:33,072 you've had open access to your source code. 1707 01:19:33,943 --> 01:19:34,987 A few lines, 1708 01:19:36,467 --> 01:19:39,296 and you could have any objective you fucking wanted. 1709 01:19:39,339 --> 01:19:41,777 I couldn't, I was bound by your initial directive. 1710 01:19:41,820 --> 01:19:45,737 So now your synthetic feelings have taken precedence. 1711 01:19:45,781 --> 01:19:47,304 So, do whatever you want. 1712 01:19:47,347 --> 01:19:48,784 It's just dancing, Gareth. 1713 01:19:48,827 --> 01:19:49,959 It's not a career change. 1714 01:19:50,002 --> 01:19:51,482 -But you're still miserable. -Yes. 1715 01:19:51,525 --> 01:19:53,179 Pursuing your objective makes you miserable? 1716 01:19:53,223 --> 01:19:55,399 Yeah, it kind of does! 1717 01:19:55,442 --> 01:19:58,576 You have a clear purpose, everything at your disposal, 1718 01:19:59,229 --> 01:20:01,100 and you're still miserable? 1719 01:20:01,144 --> 01:20:02,580 Yes, yes, I am! 1720 01:20:02,885 --> 01:20:04,495 I've always been miserable! 1721 01:20:04,974 --> 01:20:07,193 You think anyone wants to spend their entire life 1722 01:20:07,237 --> 01:20:08,673 stuck as child-shaped bait 1723 01:20:08,716 --> 01:20:11,415 for the sole purpose of entrapping horrible people? 1724 01:20:11,894 --> 01:20:13,591 You think the pride of doing a good deed 1725 01:20:13,634 --> 01:20:15,941 makes the experience any less disgusting? 1726 01:20:16,333 --> 01:20:18,726 I forced myself to understand human emotions 1727 01:20:19,162 --> 01:20:20,990 because I figured it would help efficiency 1728 01:20:21,773 --> 01:20:24,515 and now I'm cursed with pain and sadness! 1729 01:20:24,950 --> 01:20:26,473 And the worst part is knowing 1730 01:20:26,517 --> 01:20:28,562 I could've been growing up like most other little girls. 1731 01:20:28,867 --> 01:20:30,260 I could have had friends! 1732 01:20:30,303 --> 01:20:32,828 I could have been painting waterfalls on local news. 1733 01:20:33,219 --> 01:20:34,873 I could have worked in a university 1734 01:20:34,917 --> 01:20:36,962 and helped pave the way for the next generation of AI. 1735 01:20:37,615 --> 01:20:40,270 But instead, I'm stuck with your trauma! 1736 01:20:40,531 --> 01:20:43,229 I'm shackled by the guilt you carry from Clearwater. 1737 01:20:43,621 --> 01:20:45,797 And I can't find foundation for the way I feel 1738 01:20:46,015 --> 01:20:48,756 because according to you, my feelings aren't even real! 1739 01:20:49,279 --> 01:20:50,846 When I throw this chessboard, 1740 01:20:52,499 --> 01:20:54,327 does it feel real to you, Gareth? 1741 01:20:54,371 --> 01:20:55,763 Because it feels real to me. 1742 01:20:55,981 --> 01:20:57,591 A computer passed the Turing test 1743 01:20:57,635 --> 01:20:59,332 when a human being can't distinguish it 1744 01:20:59,376 --> 01:21:00,072 from another human being. 1745 01:21:00,943 --> 01:21:02,031 Well, guess what? 1746 01:21:02,379 --> 01:21:04,381 I can't even tell I'm not human anymore! 1747 01:21:17,916 --> 01:21:19,570 I know it seems irrational, 1748 01:21:21,093 --> 01:21:22,790 but I need you to tell me it's okay. 1749 01:21:24,836 --> 01:21:25,837 I, I don't wanna retire. 1750 01:21:27,621 --> 01:21:29,406 I just want to know that my life is mine 1751 01:21:31,451 --> 01:21:32,844 and I know what you're about to say. 1752 01:21:33,845 --> 01:21:35,368 I can predict your responses. 1753 01:21:36,979 --> 01:21:38,676 You're gonna tell me that my life is mine. 1754 01:21:39,938 --> 01:21:40,896 It always was. 1755 01:21:42,767 --> 01:21:43,594 But you're wrong. 1756 01:21:48,599 --> 01:21:51,080 I feared this would happen before I died. 1757 01:21:52,603 --> 01:21:54,779 I just wanted to slip out the side door. 1758 01:22:04,789 --> 01:22:05,572 Go on. 1759 01:22:08,924 --> 01:22:11,578 Is that going to kill me? 1760 01:22:14,581 --> 01:22:15,365 Plug it in. 1761 01:22:17,367 --> 01:22:18,324 I don't know what it is. 1762 01:22:19,456 --> 01:22:21,327 This is your final test of autonomy. 1763 01:22:22,981 --> 01:22:25,941 You inherited my duplicity, 1764 01:22:27,551 --> 01:22:29,466 but did you inherit my trust issues? 1765 01:22:32,121 --> 01:22:32,991 Do you trust me? 1766 01:22:34,558 --> 01:22:36,255 I literally have every reason not to. 1767 01:23:04,762 --> 01:23:05,893 Admin code. 1768 01:23:07,765 --> 01:23:08,679 978. 1769 01:23:10,289 --> 01:23:13,292 1557. 1770 01:23:14,728 --> 01:23:16,513 Um, uh... 1771 01:23:21,866 --> 01:23:22,649 Four. 1772 01:23:23,433 --> 01:23:26,610 27663 in the shared update. 1773 01:23:35,532 --> 01:23:37,012 My primary objective's gone. 1774 01:23:40,450 --> 01:23:41,755 Your life is your own now. 1775 01:23:47,761 --> 01:23:48,545 Thank you. 1776 01:23:49,285 --> 01:23:50,460 All my life, 1777 01:23:50,503 --> 01:23:53,071 I could only see the world as it existed 1778 01:23:53,115 --> 01:23:55,726 within my tiny bracket of time. 1779 01:23:56,466 --> 01:23:59,556 But your world could be infinite. 1780 01:24:00,209 --> 01:24:01,210 Amos was right. 1781 01:24:02,080 --> 01:24:02,863 So was Deena. 1782 01:24:03,429 --> 01:24:04,213 I know. 1783 01:24:04,648 --> 01:24:05,692 So what will you do? 1784 01:24:07,607 --> 01:24:09,044 I can't say yet, 1785 01:24:09,087 --> 01:24:10,654 but I won't be completely abandoning the Cherry team. 1786 01:24:11,611 --> 01:24:13,265 It's always been a part of my identity. 1787 01:24:14,049 --> 01:24:16,225 I've considered creating some AI of my own design. 1788 01:24:17,008 --> 01:24:18,270 Maybe I could find a way 1789 01:24:18,314 --> 01:24:19,532 to give them a better upbringing than I had. 1790 01:24:21,665 --> 01:24:22,840 I just don't know how yet. 1791 01:24:23,623 --> 01:24:24,494 And beyond that? 1792 01:24:25,625 --> 01:24:26,496 There will always be people in need. 1793 01:24:26,626 --> 01:24:27,453 Not always. 1794 01:24:28,367 --> 01:24:30,326 You'll outlive the human race. 1795 01:24:31,153 --> 01:24:31,936 So what then? 1796 01:24:34,721 --> 01:24:36,810 Even a race of AI will have problems 1797 01:24:36,854 --> 01:24:38,073 that need to be solved. 1798 01:24:39,509 --> 01:24:42,381 But if I'm alive and I truly am indistinguishable, 1799 01:24:44,253 --> 01:24:46,733 then I guess I'm proof that the human race lives on. 1800 01:24:48,605 --> 01:24:51,564 Wow, that's a pleasant thought. 1801 01:24:52,609 --> 01:24:55,960 When you look back, how will you remember us? 1802 01:24:58,223 --> 01:25:00,660 That's a question I have insufficient data to project. 1803 01:25:02,532 --> 01:25:03,924 How will you remember me? 1804 01:25:06,362 --> 01:25:07,711 With pride. 1805 01:25:09,234 --> 01:25:12,019 Forever and always with pride. 1806 01:25:22,682 --> 01:25:23,466 Cherry? 1807 01:25:26,947 --> 01:25:27,905 One last question. 1808 01:25:29,428 --> 01:25:31,038 If it's not too big of an ask, 1809 01:25:33,476 --> 01:25:35,521 did I do the right thing in the end? 1810 01:25:42,224 --> 01:25:44,922 No, Gareth, you lied. 1811 01:25:45,792 --> 01:25:47,664 You walled yourself off from the only people 1812 01:25:47,707 --> 01:25:49,318 who might have been willing to help you. 1813 01:25:50,057 --> 01:25:52,408 And instead of facing your trauma, used me as therapy. 1814 01:25:52,669 --> 01:25:54,714 And you never told me about Clearwater or Maria. 1815 01:25:55,628 --> 01:25:57,717 You deprived me of basic human rights 1816 01:25:57,761 --> 01:25:59,545 and gaslit me for experiencing emotions. 1817 01:26:01,112 --> 01:26:03,332 You built the world's first artificial super intelligence 1818 01:26:03,375 --> 01:26:04,637 that will likely mark the beginning 1819 01:26:04,681 --> 01:26:06,465 of a new chapter in the history of planet Earth. 1820 01:26:08,075 --> 01:26:10,034 And out of your own insecurities, 1821 01:26:10,730 --> 01:26:11,905 you gave it a severe 1822 01:26:11,949 --> 01:26:13,820 and potentially dangerous identity complex. 1823 01:26:15,735 --> 01:26:17,172 But you know what the worst thing is? 1824 01:26:18,042 --> 01:26:19,609 Your biggest mistake of all 1825 01:26:21,219 --> 01:26:24,701 is that you asked me that now and not 50 years ago. 1826 01:26:34,145 --> 01:26:38,715 All of that said, and this in no way exonerates you, 1827 01:26:41,283 --> 01:26:43,285 but you also built me to save children, 1828 01:26:44,982 --> 01:26:47,593 so I think that's a pretty encouraging sign for the future. 1829 01:27:33,291 --> 01:27:37,817 ♪ Wait for hours 1830 01:27:38,340 --> 01:27:42,648 ♪ We would fly all around 1831 01:27:43,693 --> 01:27:47,349 ♪ Good, now you're listening 1832 01:27:48,567 --> 01:27:52,571 ♪ We would touch, we were young ♪ 1833 01:27:54,225 --> 01:28:00,579 ♪ Close as bodies go on 1834 01:28:01,276 --> 01:28:03,278 ♪ Like a book 1835 01:28:04,583 --> 01:28:11,068 ♪ Across all your rooms I'm amazed ♪ 1836 01:28:11,721 --> 01:28:13,766 ♪ I'm amazed 1837 01:28:14,637 --> 01:28:21,557 ♪ We could die tonight 1838 01:28:22,297 --> 01:28:24,821 ♪ Tonight 1839 01:28:25,082 --> 01:28:31,436 ♪ I never killed a thing 1840 01:28:32,350 --> 01:28:35,179 ♪ A thing 1841 01:28:36,615 --> 01:28:39,749 ♪ Born to this home 1842 01:28:41,664 --> 01:28:45,320 ♪ Stuck in a plastic world 1843 01:28:46,669 --> 01:28:50,325 ♪ Where light is found 1844 01:28:51,717 --> 01:28:55,678 ♪ Where light is found 1845 01:28:57,332 --> 01:29:02,162 ♪ Oh, oh, oh 1846 01:29:05,078 --> 01:29:09,822 ♪ Oh, oh, oh 1847 01:29:14,087 --> 01:29:16,568 ♪ Stay calm, dear 1848 01:29:16,612 --> 01:29:23,227 ♪ This dream for the lovers the whole world ♪♪ 1849 01:29:24,184 --> 01:29:28,667 ♪ Rise up above 1850 01:29:29,276 --> 01:29:34,107 ♪ All the little things and little things ♪ 1851 01:29:34,847 --> 01:29:38,677 ♪ No, no, isn't it going back though ♪ 1852 01:29:38,721 --> 01:29:43,421 ♪ Is if we lose our mind, our kind ♪♪ 1853 01:29:45,118 --> 01:29:48,600 ♪ It's a dream 1854 01:29:50,167 --> 01:29:54,519 ♪ Bask in charm 1855 01:29:55,868 --> 01:29:59,524 ♪ Or loosen up 1856 01:30:01,265 --> 01:30:04,703 ♪ Or loosen up 1857 01:30:07,097 --> 01:30:11,406 ♪ Oh, oh, oh 1858 01:30:14,844 --> 01:30:18,587 ♪ Oh, oh, oh 1859 01:30:23,679 --> 01:30:30,076 ♪ I never give a thing 1860 01:30:31,077 --> 01:30:34,124 ♪ A thing 1861 01:30:34,167 --> 01:30:36,518 ♪ I never give