comma ai Driving to self racing cars with openpilot

Key Takeaways

[Music] yo uh can anyone see this i've never used periscope before so i'm in the car um on the way to self-racing cars open pilot is driving right now but of course um you know i have to pay attention at all times because that's how these systems work uh yeah i'll let you know if it makes mistakes um i'm not really sure like what to do and i can't really use my phone very much because i'm in the car of course i'm uh you know i have my phone mounted in a mount it's hands-free so hopefully y'all can hear me uh this is this is open pilot driving right now i also have the six minute uh timeout so we're about three minutes through the six minute timeout we are cruising up vallejo you know people always like you know there's all these demo videos and they're they're so like curated this is real this is open pilot driving all right excellent um cool i think if i double tap does that work hey what's up uh yeah i'm driving uh hang on i gotta put the speed up so let's go back here to the road all right cool so you see there's a car up there we're just gonna stop for it um i put the speed up so that resets my six minute meter to show that i've been paying attention uh yeah let me know let me know what you all want to see um the truth is driving is boring especially driving in this like stop and go ish traffic but it's really where these systems are cool so you see we got some bots dots up here um you guys can't see it but on the open pilot screen it's uh not quite seeing the right lane so we came to a full stop here uh can you see the neo um quickly if i'm stopped sure uh here's the nail all right let me put this back in the mount here no it stays dead straight no ping ponging in the lane so it's it's entirely the car i'll let you know if i have to intervene at all uh the longest drive was probably two and a half hours uh straight that was on the comma zero that was on the old system um yeah i don't know i mean we could check the logs and we could find like the max engagement record can it take bends on the highway absolutely um so this car has a slightly raised torque limit as well we've raised the torque limit double what this car ships with um which makes it take a bit sharper bends but even the neo that you build yeah it could definitely take bends on the highway you don't get a lot of updates for me follow us on twitter yeah within steering saturation limits exactly someone knows how this thing works you know it's great you guys can answer the questions for me i can't pay that much attention to the phones obviously i have to pay attention to the road um so yeah you see things like you know we're going to go under this bridge right here and you're going to get uh you're going to get some shadows but this is why we have a temporal model in open pilot so it keeps the lane straight even when the camera is adjusting its auto focus we're about three minutes since i pressed the button uh where's the hardware well my phone is mounted so my phone is mounted in a place i use dash oh i shifter i use chevro so getchever.com downloader dashcam app open pilot for other cars well you have to um go to our website there are bounties we are sponsoring a bunch of bounties for other cars the great thing about open pallet is it is open source and it is well within the community's ability to port it to other cars and i know this because i've seen it done so yeah it's still uh it's still driving i mean this is the kind of stuff that's just grueling to drive in as a human right you like stepping on the brakes you got to go a little bit you're switching from stop and go to go a bit faster but the the civic in front of me is driving pretty well which is good if the driver in front of me is being aggressive is like aggressively tailgating and slamming on the brakes and slamming on the accelerator uh it's harder to drive smoothly this is true for both humans and for this system but um because that driver is driving well we drive well also um so we should get to the six minute timeout limit we're down we're about four minutes without a disengagement i mean you guys are like literally this wow there's like 40 of you watching me driving traffic man uh yeah and i gotta i gotta make some turn up ahead onto 880 have i tested this on big rigs no um i don't own a big rig i have a license to drive a big rig we've tested it on hondas and acuras thank you i feel like a cam girl um so yeah and you know it's it's you know it's great that we have the six minute timeout limit because it really keeps the driver engaged like the system's been driving for the last uh five minutes so we might get a cut in up here for this truck we'll see how late it is yeah i thought that cut in from the truck cut in from the truck all right good job neo see that that kind of stuff man and actually it did that i you know i saw i looked on the neo i saw that it saw the truck um that was incredibly smooth probably smoother than a human would do it so here we are we're taking a little bend on the highway any near-term updates yeah so open pilot we're going to get a cut out up here of the tacoma we're gonna come back to the honda being the lead car we're gonna wait till he fully cuts out of the lane and that open pile's gonna accelerate a bit i can see on my screen that the lead is switched over to the honda a little too hard on the brakes there um part of that unfortunately is a hardware limitation uh does it plan paths for the other vehicle sorry i missed that that faded i was watching because there's a lot going on um yes a little hard on the brakes here as well but you know not bad i'm well within well within the realm of uh human driving um so we're about to hit the six minute mark uh if you've watched the video um when we get to six minutes so here are my hands uh so take control to regain speed i'm just gonna move the wheel a tiny bit uh we got a motorcyclist here i'm ah nah he's a right i'm gonna disengage uh i don't feel great around people with uh around motorcyclists since i used to ride one myself um so we're back to disengage my hands are back on the wheel and now i'm gonna re-engage now i put the speed up to uh 65 i can show you guys my hands um yeah i'm in an acura ilx i'm in the original comma acura ilx we got a lidar on the roof we got a high precision gps we're back engaged here in my hands guys um no the neo will not change lanes so we don't have any side sensors on the car um the only sensors that the oh my fuel is low it also won't take me off the road to stop at a gas station um i wonder how long i have does it have issues with bicyclists no it does okay um i don't know just like as a like i i like to you know drive extra conservatively around that so i'll usually take control um when there's other cars like all right so we're gonna get a late cut into this elantra here no no no no we're not gonna let him in yeah be aggressive that's right uh oh i'm not switched i'm just showing you that i'm not touching nothing i guess there's back uh when we use ultrasonic sensors yeah so you probably can if your ultrasonic sensors are on the cars can bus you could probably use them here's a quarter can i actually get a quarter if you got like like what are the myfreecams bucks called um i know i need to work on it to take me automatically to gas station i agree um now i gotta find where gas station is this is a lot of effort you guys i wish my phone could just like hey phone gas station i gotta go take me there that'd be cool you know what i'll do that neo uh change lanes okay i can change lanes to the left um so i technically don't have to disengage to change lanes to the left but i'm going to because i want to accelerate aggressively um so yeah we're back engaged if you heard that beep so we're back on open pilot i'm putting the speed back up and there we are uh wait actually i might be in a carpool lane right now no i'm in a carpool lane i shouldn't be here we gotta we gotta go back carpools three or more persons per vehicle well unless like the neos count as people all right we're gonna get back over here i'm disengaged right now i am driving and that will re-engage open pilot right here so i really i don't know how far long i can go without getting gas either cannoli next three exits i wonder if there's an easy on easy off uh yeah captain picard voice computer engaged i'll probably get sued by star trek right have 50 plus people with me yo all right we gotta go to the gas station man uh yeah so open piles back engaged you know what i'll do when i'm at the gas station i'll try to mount my periscope i'm trying to think there's nowhere i can really mount it that i can show you the neo the road that my hands are uh off the wheel and also read the messages that's the problem like i can't read the messages so i don't know why i'm in this lane this guy's going mad slow uh look at that look at that look at the long trailer yeah technology should be open i mean look it's like what are we all doing here right let's we all want the same thing everyone's going to get rich off self-driving cars open source it um yeah so this is this is actually running open pilot 0.3 which is a little bit better than what you can get with the released 0.2.9 uh but 0.2.9 is still pretty awesome and if you build a neo of course that's going to be an absolutely free upgrade to 0.3 um 0.3 has a new model our machine learning team has been working super hard on that and 0.3 we're really starting to use all of our crowdsourced data so we're starting to use the model that's currently an open pilot was trained somewhat on the crowdsourced data but a lot still on the original comma zero data set now we've taken that out of circulation um and yeah engineers can contribute we're really hoping for contributions um we're working to make it easier for people to contribute uh i probably need to stop at a gaster yeah neo's in the hands of thousands of people that's the dream man that's the dream um any near-term hardware software so we have the pandas uh tomorrow at noon we will be cutting the top 20 on the leaderboard and the top 20 on the weekly leaderboard will be getting free comma ai pandas see the thing is i'm afraid to get off at any of these exits because i worry that there's going to be lots of traffic when i get back on the highway what is a panda uh for other eps cars yeah um so what is a panda a panda is a car interface so it's a fairly universal car interface it'll interface with cars going way way back a lot more than just hondas and acuras and right now what it will do is it works with our app shifter and it's really read-only right now um it reads all the look this guy's over the lane line over the lane line bro he's going back we're good um need us to look up some gas station options yeah maybe uh does periscope have my location oh this is a lot of fun uh yeah so we've been we've been engaged again for four minutes so we're gonna hit the timeout yeah so the report um so any teams using comma at the racing car event i mean i think we'll find out tomorrow oh yeah panda uses the obd port on board diagnostics obd not odb it's really easy to say that the wrong way because like b's and d's kind of look similar um you really see that glare going on back there um yeah this nissan frontier is driving pretty well as well my hands bros just showing uh yeah so you can see that i mean you can see my eyes too when it's facing you that i really am spending most of my time looking at the roads right you cannot uh grow complacent with these systems they are level two systems and i can't stress that enough um on low gas i still have about 30 miles yeah that's kind of what i'm thinking right let's push it i was driving this one time i was driving through uh middle of nevada there is nothing in the middle of nevada and i see a sign that says next gas station 183 miles yeah reactions right some reactions so we can see both cameras i'm so fully stopped right now now we're starting to roll again um do you guys like seeing the front camera more or the back camera more i said an uber to pick me up yeah uh more powerful hardware uh and camera suite yeah we're absolutely looking into it um the big advantage to staying on a cell phone is cell phones are very available consumer electronics so they're easy for people to get right a building come ai is a relatively small company building complex hardware is maybe outside of our reach for i don't know at least a couple more months um we're building some simple hardware we're building the panda we'll see how that goes the panda is the most advanced way to interface to your car it has three can buses two lin buses it supports gm land it supports um detection of whether the car is started or not on the other odb pins uh it's gonna get you so like a lot of especially electric cars you're talking like nissan leafs and chevy volts here have three can buses on the odb port um and the three can buses uh one of them is the main can uh one of them is kind of like the chassis can but the other one is the battery can so we should be able to look into what's going on in the can buses of those cars and we should be able to get the status of all of the batteries up that's the six minute limit for the neo so i'm just putting my hands on the wheel turning it a tiny bit to show the system that i'm here um go back to the other camera for a little bit you want to see some action is can reverse engineering the biggest only barrier to using neo on other cars yeah um samsung phones crash a lot we're not using a samsung phone we're using a oneplus phone um yeah we're really rolling through traffic here this this this this model is good i'm i'm super happy like it's keeping me in the dead center of the lane uh stop and go feels pretty good so i was do you have a question before that i feel like i was saying something and then i started thinking about that got hit by the user distracted thing so six minute timeout all right uh how many sensors we have now so the only sensors that open pilot uses about a dead stop right now by the way um the only sensors open pilot uses are the uh the camera on the phone and the front-facing radar that's built into the car which we access over the canvas um cam i don't know what that means i can switch to the other one if you want there we go i like this periscope thing it's pretty cool what can you help my cause well there's a bunch of things uh first off uh comedy ai is real and let people know this i mean a lot of people really aren't aware um you know you'll hear about google self-driving cars you think about uber self-driving cars but you can't get any of that technology oh we gotta cut in here we gotta cut it you gotta watch okay cool that was that was plenty backed off and saw that real early um i don't know why my exposure is so washed out like that now let's hope we don't get a leg cut in from that truck he looks aggressive uh yeah but just you know spread the word about comma ai and download our dash cam app so it's called shifter it's available for both iphone and android um and you can get your hands on that and you can start it's a dash camera records all your trips and we use that data to improve open pilot um so we have almost a million miles maybe we'll have a little periscope party when we reach a million miles i like periscope by the way i'm starting to like this can you put flyers i mean i don't know if we're quite there yet like i look i mean you look at the thing right now it mostly appeals to people who want to hack on their cars um my hope is that by the end of the year we will have support for many more mass-market cars and we'll do more and more to incentivize that make that easier as the year goes on well we've already put up we're not going to do more to incentivize it we've already put up what our bounty program is um and you can check that out from comma dot ai our website um can you upload from shifter when you're on wi-fi yeah of course of course shifter by default uploads uh not on uh not on your mobile data because it would use way too much of it it waits until you get back to wi-fi it only uploads over mobile data if you turn that option on periscope's been going downhill did i miss periscope was periscope cool did he used to be cool it's not cool anymore was it not cool anymore did i miss the periscope was it cool um yeah no kami uh yeah we're real uh and we're we're gonna hopefully win i mean i think that there's a lot of uh noobs in the space and both cameras are washed out right now i don't know why all right i should probably get more serious about this whole gas station thing um so we'll we'll periscope all the way until we get to the gas station all right this doesn't look like it's anywhere near a gas station i looks like if i found like a sheep around here you know what this reminds me of windows xp bliss uh any teams in the safe self-racing event using a neo we are um we'll be doing a lap but we could do it entirely on the neo we have it kind of tied in with the computer so we could use the computer to run some of the processes i mean it's really it's like a distributed architecture uh open pilot uses cmq for serialization and we use tcp so we can go over the network just as easily um all right i don't think we want to get off this exit hercules stockton stockton scares me uh so there's that let's see if we're going to come on a gas station we're really really welcome first off we're going a little faster now this is nice um so we're going we're going 50 with this cruise control set at 65. um we're going 56 right now and yeah we're about 5 minutes in so usually we get to the bar without a disengagement um we're about i'd say on average 10 minutes between disengagements right now obviously if the bar we don't count as a disengagement because that's a uh safety feature oh there's a gas station over there all right there's a cop over there um let's get off the next exit here well uh this is like a highway exit i'm gonna get off this one this one looks like it'd be difficult to get back on but all right so you know what we can do i'll show you guys like the vaguely automatic lane change oh you know what let's hit the six minutes first just so you guys can see that there's uh no fools here that's tomorrow the fools come tomorrow does it already detect crash situations like the tesla thing that was fake news um the tesla thing they're they tesla the reason like it detected a crash situation it's actually just the radar tracks a car that you can't see i'm gonna get off willow avenue here um i disengaged if you all heard that beef uh there's a car right here i'm looking at my mirror let's accelerate let's go re-engage and pull us right back into the lane he's gonna slow us down behind this car yeah we're getting off right here oh there's a burger king too maybe i'll get a whopper i love whoppers all right so i'm back in control of the car i was switching back oh i hit the screen and for some reason it auto exposure which was nice there's a valeo before the bridge what bridge oh i'm about to hit that bridge oh i know that bridge am i gonna regret getting off this exit i don't think so this looks somewhat reasonable and i'm serious about that whopper too i think i'm playing about the whopper no i seriously want the whopper um all right a gas station straight ahead right here we got a 76. um so yeah i'ma stop we get gas get a little food and maybe i'll be back on periscope in a bit maybe for some open highway cruising let's go which side is this moving on from the left i love periscope this is great i understand why mark shkreli likes it so much is that the pump i don't know this is this should be easier there's a pump over there but that's on the wrong side there's one right here all right boss cool uh yeah i'll catch you all a bit later i'll figure out how to stop this thing start sketching oh ask for follow yeah follow me bros i don't know how do i stop this thing freelance [Music] i don't know how to do this i'm so bad at this