Connect with us

News

Musk’s OpenAI will train artificial intelligence through video game ‘Universe’

Published

on

Elon Musk’s OpenAI will introduce Universe, a virtual training ground aimed at teaching AI to play video games, use apps and even interact with websites. OpenAI, the artificial intelligence research company backed by the Tesla founder and billionaire entrepreneur, defines Universe in a blog post as “a software platform for measuring and training an AI’s general intelligence across the world’s supply of games, websites and other applications.”

Put simply, Universe will provide a gym that allows AI agents to go beyond their specialized knowledge of an individual environment to something approaching common sense. “Any task a human can complete with a computer.” Using a VNC (Virtual Network Computing) remote desktop, it allows the AI to control the game or app using a virtual keyboard and mouse, and to see its output by analyzing the pixels displayed on the screen. It’s essentially an interface to the company’s Gym toolkit for developing reinforcement algorithms, a type of machine learning system.

“Our goal is to develop a single AI agent that can flexibly apply its past experience on Universe environments to quickly master unfamiliar, difficult environments, which would be a major step towards general intelligence,” OpenAI says. As an example, it points to success of Google’s DeepMind AlphaGo initiative, which defeated the world champion human Go player earlier this year. While that success was impressive, when faced with a different challenge, the agent would have to go back to square one and learn the new environment through millions of trial and error steps.

OpenAI hopes to expand the Reward Learning (RL) lessons learned in one environment so that an AI agent can build upon past experience to succeed in unfamiliar environments.

Advertisement

OpenAI says in its blog post, “Systems with general problem solving ability — something akin to human common sense, allowing an agent to rapidly solve a new hard task — remain out of reach. One apparent challenge is that our agents don’t carry their experience along with them to new tasks. In a standard training regime, we initialize agents from scratch and let them twitch randomly through tens of millions of trials as they learn to repeat actions that happen to lead to rewarding outcomes. If we are to make progress towards generally intelligent agents, we must allow them to experience a wide repertoire of tasks so they can develop world knowledge and problem solving strategies that can be efficiently reused in a new task.”

Prior to Universe, the largest RL resource consisted of 55 Atari games — the Atari Learning Environment, says The Register. But Universe will begin with the largest library of games and resources ever assembled. “Out of the box, Universe comprises thousands of games (e.g. Flash games, slither.io, Starcraft), browser-based tasks (e.g. form filling), and applications (e.g. fold.it),” the OpenAI blog claims. Gaming companies that are cooperating with OpenAI include Flash, Microsoft – OpenAI announced a strategic partnership with the Redmond-based software giant – EA, Valve, Nvidia, Zachtronics, Wolfram, and others.

Advertisement

Universe is about more than gaming.  It’s main focus is on training AI agents to complete common online tasks with speed and accuracy. “Today, our agents are mostly learning to interact with common user interface elements like buttons, lists and sliders, but in the future they could complete complex tasks, such as looking up things they don’t know on the internet, managing your email or calendar, completing Khan Academy lessons, or working on Amazon Mechanical Turk and CrowdFlower tasks.”

The OpenAI blog post introducing Universe gives a long and detailed accounting of how Universe was created and what it hopes to accomplish. At the end, it provides a number of ways that companies and individuals can contribute to the process. It’s fascinating reading for anyone interested in what the future of computing is likely to be.

There is also a darker side to artificial intelligence, which Elon Musk refers to as “summoning the Devil.” As The Register suggests, “While making software smarter may appeal to researchers, society as a whole appears to be increasingly unnerved by the prospect. Beyond the speculative fears about malevolent AI and more realistic concerns about the automation of military weaponry, companies and individuals already have trouble dealing with automated forms of interaction.”

One area of concern is that AI agents may one day be able to reactivate themselves after being shut down by human controllers. What was once the stuff of science fiction such as Minority Report and I, Robot could one day become all too real.

Advertisement

OpenAI Universe has been open-sourced on Github for those that may be interested in testing their own video game bot. We’ve included a video below showing OpenAI in action.

"I write about technology and the coming zero emissions revolution."

Advertisement
Comments

News

Tesla reveals huge Cybercab detail in new guide for First Responders

Published

on

Credit: Tesla

Tesla revealed a major new Cybercab detail in a guide it released for First Responders, showing new territory in its beliefs and intentions for the ride-hailing-focused vehicle that entered production in April.

The First Responders Guide is released to give fire departments, paramedics, and other emergency personnel the proper guidance on what to do in the event of an accident, entrapment, or other situation that would require immediate attention.

On one of the pages of the First Responders Guide, Tesla revealed a stark detail about the Cybercab, which could help personnel enter the vehicle more easily in case of an emergency.

Tesla Cybercab has one important piece that AI4 cars might need for FSD

Advertisement

It shows Tesla has no intention of releasing any Cybercab units that were initially proposed for ride-hailing services for the general public with any manual controls, meaning a steering wheel or pedals:

“A Cybercab equipped with steering wheel, brake pedal, and an acceleration pedal is typically an engineering or test vehicle, and operates at SAE Level 2 autonomy. Cybercab is not typically equipped with a steering wheel or acceleration and brake pedals.”

This is a major development for those who continue to believe Tesla planned to release the Cybercab with any sort of manual controls so that passengers could take over if needed. However, when Tesla started manufacturing production versions of the Cybercab in Giga Texas earlier this year, they were spotted without a steering wheel or pedals.

It essentially confirms the company has no intentions of bringing manual controls to the car’s production versions. Some have argued that the likelihood of Tesla having something

There still are some Cybercab units out there with a steering wheel and pedals, and as Tesla said, these cars are engineering or test vehicles, which have Safety Monitors on board to help the car out of a precarious situation or emergency.

Advertisement
Continue Reading

News

Tesla Full Self-Driving v14 ‘Lite’ Release Notes: new capabilities and features

Published

on

(Credit: Megan Gale/Twitter)

Tesla released the Full Self-Driving v14 ‘Lite’ suite to owners of Hardware 3 or AI3 vehicles today, adding several new features to the vehicles that were once believed to be capable of unsupervised self-driving.

Now, Tesla has released this modified suite to older Tesla vehicles, adding plenty of new features and capabilities.

Here are the full release notes for the suite:

  • Distilled the intelligence from HW4 V14 into HW3. This allows HW3 to directly learn how to handle scenarios using HW4 V14 as a guide. This process unlocks the improvements that have been made to HW4 including Reinforcement Learning (RL) and offline models for HW3.
  • Improved both proactive and reactive responsiveness across a wide variety of categories including navigation handling, merges and forks, pedestrian interactions, traffic lights, and vehicle cut-in scenarios.
  • Improved general comfort in nominal scenarios through fewer false slowdowns, smoother steering and more consistent lane centering.
  • Introduced parking, unparking, and reversing capabilities.
  • Added Arrival Options for you to select where FSD should park: in a Parking Lot, on the Street, in a Driveway, or at the Curbside.
  • Speed Profiles are now available at all times, to further customize driving style preference.

These improvements, according to Tesla’s Head of AI, Ashok Elluswamy, help distill the driving behavior from AI4’s v14 series into both the camera and compute configurations of AI3.

Tesla Full Self-Driving v14 ‘Lite’ for older cars finally gets released

Advertisement

He added:

“It includes destination options and speed profiles on city roads, but more importantly significantly improved safety. We hope you’ll enjoy it, once the build ships wide.”

Tesla will continue to roll out the v14 Lite suite more widely in the coming weeks, the company said.

Continue Reading

News

Tesla Full Self-Driving v14 ‘Lite’ for older cars finally gets released

Published

on

tesla model 3 model y
Credit: Tesla Inc.

Tesla has finally released its Full Self-Driving v14 ‘Lite’ suite for older cars that equip the Hardware 3 or AI 3 chip, which have not been able to handle the newest versions of the company’s driver assistance software.

Tesla officially started releasing the v14 Lite suite to owners in the Early Access Program last night. The company’s Head of AI, Ashok Elluswamy, said that the rollout will continue over the next few weeks. The build distills the driving behavior from AI4’s v14 series into both the camera and compute configurations of an AI3 car.

It also includes a variety of new features that were available to AI4 cars running v14, including:

  • Start Self-Driving from Park
  • Arrival and Parking Options
  • Speed Profiles

The release is highly anticipated because those owners with AI3 vehicles were early adopters into the FSD platform and were promised that their cars would be capable of achieving Full Self-Driving.

However, Tesla CEO Elon Musk admitted during the company’s recent Q1 Earnings Call that these vehicles would not be capable of achieving unsupervised Full Self-Driving, which is what Tesla had originally said.

Owners were not pleased with this answer, or the idea that their commitment to buying the suite outright for thousands of dollars would not yield the ability to drive without operating the car. Tesla gave some solutions for this, including a discount on a new car, or an upgrade to an AI4 or AI5 self-driving computer and new, upgraded cameras.

Advertisement

Tesla owners do not seem pleased with these options, as they require giving the company more money.

Nevertheless, it is important to note that Tesla came through for owners here by releasing v14 Lite before the end of Q2, something it had promised owners during the previous Earnings Call. Tesla has had trouble keeping up with timelines, but this is a big achievement for the team.

Continue Reading