• WeeklyDispatch.AI
  • Posts
  • The week in AI: Google DeepMind's robot assistant that learns from humans

The week in AI: Google DeepMind's robot assistant that learns from humans

Plus: GitHub makes Copilot Chat generally available

 

Welcome to The Dispatch! We are the newsletter that keeps you informed about AI. Each Thursday, we aggregate the major developments in artificial intelligence; we pass along the news, useful resources, tools or services, and exciting projects in open source. Even if you aren’t an engineer, we’ll keep you in touch with what’s going on in AI.

New research from Google DeepMind and Stanford Artificial Intelligence could help bring a robotic assistant to your household soon - and at a cheaper price than you might expect. The new robot system called Mobile ALOHA lets a human control it to gather data as if they were the robot; ALOHA then aligns the control data with its own programming to copy the task.

By combining data from both systems, the robot became much better at doing tasks that involve moving around and using both hands. With 50 examples of each task, the robot learned to do things like cook and serve shrimp, open a big cabinet to put away heavy pots, call and get into an elevator, and wash a pan under a faucet. By learning from these examples, the robot's success rate in the given tasks went up by as much as 90%.

Check out the tutorial to build your own ALOHA for just under $32k (allen keys and hot glue gun sold separately). The hardware code, learning code and datasets are openly available on the project site.

Google’s autonomous driving technology company Waymo has published a study comparing the safety of its driverless vehicle service to human driving benchmarks. The study analyzed over 7 million miles of fully autonomous driving in Phoenix, San Francisco, and Los Angeles, comparing the crash rates from this real-world data to human crash benchmarks derived from police reports and driving studies. The results? Waymo's autonomous system had significantly lower rates of police-reported crashes (57% lower) and any injury crashes (85% lower) compared to human drivers.

Waymo’s driverless vehicle competitor Cruise (General Motors), conversely, has been trying to overcome an ‘all time low’ over a series of recent safety failures.

New research by the nonprofit Global Fishing Watch is using advances in artificial intelligence and satellite imagery for an unprecedented view of human activity across the world's oceans. Researchers analyzed five years of satellite data using deep learning models to precisely map global fishing, shipping, and offshore energy development.

The maps showed that a whopping 3 out of 4 industrial fishing ships worldwide dodge public monitoring systems, with large clusters operating secretly along the coasts of Africa and Asia. The satellite imagery also spotlighted a surge in offshore wind farms and oil rigs, underscoring the need to align environmental conservation efforts, energy demands, and maritime resource management in increasingly crowded oceans. According to the researchers, this groundbreaking use of AI and satellites will open new possibilities for smarter ocean management and conservation.

Microsoft is hoping to kick off the ‘AI era’ for PC’s in 2024 with the push of a button - or at least the new Copilot key, the first major change to Windows keyboards in 30 years. A new Windows logo-styled key will activate Copilot to engage Microsoft's comprehensive AI assistant. The new key aims to simplify using AI across everyday tasks as the tech becomes more personalized, intelligent and integrated across Windows applications. The update will start appearing on new Windows 11 devices beginning in late February, including on the upcoming Microsoft Surface devices.

Nikon, Sony Group, and Canon are developing new camera technology to combat the rise of AI-generated deepfakes. Photos from these cameras will be embedded with tamper-resistant digital details in photos like date, time, location, photographer identity and other signatures that will help verify the authenticity of images. To facilitate this, an alliance of global news organizations, technology companies and camera makers has launched a free web-based tool called ‘Verify’ for checking images for these signatures, flagging AI-created or altered images.

Sony plans to introduce this technology in professional-grade cameras through a firmware update in 2024, with potential video compatibility. Canon is also developing a similar camera and a technology for adding digital signatures to videos.

More in AI this week:

Trending AI tools/services:

  • Readbay.ai: the first “commit-to-read” AI app, an effortless way to grow maximally with minimal reading

  • ZOYO: cutting-edge AI-powered real estate tools designed for realtors, brokerages, homeowners, interior designers, builders, contractors, and architects

  • Jan: open-source ChatGPT alternative that runs 100% offline on your computer

  • Thus Spoke Zaranova: the game where you as a human must pose as an AI to save humanity

  • WhatOnEarth: AI search engine that lets you chat with the entire internet

  • ShotSolve: free mac app that allows you to take a screenshot and quickly ask GPT-4 Vision about it

  • Script.It: the no-code platform that lets you easily build complex AI workflows for your business

  • PikToChart: uses AI to quickly create high-quality infographics

Guides/lists/informative:

Social media/videos/podcasts:

  • ChatGPT acting as a real-time translator between someone who only speaks English and someone who only speaks Portuguese [X]

  • Using GPT to build an entire game without seeing a single line of code [X]

  • 4 Reasons AI in 2024 is On An Exponential: Data, Mamba, and More [YouTube]

  • (Discussion) ChatGPT will lie, cheat and use insider trading when under pressure to make money, research shows [Reddit]

  • (Discussion) Big layoff at DuoLingo due to AI? [Reddit]

  • Examining open-source frameworks and AI in medicine with interventional radiologist Dr. Judy Gichoya [Podcast]

Open source/technical/research papers:

More and more, we’re seeing AI used to replicate someone’s likeness and voice in novel ways without consent or compensation. Our laws need to keep up with this quickly evolving technology.

- Sen. Amy Klobuchar (D-Minn.), Jan 2024