Data Science by ODS.ai 🦜

2021-08-02 21:23:11 Pretrained Language Model

AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models

Github: https://github.com/huawei-noah/Pretrained-Language-Model

Paper: https://arxiv.org/abs/2107.13686v1

AutoTinyBERT: https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/AutoTinyBERT

@ai_machinelearning_big_data Open / Comment

2021-07-30 14:43:14 ​​Tonight at 9 p.m. Moscow Time, Russia’s Krasnaya Polyana resort will host the AI & Chess meetup, bringing together data scientists and professional chess players

Location: Galaxy Mall in Krasnaya Polyana, Sochi + livestream

Program:
9-9:05 p.m.
Introductory speech.

9:05-9:25 p.m. (Rus)
Mark Glukhovsky, Executive Director of the Russian Chess Federation: “Chess and Computer Technology: What AI Is and How It Is Changing the Chess World.”

9:25-9:40 p.m. (Rus)
Conversation with Sergei Shipov, a Russian professional chess player, grandmaster, chess coach and commentator: “The Role of the Computer in Professional Chess Player Training.”

9:40-9:55 p.m. (Rus)
Aleksandr Shimanov, a Russian professional chess player, grandmaster and commentator, reviews the most incredible game from the AlphaZero vs. Stockfish match, which pitted the most powerful chess engines against each other.

9:55-10:25 p.m. (Eng)
Ulrich Paquet and Nenad Tomašev, DeepMind researchers and authors of papers on AlphaZero in collaboration with Vladimir Kramnik: “Inner Workings of Chess Algorithms Based on AI and Neural Networks: AlphaZero and Beyond.”

10:25-10:45 p.m. (Eng)
Discussion:
— Effects of technology, AI engines and applications on a chess player’s training, style and mindset.
— Challenges that arise in the use of chess engines.
— Impact of chess on life and vice versa, and how the situation has evolved with the advances in chess technology.
— Future prospects of the chess-AI symbiosis in education, entertainment and self-development.

Discussion participants:
Ulrich Paquet and Nenad Tomašev, researchers, DeepMind;
Sergey Rykovanov (professor) and Yuri Shkandybin (systems architect), Skoltech’s supercomputing group;
Aleksandr Shimanov, Russian chess player, grandmaster.

Links:
Sign up: http://surl.li/abbvc
Livestream:

Open / Comment

2021-07-29 21:41:26 ​​Baidu announced opening 10k sq m park with 200 operating autonomous vehicles in China.

Source: https://twitter.com/Baidu_Inc/status/1420776376861405185

#Baidu #selfdriving Open / Comment

2021-07-29 10:25:03 New TTS Models for Minority Languages of the CIS / Russia

In collaboration with the community, we created totally unique models for the languages of the peoples of Russia / the CIS:

- Bashkir (aigul_v2)
- Kalmyk (erdni_v2)
- Tatar (dilyara_v2)
- Uzbek (dilnavoz_v2)

We also tried to create the Ukrainian voice, but the data we had (sourced from audiobooks) was not very good (all other voices were created from recordings).

Some models sound almost perfect, some a bit worse. Typically this boils down to how speakers can provide steady consistent recordings.

We used anywhere from 1 hour to 6 hours of recordings to create each voice.

These models obviously do not include automated stress and have the same major caveats as other v2 models (i.e. best used with batch size 1 on 2-4 CPU threads).

Link

- https://github.com/snakers4/silero-models#text-to-speech Open / Comment

2021-07-28 12:28:17 ​​Orbit — An Open Source Package for Time Series Inference and Forecasting

Object-ORiented BayesIan Time Series is a new project for #timeseries forecasting by #Uber team. Has #scikit-learn compatible interface and claimed to have results comparable to #prophet .

Post: https://eng.uber.com/orbit/
Docs: https://uber.github.io/orbit/about.html
GitHub: https://github.com/uber/orbit/ Open / Comment

2021-07-25 15:37:57 Researchers from NVIDIA (in particular Tero Karras) have once again "solved" image generation.

This time, the scientists were able to remove aliasing in the generator. In a nutshell, then the reason for the artifacts was careless signal processing in the CNN resulting in incorrect discretization. The signal could not be accurately reconstructed, which led to unnatural "jerks" noticeable in the video. The authors have modified the generator to prevent these negative sampling effects.

The resulting networks match the FID of StyleGAN2 but differ dramatically in their internal representations, and they are fully equivariant to translation and rotation even at subpixel scales.

The code is not available yet, but I'm sure NVIDIA will release it soon.

Read more about Alias-Free GAN here. Open / Comment

2021-07-23 17:28:30 ​​YOLOX: Exceeding YOLO Series in 2021


This paper presents a new high-performance variation of YOLO - YOLOX. Now it has an anchor-free detector, a decoupled head, and uses the leading label assignment strategy SimOTA.

Thanks to these changes, it reaches state-of-the-art results across a large scale range of models. For example, YOLOX-Nano gets 25.3% AP on COCO (+1.8% to NanoDet), YOLOX-L achieves 50.0% AP on COCO (+1.8 to YOLOv5-L).

For YOLOv3, one of the most widely used detectors in industry, they boost it to 47.3% AP on COCO, outperforming the current best practice by 3.0% AP.

The authors won the 1st Place on Streaming Perception Challenge (Workshop on Autonomous Driving at CVPR 2021) using a single YOLOX-L model.

They also provide deploy versions with ONNX, TensorRT, NCNN, and Openvino supported.

Paper: https://arxiv.org/abs/2107.08430

Code: https://github.com/Megvii-BaseDetection/YOLOX

A detailed unofficial overview of the paper: https://andlukyane.com/blog/paper-review-yolox

#deeplearning #cv #objectdetection #endtoend #anchorfree Open / Comment

2021-07-22 15:24:18 Natural Language Processing News

by Sebastian Ruder:

- Github Copilot: interesting upcoming technology that can leave you without job;
- The Perceiver: new architecture motivated by Transformer that can deal with very high-dimensional inputs;
- NL augementer: collaborative work that aims to collect all accepted transformations to NL; you still can participate and be a co-author of the paper!

and more here. Open / Comment

2021-07-21 09:52:00 Mava: a scalable, research framework for multi-agent reinforcement learning

The framework integrates with popular MARL environments such as PettingZoo, SMAC, RoboCup, OpenSpiel, Flatland , as well as a few custom environments.

Mava includes distributed implementations of multi-agent versions of ddpg, d4pg, dqn, ppo, as well as DIAL, VDN and QMIX.

ArXiV: https://arxiv.org/pdf/2107.01460.pdf
GitHub: https://github.com/instadeepai/Mava

#MARL #RL #dl Open / Comment

2021-07-20 15:31:09 ​​Politicians phone distraction tracking as an art project

Enthusiast used livestream of flemish goverment sessions to track those politicians who distracted on the phones during their worktime.

Project website: https://driesdepoorter.be/theflemishscrollers/
Twitter: https://twitter.com/FlemishScroller

#keras #neuroart #politics #ml4sg Open / Comment