All categories
Tools & Automation
CLI tools, utilities, converters, workflow automation, and productivity helpers
- 49,210
- 2,051
Security grades appear on each card once the skill has been scanned. Newly imported skills may briefly show without a grade until the backfill job runs.
Open in full browserBrowse tools & automation skills
Showing 19,249–19,272 of 49,210 skills
- Lamarckian Platform Pushing The Boundaries Of Evolutionary Reinforcement Learning Towards Asynchronous Commercial Games**arXiv ID:** 2209.10055 **Authors:** Hui Bai, Ruimin Shen, Yue Lin, Botian Xu, Ran Cheng **Published:** 2022-09-21T00:55:55Z **Abstract:** Despite the emerging progress of integrating evolutionary computation into reinforcement learning, the absence of a high-performance platform endowing composability and massive parallelism causes non-trivial difficulties for research and applications related to asynchronous commercial games. Here we introduce Lamarckian - an open-source platform featuring...Votes: 0GitHub stars: 3
- Katakomba Tools And Benchmarks For Datadriven Nethack**arXiv ID:** 2306.08772 **Authors:** Vladislav Kurenkov, Alexander Nikulin, Denis Tarasov, Sergey Kolesnikov **Published:** 2023-06-14T22:50:25Z **Abstract:** NetHack is known as the frontier of reinforcement learning research where learning-based methods still need to catch up to rule-based solutions. One of the promising directions for a breakthrough is using pre-collected datasets similar to recent developments in robotics, recommender systems, and more under the umbrella of offline reinf...Votes: 0GitHub stars: 3
- Improving The Data Efficiency Of Multiobjective Qualitydiversity Through Gradient Assistance And Crowding Exploration**arXiv ID:** 2302.12668 **Authors:** Hannah Janmohamed, Thomas Pierrot, Antoine Cully **Published:** 2023-02-24T14:48:28Z **Abstract:** Quality-Diversity (QD) algorithms have recently gained traction as optimisation methods due to their effectiveness at escaping local optima and capability of generating wide-ranging and high-performing solutions. Recently, Multi-Objective MAP-Elites (MOME) extended the QD paradigm to the multi-objective setting by maintaining a Pareto front in each cell of a...Votes: 0GitHub stars: 3
- Hypernca Growing Developmental Networks With Neural Cellular Automata**arXiv ID:** 2204.11674 **Authors:** Elias Najarro, Shyam Sudhakaran, Claire Glanois, Sebastian Risi **Published:** 2022-04-25T14:08:50Z **Abstract:** In contrast to deep reinforcement learning agents, biological neural networks are grown through a self-organized developmental process. Here we propose a new hypernetwork approach to grow artificial neural networks based on neural cellular automata (NCA). Inspired by self-organising systems and information-theoretic approaches to developmental...Votes: 0GitHub stars: 3
- Hindsight Experience Replay**arXiv ID:** 1707.01495 **Authors:** Marcin Andrychowicz, Filip Wolski, Alex Ray, Jonas Schneider, Rachel Fong, Peter Welinder, Bob McGrew, Josh Tobin, Pieter Abbeel, Wojciech Zaremba **Published:** 2017-07-05T17:55:53Z **Abstract:** Dealing with sparse rewards is one of the biggest challenges in Reinforcement Learning (RL). We present a novel technique called Hindsight Experience Replay which allows sample-efficient learning from rewards which are sparse and binary and therefore avoid the n...Votes: 0GitHub stars: 3
- Guiding Evolutionary Strategies By Differentiable Robot Simulators**arXiv ID:** 2110.00438 **Authors:** Vladislav Kurenkov, Bulat Maksudov **Published:** 2021-10-01T14:20:00Z **Abstract:** In recent years, Evolutionary Strategies were actively explored in robotic tasks for policy search as they provide a simpler alternative to reinforcement learning algorithms. However, this class of algorithms is often claimed to be extremely sample-inefficient. On the other hand, there is a growing interest in Differentiable Robot Simulators (DRS) as they potentially can ...Votes: 0GitHub stars: 3
- Graying The Black Box Understanding Dqns**arXiv ID:** 1602.02658 **Authors:** Tom Zahavy, Nir Ben Zrihem, Shie Mannor **Published:** 2016-02-08T17:27:31Z **Abstract:** In recent years there is a growing interest in using deep representations for reinforcement learning. In this paper, we present a methodology and tools to analyze Deep Q-networks (DQNs) in a non-blind matter. Moreover, we propose a new model, the Semi Aggregated Markov Decision Process (SAMDP), and an algorithm that learns it automatically. The SAMDP model allows us ...Votes: 0GitHub stars: 3
- Genetic Multiarmed Bandits A Reinforcement Learning Approach For Discrete Optimization Via Simulation**arXiv ID:** 2302.07695 **Authors:** Deniz Preil, Michael Krapp **Published:** 2023-02-15T14:46:19Z **Abstract:** This paper proposes a new algorithm, referred to as GMAB, that combines concepts from the reinforcement learning domain of multi-armed bandits and random search strategies from the domain of genetic algorithms to solve discrete stochastic optimization problems via simulation. In particular, the focus is on noisy large-scale problems, which often involve a multitude of dimensions ...Votes: 0GitHub stars: 3
- Generalized Populationbased Training For Hyperparameter Optimization In Reinforcement Learning**arXiv ID:** 2404.08233 **Authors:** Hui Bai, Ran Cheng **Published:** 2024-04-12T04:23:20Z **Abstract:** Hyperparameter optimization plays a key role in the machine learning domain. Its significance is especially pronounced in reinforcement learning (RL), where agents continuously interact with and adapt to their environments, requiring dynamic adjustments in their learning trajectories. To cater to this dynamicity, the Population-Based Training (PBT) was introduced, leveraging the collecti...Votes: 0GitHub stars: 3
- Functional Regularization For Reinforcement Learning Via Learned Fourier Features**arXiv ID:** 2112.03257 **Authors:** Alexander C. Li, Deepak Pathak **Published:** 2021-12-06T18:59:52Z **Abstract:** We propose a simple architecture for deep reinforcement learning by embedding inputs into a learned Fourier basis and show that it improves the sample efficiency of both state-based and image-based RL. We perform infinite-width analysis of our architecture using the Neural Tangent Kernel and theoretically show that tuning the initial variance of the Fourier basis is equivalen...Votes: 0GitHub stars: 3
- From Atomic Actions To Standard Operating Procedures Iterative ToolTool utilization enables Large Language Model (LLM) agents to interact with the real world and resolve complex tasks. However, existing agent frameworks predominantly rely on static toolsets composed. Based on arXiv:2607.07321.Votes: 0GitHub stars: 3
- Exploring Deep And Recurrent Architectures For Optimal Control**arXiv ID:** 1311.1761 **Authors:** Sergey Levine **Published:** 2013-11-07T17:39:31Z **Abstract:** Sophisticated multilayer neural networks have achieved state of the art results on multiple supervised tasks. However, successful applications of such multilayer networks to control have so far been limited largely to the perception portion of the control pipeline. In this paper, we explore the application of deep and recurrent neural networks to a continuous, high-dimensional locomotion task,...Votes: 0GitHub stars: 3
- Evolving Reinforcement Learning Algorithms**arXiv ID:** 2101.03958 **Authors:** John D. Co-Reyes, Yingjie Miao, Daiyi Peng, Esteban Real, Sergey Levine, Quoc V. Le, Honglak Lee, Aleksandra Faust **Published:** 2021-01-08T18:55:07Z **Abstract:** We propose a method for meta-learning reinforcement learning algorithms by searching over the space of computational graphs which compute the loss function for a value-based model-free RL agent to optimize. The learned algorithms are domain-agnostic and can generalize to new environments not s...Votes: 0GitHub stars: 3
- Evolutionary Algorithms For Reinforcement Learning**arXiv ID:** 1106.0221 **Authors:** J. J. Grefenstette, D. E. Moriarty, A. C. Schultz **Published:** 2011-06-01T16:16:14Z **Abstract:** There are two distinct approaches to solving reinforcement learning problems, namely, searching in value function space and searching in policy space. Temporal difference methods and evolutionary algorithms are well-known examples of these approaches. Kaelbling, Littman and Moore recently provided an informative survey of temporal difference ...Votes: 0GitHub stars: 3
- Enhancing Mapelites With Multiple Parallel Evolution Strategies**arXiv ID:** 2303.06137 **Authors:** Manon Flageat, Bryan Lim, Antoine Cully **Published:** 2023-03-10T18:55:02Z **Abstract:** With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied. However, we have yet to understand how to best use a large number of evaluations as using them for random variations alone is not always effective. Hig...Votes: 0GitHub stars: 3
- Endtoend Egospheric Spatial Memory**arXiv ID:** 2102.07764 **Authors:** Daniel Lenton, Stephen James, Ronald Clark, Andrew J. Davison **Published:** 2021-02-15T18:59:07Z **Abstract:** Spatial memory, or the ability to remember and recall specific locations and objects, is central to autonomous agents' ability to carry out tasks in real environments. However, most existing artificial memory modules are not very adept at storing spatial information. We propose a parameter-free module, Egospheric Spatial Memory (ESM), which enco...Votes: 0GitHub stars: 3
- Efficient Offpolicy Reinforcement Learning Via Braininspired Computing**arXiv ID:** 2205.06978 **Authors:** Yang Ni, Danny Abraham, Mariam Issa, Yeseong Kim, Pietro Mercati, Mohsen Imani **Published:** 2022-05-14T05:50:54Z **Abstract:** Reinforcement Learning (RL) has opened up new opportunities to enhance existing smart systems that generally include a complex decision-making process. However, modern RL algorithms, e.g., Deep Q-Networks (DQN), are based on deep neural networks, resulting in high computational costs. In this paper, we propose QHD, an off-policy...Votes: 0GitHub stars: 3
- Efficient Exploration Using Modelbased Qualitydiversity With Gradients**arXiv ID:** 2211.12610 **Authors:** Bryan Lim, Manon Flageat, Antoine Cully **Published:** 2022-11-22T22:19:01Z **Abstract:** Exploration is a key challenge in Reinforcement Learning, especially in long-horizon, deceptive and sparse-reward environments. For such applications, population-based approaches have proven effective. Methods such as Quality-Diversity deals with this by encouraging novel solutions and producing a diversity of behaviours. However, these methods are driven by either u...Votes: 0GitHub stars: 3
- Dynamic Reinforcement Learning For Actors**arXiv ID:** 2502.10200 **Authors:** Katsunari Shibata **Published:** 2025-02-14T14:50:05Z **Abstract:** Dynamic Reinforcement Learning (Dynamic RL), proposed in this paper, directly controls system dynamics, instead of the actor (action-generating neural network) outputs at each moment, bringing about a major qualitative shift in reinforcement learning (RL) from static to dynamic. The actor is initially designed to generate chaotic dynamics through the loop with its environment, enabling th...Votes: 0GitHub stars: 3
- Dynamic Planning Networks**arXiv ID:** 1812.11240 **Authors:** Norman Tasfi, Miriam Capretz **Published:** 2018-12-28T22:37:30Z **Abstract:** We introduce Dynamic Planning Networks (DPN), a novel architecture for deep reinforcement learning, that combines model-based and model-free aspects for online planning. Our architecture learns to dynamically construct plans using a learned state-transition model by selecting and traversing between simulated states and actions to maximize information before acting. In contrast ...Votes: 0GitHub stars: 3
- Dynamic Frame Skip Deep Q Network**arXiv ID:** 1605.05365 **Authors:** Aravind Srinivas, Sahil Sharma, Balaraman Ravindran **Published:** 2016-05-17T20:58:41Z **Abstract:** Deep Reinforcement Learning methods have achieved state of the art performance in learning control policies for the games in the Atari 2600 domain. One of the important parameters in the Arcade Learning Environment (ALE) is the frame skip rate. It decides the granularity at which agents can control game play. A frame skip value of $k$ allows the agent to ...Votes: 0GitHub stars: 3
- Distributed Deep Qlearning**arXiv ID:** 1508.04186 **Authors:** Hao Yi Ong, Kevin Chavez, Augustus Hong **Published:** 2015-08-18T01:00:32Z **Abstract:** We propose a distributed deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is based on the deep Q-network, a convolutional neural network trained with a variant of Q-learning. Its input is raw pixels and its output is a value function estimating future rewards from taking an...Votes: 0GitHub stars: 3
- Differentiable Quantum Architecture Search In Asynchronous Quantum Reinforcement Learning**arXiv ID:** 2407.18202 **Authors:** Samuel Yen-Chi Chen **Published:** 2024-07-25T17:11:00Z **Abstract:** The emergence of quantum reinforcement learning (QRL) is propelled by advancements in quantum computing (QC) and machine learning (ML), particularly through quantum neural networks (QNN) built on variational quantum circuits (VQC). These advancements have proven successful in addressing sequential decision-making tasks. However, constructing effective QRL models demands significant expe...Votes: 0GitHub stars: 3
- Deepcpg Policies For Robot Locomotion**arXiv ID:** 2302.13191 **Authors:** Aditya M. Deshpande, Eric Hurd, Ali A. Minai, Manish Kumar **Published:** 2023-02-25T23:16:57Z **Abstract:** Central Pattern Generators (CPGs) form the neural basis of the observed rhythmic behaviors for locomotion in legged animals. The CPG dynamics organized into networks allow the emergence of complex locomotor behaviors. In this work, we take this inspiration for developing walking behaviors in multi-legged robots. We present novel DeepCPG policies th...Votes: 0GitHub stars: 3