Deep Reinforcement Learning with Python. Master classic RL, deep RL, distributional RL, inverse RL, and more with OpenAI Gym and TensorFlow - Second Edition

Sudharsan Ravichandiran

With significant enhancements in the quality and quantity of algorithms in recent years, this second edition of Hands-On Reinforcement Learning with Python has been revamped into an example-rich guide to learning state-of-the-art reinforcement learning (RL) and deep RL algorithms with TensorFlow 2 and the OpenAI Gym toolkit.In addition to exploring RL basics and foundational concepts such as Bellman equation, Markov decision processes, and dynamic programming algorithms, this second edition dives deep into the full spectrum of value-based, policy-based, and actor-critic RL methods. It explores state-of-the-art algorithms such as DQN, TRPO, PPO and ACKTR, DDPG, TD3, and SAC in depth, demystifying the underlying math and demonstrating implementations through simple code examples.The book has several new chapters dedicated to new RL techniques, including distributional RL, imitation learning, inverse RL, and meta RL. You will learn to leverage stable baselines, an improvement of OpenAI’s baseline library, to effortlessly implement popular RL algorithms. The book concludes with an overview of promising approaches such as meta-learning and imagination augmented agents in research.By the end, you will become skilled in effectively employing RL and deep RL in your real-world projects.

XR Development with Unity. A beginner's guide to creating virtual, augmented, and mixed reality experiences using Unity

Anna Braun, Raffael Rizzo

The drastic surge in the demand for XR development has led to an imminent need for comprehensive resources, learning material, and overall know-how in this area. This one-stop resource will ensure that professionals venturing into XR development can access all XR-related techniques to build appealing XR applications, without relying on Google every step of the way.This book is your guide to developing XR applications with Unity 2021.3 or later versions, helping you to create VR, AR, and MR experiences of increasing complexity. The chapters cover the entire XR application development process from setting up an interactive XR scene using the XR Interaction Toolkit or AR Foundation, adding physics, animations, continuous movement, teleportation, sound effects, and visual effects, to testing and deploying to VR headsets, simulators, smartphones, and tablets. Additionally, this XR book takes you on a journey from the basics of Unity and C# to advanced techniques such as building multiplayer applications and incorporating hand- and gaze-tracking capabilities.By the end of this book, you'll be fully equipped to create cutting-edge XR projects for engaging individual, academic, and industrial use cases that captivate your audience.

Transforming Healthcare with DevOps. A practical DevOps4Care guide to embracing the complexity of digital transformation

Jeroen Mulder, Henry Mulder

Healthcare today faces a multitude of challenges, which can be summed up as the barriers architects and consultants face in transforming the healthcare system into a more sustainable one. This book helps you to guide that transformation step by step.You’ll begin by understanding the need for this transformation, exploring related challenges, the possibilities of technology, and how human factors can be involved in digital transformation. The book will enable you to overcome inhibitions and plan various transformation steps using the Transformation into Sustainable Healthcare (TiSH) model and DevOps4Care. Next, you’ll use the observe, orient, decide, and act (OODA) loop as an iterative approach to address all stakeholders and adapt swiftly when situations change. Further, you’ll be able to build shared platforms that enable interaction between various stakeholders, including the technology-enabled care service teams. The final chapters will help you execute the transformation to sustainable healthcare using the knowledge you’ve gained while getting familiar with common pitfalls and learning how to avoid or mitigate them.By the end of this DevOps book, you will have an overview of the challenges, opportunities, and directions of solutions and be on your way toward starting the transformation into sustainable healthcare.

Building Data Science Applications with FastAPI. Develop, manage, and deploy efficient machine learning applications with Python

François Voron

FastAPI is a web framework for building APIs with Python 3.6 and its later versions based on standard Python-type hints. With this book, you’ll be able to create fast and reliable data science API backends using practical examples.This book starts with the basics of the FastAPI framework and associated modern Python programming language concepts. You'll be taken through all the aspects of the framework, including its powerful dependency injection system and how you can use it to communicate with databases, implement authentication and integrate machine learning models. Later, you’ll cover best practices relating to testing and deployment to run a high-quality and robust application. You’ll also be introduced to the extensive ecosystem of Python data science packages. As you progress, you’ll learn how to build data science applications in Python using FastAPI. The book also demonstrates how to develop fast and efficient machine learning prediction backends and test them to achieve the best performance. Finally, you’ll see how to implement a real-time face detection system using WebSockets and a web browser as a client.By the end of this FastAPI book, you’ll have not only learned how to implement Python in data science projects but also how to maintain and design them to meet high programming standards with the help of FastAPI.

Democratizing Application Development with AppSheet. A citizen developer's guide to building rapid low-code apps with the powerful features of AppSheet

Koichi Tsuji, Suvrutt Gurjar, Takuya Miyai

Many citizen developers regularly use spreadsheets in their business and day-to-day jobs. With AppSheet, you can take your spreadsheets to the next level by enhancing their ease of use. The platform allows you to run your business efficiently and manage it in the field outside of an office or indoor environment. This book enables you to create your own simple or medium to complex hybrid apps for business or personal use.As a beginner to AppSheet, this book will show you how the AppSheet Editor works and how it is used to configure, test, and deploy an app and share it with others as users or co-authors. You’ll learn about widely used features such as how to use data sources, create app views and actions, construct expressions with AppSheet functions, and make your app secure through security and UX options. Next, you’ll create email/attachment templates and develop reports/documents based on templates, store in the cloud, and send files through emails. You’ll also understand how to integrate third-party services and monitor various usage statistics of your app. As you progress, you’ll explore various features with the help of sample apps that you create using the book.By the end of this book, you’ll have learned how to make the most of AppSheet to build powerful and efficient applications.

GraphQL Best Practices. Gain hands-on experience with schema design, security, and error handling

Artur Czemiel

In the ever-evolving landscape of web development, GraphQL has emerged as a powerful query language that addresses the limitations of traditional REST APIs. This guide delves deep into GraphQL, starting with its foundational principles and swiftly advancing to complex topics that will equip you with the skills you need to understand this technology.As you progress, you’ll cover advanced concepts such as schema design, security enhancements, and error handling. You'll also explore essential topics such as federation and the transition from REST to GraphQL, gaining a comprehensive understanding of these critical areas. The book helps you learn through practical examples in TypeScript, guiding you through building scalable and secure GraphQL backends. Additionally, you’ll get up to speed with the intricacies of frontend integration.By the end of this book, you’ll have the skills you need to implement real-world GraphQL solutions, creating efficient and robust applications that meet modern web development demands.

Learning Mongoid. If you know MongoDB and Ruby, then Mongoid is a very handy tool to have at your disposal. Quickly learn to build Rails applications with the helpful code samples and instructions in this book

Gautam Rege

Mongoid helps you to leverage the power of schema-less and efficient document-based design, dynamic queries, and atomic modifier operations. Mongoid eases the work of Ruby developers while they are working on complex frameworks.Starting with why and how you should use Mongoid, this book covers the various components of Mongoid. It then delves deeper into the detail of queries and relations, and you will learn some tips and tricks on improving performance. With this book, you will be able to build robust and large-scale web applications with Mongoid and Rails.Starting with the basics, this book introduces you to components such as moped and origin, and how information is managed, learn about the various datatypes, embedded documents, arrays, and hashes. You will learn how a document is stored and manipulated with callbacks, validations, and even atomic updates. This book will then show you the querying mechanism in detail, right from simple to complex queries, and even explains eager loading, lazy evaluation, and chaining of queries. Finally, this book will explain the importance of performance tuning and how to use the right indexes. It also explains MapReduce and the Aggregation Framework.

Mastering iOS Game Development. Mastering iOS Game Development

Miguel DeQuadros

iOS is an operating system for Apple manufactured phones and tablets. Mobile gaming is one of the fastest-growing industries, and compatibility with iOS is now becoming the norm for game developers. SpriteKit is part of the native SDK from Apple, and enables developers to make simple entry into game development without unnecessary overhead and a long learning process. SpriteKit also provides other functionality that is useful for games, including basic sound playback support and physics simulation. In addition, Xcode provides built-in support for SpriteKit so that you can create complex special effects and texture atlases directly in Xcode. This combination of framework and tools makes SpriteKit a good choice for games and other apps that require similar kinds of animation. Become a master in iOS game development through this fast and fun guide! In the beginning, we’ll tell you everything you need to plan and design your game. You’ll then start developing your game through step-by-step instructions using the various built-in technologies of Xcode. From there on, we discuss how to deploy your game to the iOS App Store, as well as monetizing it to make more revenue. You will also learn advanced techniques to improve your game playing experience, including better multi-tasking, improved performance optimization, battery management, and more. To end the book off, we’ll show you how to update your game with different features, then port the update to the App Store.