Hands-On Q-Learning with Python. Practical Q-learning with OpenAI Gym, Keras, and TensorFlow

Nazia Habib

Q-learning is a machine learning algorithm used to solve optimization problems in artificial intelligence (AI). It is one of the most popular fields of study among AI researchers.This book starts off by introducing you to reinforcement learning and Q-learning, in addition to helping you become familiar with OpenAI Gym as well as libraries such as Keras and TensorFlow. A few chapters into the book, you will gain insights into model-free Q-learning and use deep Q-networks and double deep Q-networks to solve complex problems. This book will guide you in exploring use cases such as self-driving vehicles and OpenAI Gym’s CartPole problem. You will also learn how to tune and optimize Q-networks and their hyperparameters. As you progress, you will understand the reinforcement learning approach to solving real-world problems. You will also explore how to use Q-learning and related algorithms in scientific research. Toward the end, you’ll gain insight into what’s in store for reinforcement learning.By the end of this book, you will be equipped with the skills you need to solve reinforcement learning problems using Q-learning algorithms with OpenAI Gym, Keras, and TensorFlow.

SketchBook Pro Digital Painting Essentials. Explore the styles and capabilities of Sketchbook Pro with this excellent guide to the essentials of digital painting. In no time, you'll be bringing your own unique creativity to the virtual easel or drawing pad

Gil Robles

Sketchbook Pro is a professional grade painting app that is easy to use and which helps you create digital art that looks like paintings created using ink and color. Using Sketchbook Pro, you can transform your digital art into true masterpieces that resemble work done using traditional mediums.SketchBook Pro Digital Painting Essentials will show you how to transform your digital art into true masterpieces. This book will guide you through the many tools and options available in Sketchbook Pro such as the symmetry tool, layer editor, and blend modes to create images that look as though they were done by hand using traditional tools and mediums. This unique book offers inspiration with hands-on techniques and gives you an insight into a professional artist's mind.Starting with an overview of the program, this book will help you customize and set your preferences to help you produce the best possible images for use on the Web or for print. You will be able to look over the author's shoulder as he demonstrates the use of the tools to create artwork that looks like it was painted or inked. This book will then show you how you can draw basic illustrations and then how to create acrylic paintings. You will also learn about file saving options; which ones are best for what you intend to do with the artwork. The book will also show you how to export the images you've created to other software and will give you tips and tricks that will help you make the most out of Sketchbook Pro. SketchBook Pro Digital Painting Essentials will give you an extensive overview complete with supporting imagery of how each piece of art was made, and by the end of this book, you will have created multiple drawings using Sketchbook Pro.

LLVM Essentials. Become familiar with the LLVM infrastructure and start using LLVM libraries to design a compiler

Mayur Pandey, Suyog Sarda, David Farago

LLVM is currently the point of interest for many firms, and has a very active open source community. It provides us with a compiler infrastructure that can be used to write a compiler for a language. It provides us with a set of reusable libraries that can be used to optimize code, and a target-independent code generator to generate code for different backends. It also provides us with a lot of other utility tools that can be easily integrated into compiler projects.This book details how you can use the LLVM compiler infrastructure libraries effectively, and will enable you to design your own custom compiler with LLVM in a snap.We start with the basics, where you’ll get to know all about LLVM. We then cover how you can use LLVM library calls to emit intermediate representation (IR) of simple and complex high-level language paradigms. Moving on, we show you how to implement optimizations at different levels, write an optimization pass, generate code that is independent of a target, and then map the code generated to a backend. The book also walks you through CLANG, IR to IR transformations, advanced IR block transformations, and target machines. By the end of this book, you’ll be able to easily utilize the LLVM libraries in your own projects.

jQuery Mobile Cookbook. Over 80 recipes with examples and practical tips to help you quickly learn and develop cross-platform applications with jQuery Mobile book and

Chetan Jain

jQuery Mobile is an award winning, HTML5/CSS3 based open source cross-platform UI framework. It offers a very cool and highly customizable UX. It is built on the popular jQuery library and uses declarative coding making it easy to use and learn. It is the market leader today considering the numerous browsers and platforms that it supports.jQuery Mobile Cookbook presents over a hundred recipes written in a simple and easy manner. You can quickly learn and start writing code immediately. Advanced topics such as using scripts to manipulate, customize, and extend the framework are also covered. These tips address your common everyday problems. The book is very handy for both beginner and experienced jQuery Mobile developers.You start by developing simple apps using various controls and learn to customize them. Later you explore using advanced aspects like configurations, events, and methods.Develop single and multi-page applications. Use caching to boost performance. Use custom transitions, icon sprites, styles, and themes. Learn advanced features like configurations, events, and methods. Explore future trends by using HTML5 new features and semantics with jQuery Mobile.jQuery Mobile Cookbook is an easy read and is packed with practical tips and screenshots.

Penetration Testing with BackBox. This tutorial will immerse you in the fascinating environment of penetration testing. Thoroughly practical and written for ease of understanding, it will give you the insights and knowledge you need to start using BackBox

Stefan Umit Uygur

Joomla! 3 Beginner's Guide. Build, develop, and manage a fully functioning, professional looking, and feature-rich website with the Joomla! CMS

Eric Tiggeler

Deep Learning for Natural Language Processing. Solve your natural language processing problems with smart deep neural networks

Karthiek Reddy Bokka, Shubhangi Hora, Tanuj Jain, Monicah Wambugu

Applying deep learning approaches to various NLP tasks can take your computational algorithms to a completely new level in terms of speed and accuracy. Deep Learning for Natural Language Processing starts by highlighting the basic building blocks of the natural language processing domain.The book goes on to introduce the problems that you can solve using state-of-the-art neural network models. After this, delving into the various neural network architectures and their specific areas of application will help you to understand how to select the best model to suit your needs. As you advance through this deep learning book, you’ll study convolutional, recurrent, and recursive neural networks, in addition to covering long short-term memory networks (LSTM). Understanding these networks will help you to implement their models using Keras. In later chapters, you will be able to develop a trigger word detection application using NLP techniques such as attention model and beam search.By the end of this book, you will not only have sound knowledge of natural language processing, but also be able to select the best text preprocessing and neural network models to solve a number of NLP issues.

Java Deep Learning Cookbook. Train neural networks for classification, NLP, and reinforcement learning using Deeplearning4j

Rahul Raj

Java is one of the most widely used programming languages in the world. With this book, you will see how to perform deep learning using Deeplearning4j (DL4J) – the most popular Java library for training neural networks efficiently.This book starts by showing you how to install and configure Java and DL4J on your system. You will then gain insights into deep learning basics and use your knowledge to create a deep neural network for binary classification from scratch. As you progress, you will discover how to build a convolutional neural network (CNN) in DL4J, and understand how to construct numeric vectors from text. This deep learning book will also guide you through performing anomaly detection on unsupervised data and help you set up neural networks in distributed systems effectively. In addition to this, you will learn how to import models from Keras and change the configuration in a pre-trained DL4J model. Finally, you will explore benchmarking in DL4J and optimize neural networks for optimal results.By the end of this book, you will have a clear understanding of how you can use DL4J to build robust deep learning applications in Java.

Master Data Science with Python. Combine Python with machine learning principles to discover hidden patterns in raw data

Rohan Chopra, Aaron England, Mohamed Noordeen Alaudeen

Data Science with Python begins by introducing you to data science and teaches you to install the packages you need to create a data science coding environment. You will learn three major techniques in machine learning: unsupervised learning, supervised learning, and reinforcement learning. You will also explore basic classification and regression techniques, such as support vector machines, decision trees, and logistic regression.As you make your way through the book, you will understand the basic functions, data structures, and syntax of the Python language that are used to handle large datasets with ease. You will learn about NumPy and pandas libraries for matrix calculations and data manipulation, discover how to use Matplotlib to create highly customizable visualizations, and apply the boosting algorithm XGBoost to make predictions. In the concluding chapters, you will explore convolutional neural networks (CNNs), deep learning algorithms used to predict what is in an image. You will also understand how to feed human sentences to a neural network, make the model process contextual information, and create human language processing systems to predict the outcome.By the end of this book, you will be able to understand and implement any new data science algorithm and have the confidence to experiment with tools or libraries other than those covered in the book.

Python Web Penetration Testing Cookbook. Over 60 indispensable Python recipes to ensure you always have the right code on hand for web application testing

Benjamin May, Cameron Buchanan, Andrew Mabbitt, Dave Mound, ...

Scala for Machine Learning. Leverage Scala and Machine Learning to construct and study systems that can learn from data

Patrick R. Nicolas

Mastering Adobe Captivate 8. Create responsive demonstrations, simulations, and quizzes for multiscreen delivery with Adobe Captivate

Damien Bruyndonckx

Building ETL Pipelines with Python. Create and deploy enterprise-ready ETL pipelines by employing modern methods

Brij Kishore Pandey, Emily Ro Schoof

Modern extract, transform, and load (ETL) pipelines for data engineering have favored the Python language for its broad range of uses and a large assortment of tools, applications, and open source components. With its simplicity and extensive library support, Python has emerged as the undisputed choice for data processing.In this book, you’ll walk through the end-to-end process of ETL data pipeline development, starting with an introduction to the fundamentals of data pipelines and establishing a Python development environment to create pipelines. Once you've explored the ETL pipeline design principles and ET development process, you'll be equipped to design custom ETL pipelines. Next, you'll get to grips with the steps in the ETL process, which involves extracting valuable data; performing transformations, through cleaning, manipulation, and ensuring data integrity; and ultimately loading the processed data into storage systems. You’ll also review several ETL modules in Python, comparing their pros and cons when building data pipelines and leveraging cloud tools, such as AWS, to create scalable data pipelines. Lastly, you’ll learn about the concept of test-driven development for ETL pipelines to ensure safe deployments.By the end of this book, you’ll have worked on several hands-on examples to create high-performance ETL pipelines to develop robust, scalable, and resilient environments using Python.

Azure Data Factory Cookbook. Build ETL, Hybrid ETL, and ELT pipelines using ADF, Synapse Analytics, Fabric and Databricks - Second Edition

Dmitry Foshin, Tonya Chernyshova, Dmitry Anoshin, Xenia Ireton

This new edition of the Azure Data Factory book, fully updated to reflect ADS V2, will help you get up and running by showing you how to create and execute your first job in ADF. There are updated and new recipes throughout the book based on developments happening in Azure Synapse, Deployment with Azure DevOps, and Azure Purview. The current edition also runs you through Fabric Data Factory, Data Explorer, and some industry-grade best practices with specific chapters on each.You’ll learn how to branch and chain activities, create custom activities, and schedule pipelines, as well as discover the benefits of cloud data warehousing, Azure Synapse Analytics, and Azure Data Lake Gen2 Storage. With practical recipes, you’ll learn how to actively engage with analytical tools from Azure Data Services and leverage your on-premises infrastructure with cloud-native tools to get relevant business insights. You'll familiarize yourself with the common errors that you may encounter while working with ADF and find out the solutions to them. You’ll also understand error messages and resolve problems in connectors and data flows with the debugging capabilities of ADF.By the end of this book, you’ll be able to use ADF with its latest advancements as the main ETL and orchestration tool for your data warehouse projects.

Web Development on Netlify. Proven strategies for building, deploying, and hosting modern web applications

Ekene Eze

Written by a former member of Netlify’s Developer Experience team, Web Development on Netlify is the ultimate companion for anyone looking to build, deploy, optimize, and scale frontend web applications on the platform. From setting up your account, and configuring settings and options, to deploying and optimizing web applications, this book offers comprehensive guidance through Netlify’s extensive capabilities, supported by step-by-step instructions and real-world examples.Focused on best practices and scalability, this invaluable resource is for both beginners and experienced developers, covering essential aspects such as performance optimization, A/B testing, webhooks, continuous deployment, and scaling considerations. Whether you want to get started with Netlify or expand your knowledge of the platform, this book has everything you need to take your web applications to the next level. Ekene’s clear and concise style makes it easy to understand even for readers with little to no Netlify experience.By the end of this book, you’ll be equipped with the expertise to revolutionize your workflow and take your web projects to new heights with Netlify, adhering to industry best practices every step of the way.

Modular Programming with PHP 7. Click here to enter text

Branko Ajzele

Modular design techniques help you build readable, manageable, reusable, and more efficient codes. PHP 7, which is a popular open source scripting language, is used to build modular functions for your software. With this book, you will gain a deep insight into the modular programming paradigm and how to achieve modularity in your PHP code. We start with a brief introduction to the new features of PHP 7, some of which open a door to new concepts used in modular development. With design patterns being at the heart of all modular PHP code, you will learn about the GoF design patterns and how to apply them. You will see how to write code that is easy to maintain and extend over time with the help of the SOLID design principles. Throughout the rest of the book, you will build different working modules of a modern web shop application using the Symfony framework, which will give you a deep understanding of modular application development using PHP 7.