Author: Rui Costa
Publisher: "O'Reilly Media, Inc."
ISBN: 149209286X
Category : Computers
Languages : en
Pages : 286
Book Description
Get quick hands-on experience with Google Cloud. This cookbook provides a variety of self-contained recipes that show you how to use Google Cloud services for your enterprise application. Whether you're looking for practical ways to apply microservices, AI, analytics, security, or networking solutions, these recipes take you step-by-step through the process and provide discussions that explain how and why the recipes work. Ideal for system engineers and administrators, developers, network and database administrators, and data analysts, this cookbook helps you get started with Google Cloud regardless of your level of experience. Google veterans Rui Costa and Drew Hodun also cover advanced-level Google Cloud services for those who have appreciable experience with the platform. Learn how to get started with Google Cloud Understand the depth of services Google Cloud provides Gain hands-on experience using practical examples and labs Explore topics that include BigQuery, Cloud Run, and Kubernetes Build and run mobile and web applications on Google Cloud Examine ways to build your cloud applications for scale Build a minimum viable product (MVP) app to use in production Learn data platform and pipeline skills
Google Cloud Cookbook
Author: Rui Costa
Publisher: "O'Reilly Media, Inc."
ISBN: 149209286X
Category : Computers
Languages : en
Pages : 286
Book Description
Get quick hands-on experience with Google Cloud. This cookbook provides a variety of self-contained recipes that show you how to use Google Cloud services for your enterprise application. Whether you're looking for practical ways to apply microservices, AI, analytics, security, or networking solutions, these recipes take you step-by-step through the process and provide discussions that explain how and why the recipes work. Ideal for system engineers and administrators, developers, network and database administrators, and data analysts, this cookbook helps you get started with Google Cloud regardless of your level of experience. Google veterans Rui Costa and Drew Hodun also cover advanced-level Google Cloud services for those who have appreciable experience with the platform. Learn how to get started with Google Cloud Understand the depth of services Google Cloud provides Gain hands-on experience using practical examples and labs Explore topics that include BigQuery, Cloud Run, and Kubernetes Build and run mobile and web applications on Google Cloud Examine ways to build your cloud applications for scale Build a minimum viable product (MVP) app to use in production Learn data platform and pipeline skills
Publisher: "O'Reilly Media, Inc."
ISBN: 149209286X
Category : Computers
Languages : en
Pages : 286
Book Description
Get quick hands-on experience with Google Cloud. This cookbook provides a variety of self-contained recipes that show you how to use Google Cloud services for your enterprise application. Whether you're looking for practical ways to apply microservices, AI, analytics, security, or networking solutions, these recipes take you step-by-step through the process and provide discussions that explain how and why the recipes work. Ideal for system engineers and administrators, developers, network and database administrators, and data analysts, this cookbook helps you get started with Google Cloud regardless of your level of experience. Google veterans Rui Costa and Drew Hodun also cover advanced-level Google Cloud services for those who have appreciable experience with the platform. Learn how to get started with Google Cloud Understand the depth of services Google Cloud provides Gain hands-on experience using practical examples and labs Explore topics that include BigQuery, Cloud Run, and Kubernetes Build and run mobile and web applications on Google Cloud Examine ways to build your cloud applications for scale Build a minimum viable product (MVP) app to use in production Learn data platform and pipeline skills
Google Cloud Cookbook
Author: Rui Santos Costa
Publisher: "O'Reilly Media, Inc."
ISBN: 1492092843
Category : Computers
Languages : en
Pages : 298
Book Description
Get quick hands-on experience with Google Cloud. This cookbook provides a variety of self-contained recipes that show you how to use Google Cloud services for your enterprise application. Whether you're looking for practical ways to apply microservices, AI, analytics, security, or networking solutions, these recipes take you step-by-step through the process and provide discussions that explain how and why the recipes work. Ideal for system engineers and administrators, developers, network and database administrators, and data analysts, this cookbook helps you get started with Google Cloud regardless of your level of experience. Google veterans Rui Costa and Drew Hodun also cover advanced-level Google Cloud services for those who have appreciable experience with the platform. Learn how to get started with Google Cloud Understand the depth of services Google Cloud provides Gain hands-on experience using practical examples and labs Explore topics that include BigQuery, Cloud Run, and Kubernetes Build and run mobile and web applications on Google Cloud Examine ways to build your cloud applications for scale Build a minimum viable product (MVP) app to use in production Learn data platform and pipeline skills
Publisher: "O'Reilly Media, Inc."
ISBN: 1492092843
Category : Computers
Languages : en
Pages : 298
Book Description
Get quick hands-on experience with Google Cloud. This cookbook provides a variety of self-contained recipes that show you how to use Google Cloud services for your enterprise application. Whether you're looking for practical ways to apply microservices, AI, analytics, security, or networking solutions, these recipes take you step-by-step through the process and provide discussions that explain how and why the recipes work. Ideal for system engineers and administrators, developers, network and database administrators, and data analysts, this cookbook helps you get started with Google Cloud regardless of your level of experience. Google veterans Rui Costa and Drew Hodun also cover advanced-level Google Cloud services for those who have appreciable experience with the platform. Learn how to get started with Google Cloud Understand the depth of services Google Cloud provides Gain hands-on experience using practical examples and labs Explore topics that include BigQuery, Cloud Run, and Kubernetes Build and run mobile and web applications on Google Cloud Examine ways to build your cloud applications for scale Build a minimum viable product (MVP) app to use in production Learn data platform and pipeline skills
Microsoft Defender for Cloud Cookbook
Author: Sasha Kranjac
Publisher: Packt Publishing Ltd
ISBN: 180107044X
Category : Computers
Languages : en
Pages : 314
Book Description
Effectively secure their cloud and hybrid infrastructure, how to centrally manage security, and improve organizational security posture Key Features • Implement and optimize security posture in Azure, hybrid, and multi-cloud environments • Understand Microsoft Defender for Cloud and its features • Protect workloads using Microsoft Defender for Cloud's threat detection and prevention capabilities Book Description Microsoft Defender for Cloud is a multi-cloud and hybrid cloud security posture management solution that enables security administrators to build cyber defense for their Azure and non-Azure resources by providing both recommendations and security protection capabilities. This book will start with a foundational overview of Microsoft Defender for Cloud and its core capabilities. Then, the reader is taken on a journey from enabling the service, selecting the correct tier, and configuring the data collection, to working on remediation. Next, we will continue with hands-on guidance on how to implement several security features of Microsoft Defender for Cloud, finishing with monitoring and maintenance-related topics, gaining visibility in advanced threat protection in distributed infrastructure and preventing security failures through automation. By the end of this book, you will know how to get a view of your security posture and where to optimize security protection in your environment as well as the ins and outs of Microsoft Defender for Cloud. What you will learn • Understand Microsoft Defender for Cloud features and capabilities • Understand the fundamentals of building a cloud security posture and defending your cloud and on-premises resources • Implement and optimize security in Azure, multi-cloud and hybrid environments through the single pane of glass - Microsoft Defender for Cloud • Harden your security posture, identify, track and remediate vulnerabilities • Improve and harden your security and services security posture with Microsoft Defender for Cloud benchmarks and best practices • Detect and fix threats to services and resources Who this book is for This book is for Security engineers, systems administrators, security professionals, IT professionals, system architects, and developers. Anyone whose responsibilities include maintaining security posture, identifying, and remediating vulnerabilities, and securing cloud and hybrid infrastructure. Anyone who is willing to learn about security in Azure and to build secure Azure and hybrid infrastructure, to improve their security posture in Azure, hybrid and multi-cloud environments by leveraging all the features within Microsoft Defender for Cloud.
Publisher: Packt Publishing Ltd
ISBN: 180107044X
Category : Computers
Languages : en
Pages : 314
Book Description
Effectively secure their cloud and hybrid infrastructure, how to centrally manage security, and improve organizational security posture Key Features • Implement and optimize security posture in Azure, hybrid, and multi-cloud environments • Understand Microsoft Defender for Cloud and its features • Protect workloads using Microsoft Defender for Cloud's threat detection and prevention capabilities Book Description Microsoft Defender for Cloud is a multi-cloud and hybrid cloud security posture management solution that enables security administrators to build cyber defense for their Azure and non-Azure resources by providing both recommendations and security protection capabilities. This book will start with a foundational overview of Microsoft Defender for Cloud and its core capabilities. Then, the reader is taken on a journey from enabling the service, selecting the correct tier, and configuring the data collection, to working on remediation. Next, we will continue with hands-on guidance on how to implement several security features of Microsoft Defender for Cloud, finishing with monitoring and maintenance-related topics, gaining visibility in advanced threat protection in distributed infrastructure and preventing security failures through automation. By the end of this book, you will know how to get a view of your security posture and where to optimize security protection in your environment as well as the ins and outs of Microsoft Defender for Cloud. What you will learn • Understand Microsoft Defender for Cloud features and capabilities • Understand the fundamentals of building a cloud security posture and defending your cloud and on-premises resources • Implement and optimize security in Azure, multi-cloud and hybrid environments through the single pane of glass - Microsoft Defender for Cloud • Harden your security posture, identify, track and remediate vulnerabilities • Improve and harden your security and services security posture with Microsoft Defender for Cloud benchmarks and best practices • Detect and fix threats to services and resources Who this book is for This book is for Security engineers, systems administrators, security professionals, IT professionals, system architects, and developers. Anyone whose responsibilities include maintaining security posture, identifying, and remediating vulnerabilities, and securing cloud and hybrid infrastructure. Anyone who is willing to learn about security in Azure and to build secure Azure and hybrid infrastructure, to improve their security posture in Azure, hybrid and multi-cloud environments by leveraging all the features within Microsoft Defender for Cloud.
Kubernetes - A Complete DevOps Cookbook
Author: Murat Karslioglu
Publisher: Packt Publishing Ltd
ISBN: 1838820337
Category : Computers
Languages : en
Pages : 576
Book Description
Leverage Kubernetes and container architecture to successfully run production-ready workloads Key FeaturesImplement Kubernetes to orchestrate and scale applications proficientlyLeverage the latest features of Kubernetes to resolve common as well as complex problems in a cloud-native environmentGain hands-on experience in securing, monitoring, and troubleshooting your applicationBook Description Kubernetes is a popular open source orchestration platform for managing containers in a cluster environment. With this Kubernetes cookbook, you’ll learn how to implement Kubernetes using a recipe-based approach. The book will prepare you to create highly available Kubernetes clusters on multiple clouds such as Amazon Web Services (AWS), Google Cloud Platform (GCP), Azure, Alibaba, and on-premises data centers. Starting with recipes for installing and configuring Kubernetes instances, you’ll discover how to work with Kubernetes clients, services, and key metadata. You’ll then learn how to build continuous integration/continuous delivery (CI/CD) pipelines for your applications, and understand various methods to manage containers. As you advance, you’ll delve into Kubernetes' integration with Docker and Jenkins, and even perform a batch process and configure data volumes. You’ll get to grips with methods for scaling, security, monitoring, logging, and troubleshooting. Additionally, this book will take you through the latest updates in Kubernetes, including volume snapshots, creating high availability clusters with kops, running workload operators, new inclusions around kubectl and more. By the end of this book, you’ll have developed the skills required to implement Kubernetes in production and manage containers proficiently. What you will learnDeploy cloud-native applications on KubernetesAutomate testing in the DevOps workflowDiscover and troubleshoot common storage issuesDynamically scale containerized services to manage fluctuating traffic needsUnderstand how to monitor your containerized DevOps environmentBuild DevSecOps into CI/CD pipelinesWho this book is for This Kubernetes book is for developers, IT professionals, and DevOps engineers and teams who want to use Kubernetes to manage, scale, and orchestrate applications in their organization. Basic understanding of Kubernetes and containerization is necessary.
Publisher: Packt Publishing Ltd
ISBN: 1838820337
Category : Computers
Languages : en
Pages : 576
Book Description
Leverage Kubernetes and container architecture to successfully run production-ready workloads Key FeaturesImplement Kubernetes to orchestrate and scale applications proficientlyLeverage the latest features of Kubernetes to resolve common as well as complex problems in a cloud-native environmentGain hands-on experience in securing, monitoring, and troubleshooting your applicationBook Description Kubernetes is a popular open source orchestration platform for managing containers in a cluster environment. With this Kubernetes cookbook, you’ll learn how to implement Kubernetes using a recipe-based approach. The book will prepare you to create highly available Kubernetes clusters on multiple clouds such as Amazon Web Services (AWS), Google Cloud Platform (GCP), Azure, Alibaba, and on-premises data centers. Starting with recipes for installing and configuring Kubernetes instances, you’ll discover how to work with Kubernetes clients, services, and key metadata. You’ll then learn how to build continuous integration/continuous delivery (CI/CD) pipelines for your applications, and understand various methods to manage containers. As you advance, you’ll delve into Kubernetes' integration with Docker and Jenkins, and even perform a batch process and configure data volumes. You’ll get to grips with methods for scaling, security, monitoring, logging, and troubleshooting. Additionally, this book will take you through the latest updates in Kubernetes, including volume snapshots, creating high availability clusters with kops, running workload operators, new inclusions around kubectl and more. By the end of this book, you’ll have developed the skills required to implement Kubernetes in production and manage containers proficiently. What you will learnDeploy cloud-native applications on KubernetesAutomate testing in the DevOps workflowDiscover and troubleshoot common storage issuesDynamically scale containerized services to manage fluctuating traffic needsUnderstand how to monitor your containerized DevOps environmentBuild DevSecOps into CI/CD pipelinesWho this book is for This Kubernetes book is for developers, IT professionals, and DevOps engineers and teams who want to use Kubernetes to manage, scale, and orchestrate applications in their organization. Basic understanding of Kubernetes and containerization is necessary.
Google Cloud Platform Cookbook
Author: Legorie Rajan PS
Publisher: Packt Publishing Ltd
ISBN: 1788294564
Category : Computers
Languages : en
Pages : 274
Book Description
Practical recipes to implement cost-effective and scalable cloud solutions for your organization Key Features Implement Google Cloud services in your organization Leverage Google Cloud components to secure your organization’s data A recipe-based guide that promises hands-on experience in deploying a highly scalable and available environment Book Description Google Cloud Platform is a cloud computing platform that offers products and services to host applications using state-of-the art infrastructure and technology. You can build and host applications and websites, store data, and analyze data on Google's scalable infrastructure. This book follows a recipe-based approach, giving you hands-on experience to make the most of Google Cloud services. This book starts with practical recipes that explain how to utilize Google Cloud's common services. Then, you'll see how to make full use of Google Cloud components such as networking, security, management, and developer tools. Next, we'll deep dive into implementing core Google Cloud services into your organization, with practical recipes on App Engine, Compute Engine microservices with Cloud Functions, virtual networks, and Cloud Storage. Later, we'll provide recipes on implementing authentication and security, Cloud APIs, command-line management, deployment management, and the Cloud SDK. Finally, we'll cover administration troubleshooting tasks with the Compute and Container Engines and we'll show how to monitor your organization's efficiency with best practices. By the end of this book, you'll have a complete understanding of how to implement Google Cloud services in your organization with ease. What you will learn Host a Python application on Google Compute Engine Host an application using Google Cloud Functions Migrate a MySQL DB to Cloud Spanner Configure a network for a highly available application on GCP Learn simple image processing using Storage and Cloud Functions Automate security checks using Policy Scanner Understand tools for monitoring a production environment in GCP Learn to manage multiple projects using service accounts Who this book is for This book is for IT professionals, engineers, and developers looking at implementing Google Cloud in their organizations. Administrators and architects planning to make their organization more efficient with Google Cloud will also find this book useful. Basic understanding of Cloud services and the Google Cloud platform is necessary.
Publisher: Packt Publishing Ltd
ISBN: 1788294564
Category : Computers
Languages : en
Pages : 274
Book Description
Practical recipes to implement cost-effective and scalable cloud solutions for your organization Key Features Implement Google Cloud services in your organization Leverage Google Cloud components to secure your organization’s data A recipe-based guide that promises hands-on experience in deploying a highly scalable and available environment Book Description Google Cloud Platform is a cloud computing platform that offers products and services to host applications using state-of-the art infrastructure and technology. You can build and host applications and websites, store data, and analyze data on Google's scalable infrastructure. This book follows a recipe-based approach, giving you hands-on experience to make the most of Google Cloud services. This book starts with practical recipes that explain how to utilize Google Cloud's common services. Then, you'll see how to make full use of Google Cloud components such as networking, security, management, and developer tools. Next, we'll deep dive into implementing core Google Cloud services into your organization, with practical recipes on App Engine, Compute Engine microservices with Cloud Functions, virtual networks, and Cloud Storage. Later, we'll provide recipes on implementing authentication and security, Cloud APIs, command-line management, deployment management, and the Cloud SDK. Finally, we'll cover administration troubleshooting tasks with the Compute and Container Engines and we'll show how to monitor your organization's efficiency with best practices. By the end of this book, you'll have a complete understanding of how to implement Google Cloud services in your organization with ease. What you will learn Host a Python application on Google Compute Engine Host an application using Google Cloud Functions Migrate a MySQL DB to Cloud Spanner Configure a network for a highly available application on GCP Learn simple image processing using Storage and Cloud Functions Automate security checks using Policy Scanner Understand tools for monitoring a production environment in GCP Learn to manage multiple projects using service accounts Who this book is for This book is for IT professionals, engineers, and developers looking at implementing Google Cloud in their organizations. Administrators and architects planning to make their organization more efficient with Google Cloud will also find this book useful. Basic understanding of Cloud services and the Google Cloud platform is necessary.
Xamarin Mobile Development for Android Cookbook
Author: Matthew Leibowitz
Publisher: Packt Publishing Ltd
ISBN: 1784395870
Category : Computers
Languages : en
Pages : 456
Book Description
Over 80 hands-on recipes to unleash full potential for Xamarin in development and monetization of feature-packed, real-world Android apps About This Book Create a number of Android applications using the Xamarin Android platform Extensively integrate your Android devices with other Android devices to enhance your app creation experience A comprehensive guide packed with real-world scenarios and pro-level practices and techniques to help you build successful Android apps Who This Book Is For If you are a Xamarin developer who wants to create complete Android applications with Xamarin, then this book is ideal for you. No prior knowledge of Android development is needed, however a basic knowledge of C# and .NET would be useful. What You Will Learn Install and use Xamarin.Android with Xamarin Studio and Visual Studio Design an app's user interface for multiple device configurations Store and protect data in databases, files, and on the cloud Utilize lists and collections to present data to the user Communicate across the network using NFC or Bluetooth Perform tasks in the background and update the user with notifications Capture and play multimedia, such as video and audio, with the camera Implement In-App Billing and Expansion Files and deploy to the store In Detail Xamarin is used by developers to write native iOS, Android, and Windows apps with native user interfaces and share code across multiple platforms not just on mobile devices, but on Windows, Mac OS X, and Linux. Developing apps with Xamarin.Android allows you to use and re-use your code and your skills on different platforms, making you more productive in any development. Although it's not a write-once-run-anywhere framework, Xamarin provides native platform integration and optimizations. There is no middleware; Xamarin.Android talks directly to the system, taking your C# and F# code directly to the low levels. This book will provide you with the necessary knowledge and skills to be part of the mobile development era using C#. Covering a wide range of recipes such as creating a simple application and using device features effectively, it will be your companion to the complete application development cycle. Starting with installing the necessary tools, you will be guided on everything you need to develop an application ready to be deployed. You will learn the best practices for interacting with the device hardware, such as GPS, NFC, and Bluetooth. Furthermore, you will be able to manage multimedia resources such as photos and videos captured with the device camera, and so much more! By the end of this book, you will be able to create Android apps as a result of learning and implementing pro-level practices, techniques, and solutions. This book will ascertain a seamless and successful app building experience. Style and approach This book employs a step-by-step approach to Android app creation, explained in a conversational and easy-to-follow style. A wide range of examples are listed to ensure a complete understanding of how to deploy competent apps on the Android market.
Publisher: Packt Publishing Ltd
ISBN: 1784395870
Category : Computers
Languages : en
Pages : 456
Book Description
Over 80 hands-on recipes to unleash full potential for Xamarin in development and monetization of feature-packed, real-world Android apps About This Book Create a number of Android applications using the Xamarin Android platform Extensively integrate your Android devices with other Android devices to enhance your app creation experience A comprehensive guide packed with real-world scenarios and pro-level practices and techniques to help you build successful Android apps Who This Book Is For If you are a Xamarin developer who wants to create complete Android applications with Xamarin, then this book is ideal for you. No prior knowledge of Android development is needed, however a basic knowledge of C# and .NET would be useful. What You Will Learn Install and use Xamarin.Android with Xamarin Studio and Visual Studio Design an app's user interface for multiple device configurations Store and protect data in databases, files, and on the cloud Utilize lists and collections to present data to the user Communicate across the network using NFC or Bluetooth Perform tasks in the background and update the user with notifications Capture and play multimedia, such as video and audio, with the camera Implement In-App Billing and Expansion Files and deploy to the store In Detail Xamarin is used by developers to write native iOS, Android, and Windows apps with native user interfaces and share code across multiple platforms not just on mobile devices, but on Windows, Mac OS X, and Linux. Developing apps with Xamarin.Android allows you to use and re-use your code and your skills on different platforms, making you more productive in any development. Although it's not a write-once-run-anywhere framework, Xamarin provides native platform integration and optimizations. There is no middleware; Xamarin.Android talks directly to the system, taking your C# and F# code directly to the low levels. This book will provide you with the necessary knowledge and skills to be part of the mobile development era using C#. Covering a wide range of recipes such as creating a simple application and using device features effectively, it will be your companion to the complete application development cycle. Starting with installing the necessary tools, you will be guided on everything you need to develop an application ready to be deployed. You will learn the best practices for interacting with the device hardware, such as GPS, NFC, and Bluetooth. Furthermore, you will be able to manage multimedia resources such as photos and videos captured with the device camera, and so much more! By the end of this book, you will be able to create Android apps as a result of learning and implementing pro-level practices, techniques, and solutions. This book will ascertain a seamless and successful app building experience. Style and approach This book employs a step-by-step approach to Android app creation, explained in a conversational and easy-to-follow style. A wide range of examples are listed to ensure a complete understanding of how to deploy competent apps on the Android market.
Databricks Lakehouse Platform Cookbook
Author: Dr. Alan L. Dennis
Publisher: BPB Publications
ISBN: 9355519567
Category : Computers
Languages : en
Pages : 610
Book Description
Analyze, Architect, and Innovate with Databricks Lakehouse KEY FEATURES ● Create a Lakehouse using Databricks, including ingestion from source to Bronze. ● Refinement of Bronze items to business-ready Silver items using incremental methods. ● Construct Gold items to service the needs of various business requirements. DESCRIPTION The Databricks Lakehouse is groundbreaking technology that simplifies data storage, processing, and analysis. This cookbook offers a clear and practical guide to building and optimizing your Lakehouse to make data-driven decisions and drive impactful results. This definitive guide walks you through the entire Lakehouse journey, from setting up your environment, and connecting to storage, to creating Delta tables, building data models, and ingesting and transforming data. We start off by discussing how to ingest data to Bronze, then refine it to produce Silver. Next, we discuss how to create Gold tables and various data modeling techniques often performed in the Gold layer. You will learn how to leverage Spark SQL and PySpark for efficient data manipulation, apply Delta Live Tables for real-time data processing, and implement Machine Learning and Data Science workflows with MLflow, Feature Store, and AutoML. The book also delves into advanced topics like graph analysis, data governance, and visualization, equipping you with the necessary knowledge to solve complex data challenges. By the end of this cookbook, you will be a confident Lakehouse expert, capable of designing, building, and managing robust data-driven solutions. WHAT YOU WILL LEARN ● Design and build a robust Databricks Lakehouse environment. ● Create and manage Delta tables with advanced transformations. ● Analyze and transform data using SQL and Python. ● Build and deploy machine learning models for actionable insights. ● Implement best practices for data governance and security. WHO THIS BOOK IS FOR This book is meant for Data Engineers, Data Analysts, Data Scientists, Business intelligence professionals, and Architects who want to go to the next level of Data Engineering using the Databricks platform to construct Lakehouses. TABLE OF CONTENTS 1. Introduction to Databricks Lakehouse 2. Setting Up a Databricks Workspace 3. Connecting to Storage 4. Creating Delta Tables 5. Data Profiling and Modeling in the Lakehouse 6. Extracting from Source and Loading to Bronze 7. Transforming to Create Silver 8. Transforming to Create Gold for Business Purposes 9. Machine Learning and Data Science 10. SQL Analysis 11. Graph Analysis 12. Visualizations 13. Governance 14. Operations 15. Tips, Tricks, Troubleshooting, and Best Practices
Publisher: BPB Publications
ISBN: 9355519567
Category : Computers
Languages : en
Pages : 610
Book Description
Analyze, Architect, and Innovate with Databricks Lakehouse KEY FEATURES ● Create a Lakehouse using Databricks, including ingestion from source to Bronze. ● Refinement of Bronze items to business-ready Silver items using incremental methods. ● Construct Gold items to service the needs of various business requirements. DESCRIPTION The Databricks Lakehouse is groundbreaking technology that simplifies data storage, processing, and analysis. This cookbook offers a clear and practical guide to building and optimizing your Lakehouse to make data-driven decisions and drive impactful results. This definitive guide walks you through the entire Lakehouse journey, from setting up your environment, and connecting to storage, to creating Delta tables, building data models, and ingesting and transforming data. We start off by discussing how to ingest data to Bronze, then refine it to produce Silver. Next, we discuss how to create Gold tables and various data modeling techniques often performed in the Gold layer. You will learn how to leverage Spark SQL and PySpark for efficient data manipulation, apply Delta Live Tables for real-time data processing, and implement Machine Learning and Data Science workflows with MLflow, Feature Store, and AutoML. The book also delves into advanced topics like graph analysis, data governance, and visualization, equipping you with the necessary knowledge to solve complex data challenges. By the end of this cookbook, you will be a confident Lakehouse expert, capable of designing, building, and managing robust data-driven solutions. WHAT YOU WILL LEARN ● Design and build a robust Databricks Lakehouse environment. ● Create and manage Delta tables with advanced transformations. ● Analyze and transform data using SQL and Python. ● Build and deploy machine learning models for actionable insights. ● Implement best practices for data governance and security. WHO THIS BOOK IS FOR This book is meant for Data Engineers, Data Analysts, Data Scientists, Business intelligence professionals, and Architects who want to go to the next level of Data Engineering using the Databricks platform to construct Lakehouses. TABLE OF CONTENTS 1. Introduction to Databricks Lakehouse 2. Setting Up a Databricks Workspace 3. Connecting to Storage 4. Creating Delta Tables 5. Data Profiling and Modeling in the Lakehouse 6. Extracting from Source and Loading to Bronze 7. Transforming to Create Silver 8. Transforming to Create Gold for Business Purposes 9. Machine Learning and Data Science 10. SQL Analysis 11. Graph Analysis 12. Visualizations 13. Governance 14. Operations 15. Tips, Tricks, Troubleshooting, and Best Practices
Data Ingestion with Python Cookbook
Author: Glaucia Esppenchutz
Publisher: Packt Publishing Ltd
ISBN: 1837633096
Category : Computers
Languages : en
Pages : 414
Book Description
Deploy your data ingestion pipeline, orchestrate, and monitor efficiently to prevent loss of data and quality Key Features Harness best practices to create a Python and PySpark data ingestion pipeline Seamlessly automate and orchestrate your data pipelines using Apache Airflow Build a monitoring framework by integrating the concept of data observability into your pipelines Book Description Data Ingestion with Python Cookbook offers a practical approach to designing and implementing data ingestion pipelines. It presents real-world examples with the most widely recognized open source tools on the market to answer commonly asked questions and overcome challenges. You'll be introduced to designing and working with or without data schemas, as well as creating monitored pipelines with Airflow and data observability principles, all while following industry best practices. The book also addresses challenges associated with reading different data sources and data formats. As you progress through the book, you'll gain a broader understanding of error logging best practices, troubleshooting techniques, data orchestration, monitoring, and storing logs for further consultation. By the end of the book, you'll have a fully automated set that enables you to start ingesting and monitoring your data pipeline effortlessly, facilitating seamless integration with subsequent stages of the ETL process. What you will learn Implement data observability using monitoring tools Automate your data ingestion pipeline Read analytical and partitioned data, whether schema or non-schema based Debug and prevent data loss through efficient data monitoring and logging Establish data access policies using a data governance framework Construct a data orchestration framework to improve data quality Who this book is for This book is for data engineers and data enthusiasts seeking a comprehensive understanding of the data ingestion process using popular tools in the open source community. For more advanced learners, this book takes on the theoretical pillars of data governance while providing practical examples of real-world scenarios commonly encountered by data engineers.
Publisher: Packt Publishing Ltd
ISBN: 1837633096
Category : Computers
Languages : en
Pages : 414
Book Description
Deploy your data ingestion pipeline, orchestrate, and monitor efficiently to prevent loss of data and quality Key Features Harness best practices to create a Python and PySpark data ingestion pipeline Seamlessly automate and orchestrate your data pipelines using Apache Airflow Build a monitoring framework by integrating the concept of data observability into your pipelines Book Description Data Ingestion with Python Cookbook offers a practical approach to designing and implementing data ingestion pipelines. It presents real-world examples with the most widely recognized open source tools on the market to answer commonly asked questions and overcome challenges. You'll be introduced to designing and working with or without data schemas, as well as creating monitored pipelines with Airflow and data observability principles, all while following industry best practices. The book also addresses challenges associated with reading different data sources and data formats. As you progress through the book, you'll gain a broader understanding of error logging best practices, troubleshooting techniques, data orchestration, monitoring, and storing logs for further consultation. By the end of the book, you'll have a fully automated set that enables you to start ingesting and monitoring your data pipeline effortlessly, facilitating seamless integration with subsequent stages of the ETL process. What you will learn Implement data observability using monitoring tools Automate your data ingestion pipeline Read analytical and partitioned data, whether schema or non-schema based Debug and prevent data loss through efficient data monitoring and logging Establish data access policies using a data governance framework Construct a data orchestration framework to improve data quality Who this book is for This book is for data engineers and data enthusiasts seeking a comprehensive understanding of the data ingestion process using popular tools in the open source community. For more advanced learners, this book takes on the theoretical pillars of data governance while providing practical examples of real-world scenarios commonly encountered by data engineers.
Java Deep Learning Cookbook
Author: Rahul Raj
Publisher: Packt Publishing Ltd
ISBN: 1788999479
Category : Computers
Languages : en
Pages : 294
Book Description
Use Java and Deeplearning4j to build robust, scalable, and highly accurate AI models from scratch Key FeaturesInstall and configure Deeplearning4j to implement deep learning models from scratchExplore recipes for developing, training, and fine-tuning your neural network models in JavaModel neural networks using datasets containing images, text, and time-series dataBook Description Java is one of the most widely used programming languages in the world. With this book, you will see how to perform deep learning using Deeplearning4j (DL4J) – the most popular Java library for training neural networks efficiently. This book starts by showing you how to install and configure Java and DL4J on your system. You will then gain insights into deep learning basics and use your knowledge to create a deep neural network for binary classification from scratch. As you progress, you will discover how to build a convolutional neural network (CNN) in DL4J, and understand how to construct numeric vectors from text. This deep learning book will also guide you through performing anomaly detection on unsupervised data and help you set up neural networks in distributed systems effectively. In addition to this, you will learn how to import models from Keras and change the configuration in a pre-trained DL4J model. Finally, you will explore benchmarking in DL4J and optimize neural networks for optimal results. By the end of this book, you will have a clear understanding of how you can use DL4J to build robust deep learning applications in Java. What you will learnPerform data normalization and wrangling using DL4JBuild deep neural networks using DL4JImplement CNNs to solve image classification problemsTrain autoencoders to solve anomaly detection problems using DL4JPerform benchmarking and optimization to improve your model's performanceImplement reinforcement learning for real-world use cases using RL4JLeverage the capabilities of DL4J in distributed systemsWho this book is for If you are a data scientist, machine learning developer, or a deep learning enthusiast who wants to implement deep learning models in Java, this book is for you. Basic understanding of Java programming as well as some experience with machine learning and neural networks is required to get the most out of this book.
Publisher: Packt Publishing Ltd
ISBN: 1788999479
Category : Computers
Languages : en
Pages : 294
Book Description
Use Java and Deeplearning4j to build robust, scalable, and highly accurate AI models from scratch Key FeaturesInstall and configure Deeplearning4j to implement deep learning models from scratchExplore recipes for developing, training, and fine-tuning your neural network models in JavaModel neural networks using datasets containing images, text, and time-series dataBook Description Java is one of the most widely used programming languages in the world. With this book, you will see how to perform deep learning using Deeplearning4j (DL4J) – the most popular Java library for training neural networks efficiently. This book starts by showing you how to install and configure Java and DL4J on your system. You will then gain insights into deep learning basics and use your knowledge to create a deep neural network for binary classification from scratch. As you progress, you will discover how to build a convolutional neural network (CNN) in DL4J, and understand how to construct numeric vectors from text. This deep learning book will also guide you through performing anomaly detection on unsupervised data and help you set up neural networks in distributed systems effectively. In addition to this, you will learn how to import models from Keras and change the configuration in a pre-trained DL4J model. Finally, you will explore benchmarking in DL4J and optimize neural networks for optimal results. By the end of this book, you will have a clear understanding of how you can use DL4J to build robust deep learning applications in Java. What you will learnPerform data normalization and wrangling using DL4JBuild deep neural networks using DL4JImplement CNNs to solve image classification problemsTrain autoencoders to solve anomaly detection problems using DL4JPerform benchmarking and optimization to improve your model's performanceImplement reinforcement learning for real-world use cases using RL4JLeverage the capabilities of DL4J in distributed systemsWho this book is for If you are a data scientist, machine learning developer, or a deep learning enthusiast who wants to implement deep learning models in Java, this book is for you. Basic understanding of Java programming as well as some experience with machine learning and neural networks is required to get the most out of this book.
Android Cookbook
Author: Ian F. Darwin
Publisher: "O'Reilly Media, Inc."
ISBN: 1449374492
Category : Computers
Languages : en
Pages : 733
Book Description
Jump in and build working Android apps with the help of more than 230 tested recipes. The second edition of this acclaimed cookbook includes recipes for working with user interfaces, multitouch gestures, location awareness, web services, and specific device features such as the phone, camera, and accelerometer. You also get useful info on packaging your app for the Google Play Market. Ideal for developers familiar with Java, Android basics, and the Java SE API, this book features recipes contributed by more than three dozen Android developers. Each recipe provides a clear solution and sample code you can use in your project right away. Among numerous topics, this cookbook helps you: Get started with the tooling you need for developing and testing Android apps Create layouts with Android’s UI controls, graphical services, and pop-up mechanisms Build location-aware services on Google Maps and OpenStreetMap Control aspects of Android’s music, video, and other multimedia capabilities Work with accelerometers and other Android sensors Use various gaming and animation frameworks Store and retrieve persistent data in files and embedded databases Access RESTful web services with JSON and other formats Test and troubleshoot individual components and your entire application
Publisher: "O'Reilly Media, Inc."
ISBN: 1449374492
Category : Computers
Languages : en
Pages : 733
Book Description
Jump in and build working Android apps with the help of more than 230 tested recipes. The second edition of this acclaimed cookbook includes recipes for working with user interfaces, multitouch gestures, location awareness, web services, and specific device features such as the phone, camera, and accelerometer. You also get useful info on packaging your app for the Google Play Market. Ideal for developers familiar with Java, Android basics, and the Java SE API, this book features recipes contributed by more than three dozen Android developers. Each recipe provides a clear solution and sample code you can use in your project right away. Among numerous topics, this cookbook helps you: Get started with the tooling you need for developing and testing Android apps Create layouts with Android’s UI controls, graphical services, and pop-up mechanisms Build location-aware services on Google Maps and OpenStreetMap Control aspects of Android’s music, video, and other multimedia capabilities Work with accelerometers and other Android sensors Use various gaming and animation frameworks Store and retrieve persistent data in files and embedded databases Access RESTful web services with JSON and other formats Test and troubleshoot individual components and your entire application