Data Analytics with Google Cloud Platform

Data Analytics with Google Cloud Platform PDF Author: Murari Ramuka
Publisher: BPB Publications
ISBN: 9389423635
Category : Computers
Languages : en
Pages : 287

Get Book Here

Book Description
Step-by-step guide to different data movement and processing techniques, using Google Cloud Platform Services DESCRIPTION Modern businesses are awash with data, making data-driven decision-making tasks increasingly complex. As a result, relevant technical expertise and analytical skills are required to do such tasks. This book aims to equip you with enough knowledge of Cloud Computing in conjunction with Google Cloud Data platform to succeed in the role of a Cloud data expert. The current market is trending towards the latest cloud technologies, which is the need of the hour. Google being the pioneer, is dominating this space with the right set of cloud services being offered as part of GCP (Google Cloud Platform). At this juncture, this book will be very vital and will cover all the services that are being offered by GCP, putting emphasis on Data services. This book starts with sophisticated knowledge on Cloud Computing. It also explains different types of data services/technology and machine learning algorithm/Pre-Trained API through real-business problems, which are built on the Google Cloud Platform (GCP). With some of the latest business examples and hands-on guide, this book will enable the developers entering the data analytics fields to implement an end-to-end data pipeline, using GCP Data services. Through the course of the book, you will come across multiple industry-wise use cases, like Building Datawarehouse using Big Query, a sample real-time data analytics solution on machine learning and Artificial Intelligence that helped with the business decision, by employing a variety of data science approaches on Google Cloud environment. Whether yourÊbusinessÊis at the early stage of cloud implementation in its journey or well on its way to digital transformation,ÊGoogle Cloud'sÊsolutions and technologies will always help chart a path to success. This book can be used to develop the GCP concepts in an easy way. It contains many examples showcasing the implementation of a GCP service. It enables the learning of the basic and advance concepts of Google Cloud Data Platform. This book is divided into 7 chapters and provides a detailed description of the core concepts of each of the Data services offered by Google Cloud. KEY FEATURES Learn the basic concept of Cloud Computing along with different Cloud service provides with their supported Models (IaaS/PaaS/SaaS) Learn the basics of Compute Engine, App Engine, Container Engine, Project and Billing setup in the Google Cloud Platform Learn how and when to use Cloud DataFlow, Cloud DataProc and Cloud DataPrepÊ Build real-time data pipeline to support real-time analytics using Pub/Sub messaging service Setting up a fully managed GCP Big Data Cluster using Cloud DataProc for runningÊApache SparkÊandÊApache HadoopÊclusters in a simpler, more cost-efficient manner Learn how to use Cloud Data Studio for visualizing the data on top of Big Query Implement and understand real-world business scenarios for Machine Learning, Data Pipeline Engineering WHAT WILL YOU LEARN By the end of the book, you will have come across different data services and platforms offered by Google Cloud, and how those services/features can be enabled to serve business needs. You will also see a few case studies to put your knowledge to practice and solve business problems such as building a real-time streaming pipeline engine, Scalable Data Warehouse on Cloud, fully managed Hadoop cluster on Cloud and enabling TensorFlow/Machine Learning APIÕs to support real-life business problems. Remember to practice additional examples to master these techniques. WHO IS THIS BOOK FOR This book is for professionals as well as graduates who want to build a career in Google Cloud data analytics technologies. While no prior knowledge of Cloud Computing or related technologies is assumed, it will be helpful to have some data background and experience. One stop shop for those who wish to get an initial to advance understanding of the GCP data platform. The target audience will be data engineers/professionals who are new, as well as those who are acquainted with the tools and techniques related to cloud and data space.ÊÊ _Ê Ê Ê Individuals who have basic data understanding (i.e. Data and cloud) and have done some work in the field ofÊ data analytics, can refer/use this book to master their knowledge/understanding. _Ê Ê Ê The highlight of this book is that it will start with theÊ basic cloud computing fundamentals and will move on to cover the advance concepts on GCP cloud data analytics and hence can be referred across multiple different levels of audiences.Ê Table of Contents 1. GCP Overview and Architecture 2. Data Storage in GCPÊ 3. Data Processing in GCP with Pub/Sub and DataflowÊ 4. Data Processing in GCP with DataPrep and Dataflow 5. Big Query and Data Studio 6. Machine Learning with GCP 7. Sample Use cases and Examples

Data Analytics with Google Cloud Platform

Data Analytics with Google Cloud Platform PDF Author: Murari Ramuka
Publisher: BPB Publications
ISBN: 9389423635
Category : Computers
Languages : en
Pages : 287

Get Book Here

Book Description
Step-by-step guide to different data movement and processing techniques, using Google Cloud Platform Services DESCRIPTION Modern businesses are awash with data, making data-driven decision-making tasks increasingly complex. As a result, relevant technical expertise and analytical skills are required to do such tasks. This book aims to equip you with enough knowledge of Cloud Computing in conjunction with Google Cloud Data platform to succeed in the role of a Cloud data expert. The current market is trending towards the latest cloud technologies, which is the need of the hour. Google being the pioneer, is dominating this space with the right set of cloud services being offered as part of GCP (Google Cloud Platform). At this juncture, this book will be very vital and will cover all the services that are being offered by GCP, putting emphasis on Data services. This book starts with sophisticated knowledge on Cloud Computing. It also explains different types of data services/technology and machine learning algorithm/Pre-Trained API through real-business problems, which are built on the Google Cloud Platform (GCP). With some of the latest business examples and hands-on guide, this book will enable the developers entering the data analytics fields to implement an end-to-end data pipeline, using GCP Data services. Through the course of the book, you will come across multiple industry-wise use cases, like Building Datawarehouse using Big Query, a sample real-time data analytics solution on machine learning and Artificial Intelligence that helped with the business decision, by employing a variety of data science approaches on Google Cloud environment. Whether yourÊbusinessÊis at the early stage of cloud implementation in its journey or well on its way to digital transformation,ÊGoogle Cloud'sÊsolutions and technologies will always help chart a path to success. This book can be used to develop the GCP concepts in an easy way. It contains many examples showcasing the implementation of a GCP service. It enables the learning of the basic and advance concepts of Google Cloud Data Platform. This book is divided into 7 chapters and provides a detailed description of the core concepts of each of the Data services offered by Google Cloud. KEY FEATURES Learn the basic concept of Cloud Computing along with different Cloud service provides with their supported Models (IaaS/PaaS/SaaS) Learn the basics of Compute Engine, App Engine, Container Engine, Project and Billing setup in the Google Cloud Platform Learn how and when to use Cloud DataFlow, Cloud DataProc and Cloud DataPrepÊ Build real-time data pipeline to support real-time analytics using Pub/Sub messaging service Setting up a fully managed GCP Big Data Cluster using Cloud DataProc for runningÊApache SparkÊandÊApache HadoopÊclusters in a simpler, more cost-efficient manner Learn how to use Cloud Data Studio for visualizing the data on top of Big Query Implement and understand real-world business scenarios for Machine Learning, Data Pipeline Engineering WHAT WILL YOU LEARN By the end of the book, you will have come across different data services and platforms offered by Google Cloud, and how those services/features can be enabled to serve business needs. You will also see a few case studies to put your knowledge to practice and solve business problems such as building a real-time streaming pipeline engine, Scalable Data Warehouse on Cloud, fully managed Hadoop cluster on Cloud and enabling TensorFlow/Machine Learning APIÕs to support real-life business problems. Remember to practice additional examples to master these techniques. WHO IS THIS BOOK FOR This book is for professionals as well as graduates who want to build a career in Google Cloud data analytics technologies. While no prior knowledge of Cloud Computing or related technologies is assumed, it will be helpful to have some data background and experience. One stop shop for those who wish to get an initial to advance understanding of the GCP data platform. The target audience will be data engineers/professionals who are new, as well as those who are acquainted with the tools and techniques related to cloud and data space.ÊÊ _Ê Ê Ê Individuals who have basic data understanding (i.e. Data and cloud) and have done some work in the field ofÊ data analytics, can refer/use this book to master their knowledge/understanding. _Ê Ê Ê The highlight of this book is that it will start with theÊ basic cloud computing fundamentals and will move on to cover the advance concepts on GCP cloud data analytics and hence can be referred across multiple different levels of audiences.Ê Table of Contents 1. GCP Overview and Architecture 2. Data Storage in GCPÊ 3. Data Processing in GCP with Pub/Sub and DataflowÊ 4. Data Processing in GCP with DataPrep and Dataflow 5. Big Query and Data Studio 6. Machine Learning with GCP 7. Sample Use cases and Examples

Cloud Analytics with Google Cloud Platform

Cloud Analytics with Google Cloud Platform PDF Author: Sanket Thodge
Publisher: Packt Publishing Ltd
ISBN: 1788838599
Category : Computers
Languages : en
Pages : 273

Get Book Here

Book Description
Combine the power of analytics and cloud computing for faster and efficient insights Key Features Master the concept of analytics on the cloud: and how organizations are using it Learn the design considerations and while applying a cloud analytics solution Design an end-to-end analytics pipeline on the cloud Book Description With the ongoing data explosion, more and more organizations all over the world are slowly migrating their infrastructure to the cloud. These cloud platforms also provide their distinct analytics services to help you get faster insights from your data. This book will give you an introduction to the concept of analytics on the cloud, and the different cloud services popularly used for processing and analyzing data. If you’re planning to adopt the cloud analytics model for your business, this book will help you understand the design and business considerations to be kept in mind, and choose the best tools and alternatives for analytics, based on your requirements. The chapters in this book will take you through the 70+ services available in Google Cloud Platform and their implementation for practical purposes. From ingestion to processing your data, this book contains best practices on building an end-to-end analytics pipeline on the cloud by leveraging popular concepts such as machine learning and deep learning. By the end of this book, you will have a better understanding of cloud analytics as a concept as well as a practical know-how of its implementation What you will learn Explore the basics of cloud analytics and the major cloud solutions Learn how organizations are using cloud analytics to improve the ROI Explore the design considerations while adopting cloud services Work with the ingestion and storage tools of GCP such as Cloud Pub/Sub Process your data with tools such as Cloud Dataproc, BigQuery, etc Over 70 GCP tools to build an analytics engine for cloud analytics Implement machine learning and other AI techniques on GCP Who this book is for This book is targeted at CIOs, CTOs, and even analytics professionals looking for various alternatives to implement their analytics pipeline on the cloud. Data professionals looking to get started with cloud-based analytics will also find this book useful. Some basic exposure to cloud platforms such as GCP will be helpful, but not mandatory.

Cloud Analytics with Google Cloud Platform

Cloud Analytics with Google Cloud Platform PDF Author: Sanket Thodge
Publisher: Packt Publishing Ltd
ISBN: 1788838599
Category : Computers
Languages : en
Pages : 273

Get Book Here

Book Description
Combine the power of analytics and cloud computing for faster and efficient insights Key Features Master the concept of analytics on the cloud: and how organizations are using it Learn the design considerations and while applying a cloud analytics solution Design an end-to-end analytics pipeline on the cloud Book Description With the ongoing data explosion, more and more organizations all over the world are slowly migrating their infrastructure to the cloud. These cloud platforms also provide their distinct analytics services to help you get faster insights from your data. This book will give you an introduction to the concept of analytics on the cloud, and the different cloud services popularly used for processing and analyzing data. If you’re planning to adopt the cloud analytics model for your business, this book will help you understand the design and business considerations to be kept in mind, and choose the best tools and alternatives for analytics, based on your requirements. The chapters in this book will take you through the 70+ services available in Google Cloud Platform and their implementation for practical purposes. From ingestion to processing your data, this book contains best practices on building an end-to-end analytics pipeline on the cloud by leveraging popular concepts such as machine learning and deep learning. By the end of this book, you will have a better understanding of cloud analytics as a concept as well as a practical know-how of its implementation What you will learn Explore the basics of cloud analytics and the major cloud solutions Learn how organizations are using cloud analytics to improve the ROI Explore the design considerations while adopting cloud services Work with the ingestion and storage tools of GCP such as Cloud Pub/Sub Process your data with tools such as Cloud Dataproc, BigQuery, etc Over 70 GCP tools to build an analytics engine for cloud analytics Implement machine learning and other AI techniques on GCP Who this book is for This book is targeted at CIOs, CTOs, and even analytics professionals looking for various alternatives to implement their analytics pipeline on the cloud. Data professionals looking to get started with cloud-based analytics will also find this book useful. Some basic exposure to cloud platforms such as GCP will be helpful, but not mandatory.

Data Analytics with Google Cloud Platform

Data Analytics with Google Cloud Platform PDF Author: Murari Ramuka
Publisher: BPB Publications
ISBN: 9389423635
Category : Computers
Languages : en
Pages : 287

Get Book Here

Book Description
Step-by-step guide to different data movement and processing techniques, using Google Cloud Platform Services DESCRIPTION Modern businesses are awash with data, making data-driven decision-making tasks increasingly complex. As a result, relevant technical expertise and analytical skills are required to do such tasks. This book aims to equip you with enough knowledge of Cloud Computing in conjunction with Google Cloud Data platform to succeed in the role of a Cloud data expert. The current market is trending towards the latest cloud technologies, which is the need of the hour. Google being the pioneer, is dominating this space with the right set of cloud services being offered as part of GCP (Google Cloud Platform). At this juncture, this book will be very vital and will cover all the services that are being offered by GCP, putting emphasis on Data services. This book starts with sophisticated knowledge on Cloud Computing. It also explains different types of data services/technology and machine learning algorithm/Pre-Trained API through real-business problems, which are built on the Google Cloud Platform (GCP). With some of the latest business examples and hands-on guide, this book will enable the developers entering the data analytics fields to implement an end-to-end data pipeline, using GCP Data services. Through the course of the book, you will come across multiple industry-wise use cases, like Building Datawarehouse using Big Query, a sample real-time data analytics solution on machine learning and Artificial Intelligence that helped with the business decision, by employing a variety of data science approaches on Google Cloud environment. Whether yourÊbusinessÊis at the early stage of cloud implementation in its journey or well on its way to digital transformation,ÊGoogle Cloud'sÊsolutions and technologies will always help chart a path to success. This book can be used to develop the GCP concepts in an easy way. It contains many examples showcasing the implementation of a GCP service. It enables the learning of the basic and advance concepts of Google Cloud Data Platform. This book is divided into 7 chapters and provides a detailed description of the core concepts of each of the Data services offered by Google Cloud. KEY FEATURES Learn the basic concept of Cloud Computing along with different Cloud service provides with their supported Models (IaaS/PaaS/SaaS) Learn the basics of Compute Engine, App Engine, Container Engine, Project and Billing setup in the Google Cloud Platform Learn how and when to use Cloud DataFlow, Cloud DataProc and Cloud DataPrepÊ Build real-time data pipeline to support real-time analytics using Pub/Sub messaging service Setting up a fully managed GCP Big Data Cluster using Cloud DataProc for runningÊApache SparkÊandÊApache HadoopÊclusters in a simpler, more cost-efficient manner Learn how to use Cloud Data Studio for visualizing the data on top of Big Query Implement and understand real-world business scenarios for Machine Learning, Data Pipeline Engineering WHAT WILL YOU LEARN By the end of the book, you will have come across different data services and platforms offered by Google Cloud, and how those services/features can be enabled to serve business needs. You will also see a few case studies to put your knowledge to practice and solve business problems such as building a real-time streaming pipeline engine, Scalable Data Warehouse on Cloud, fully managed Hadoop cluster on Cloud and enabling TensorFlow/Machine Learning APIÕs to support real-life business problems. Remember to practice additional examples to master these techniques. WHO IS THIS BOOK FOR This book is for professionals as well as graduates who want to build a career in Google Cloud data analytics technologies. While no prior knowledge of Cloud Computing or related technologies is assumed, it will be helpful to have some data background and experience. One stop shop for those who wish to get an initial to advance understanding of the GCP data platform. The target audience will be data engineers/professionals who are new, as well as those who are acquainted with the tools and techniques related to cloud and data space.ÊÊ _Ê Ê Ê Individuals who have basic data understanding (i.e. Data and cloud) and have done some work in the field ofÊ data analytics, can refer/use this book to master their knowledge/understanding. _Ê Ê Ê The highlight of this book is that it will start with theÊ basic cloud computing fundamentals and will move on to cover the advance concepts on GCP cloud data analytics and hence can be referred across multiple different levels of audiences.Ê Table of Contents 1. GCP Overview and Architecture 2. Data Storage in GCPÊ 3. Data Processing in GCP with Pub/Sub and DataflowÊ 4. Data Processing in GCP with DataPrep and Dataflow 5. Big Query and Data Studio 6. Machine Learning with GCP 7. Sample Use cases and Examples

Google Cloud Platform for Architects

Google Cloud Platform for Architects PDF Author: Vitthal Srinivasan
Publisher: Packt Publishing Ltd
ISBN: 1788833074
Category : Computers
Languages : en
Pages : 355

Get Book Here

Book Description
Get acquainted with GCP and manage robust, highly available, and dynamic solutions to drive business objective Key Features Identify the strengths, weaknesses and ideal use-cases for individual services offered on the Google Cloud Platform Make intelligent choices about which cloud technology works best for your use-case Leverage Google Cloud Platform to analyze and optimize technical and business processes Book Description Using a public cloud platform was considered risky a decade ago, and unconventional even just a few years ago. Today, however, use of the public cloud is completely mainstream - the norm, rather than the exception. Several leading technology firms, including Google, have built sophisticated cloud platforms, and are locked in a fierce competition for market share. The main goal of this book is to enable you to get the best out of the GCP, and to use it with confidence and competence. You will learn why cloud architectures take the forms that they do, and this will help you become a skilled high-level cloud architect. You will also learn how individual cloud services are configured and used, so that you are never intimidated at having to build it yourself. You will also learn the right way and the right situation in which to use the important GCP services. By the end of this book, you will be able to make the most out of Google Cloud Platform design. What you will learn Set up GCP account and utilize GCP services using the cloud shell, web console, and client APIs Harness the power of App Engine, Compute Engine, Containers on the Kubernetes Engine, and Cloud Functions Pick the right managed service for your data needs, choosing intelligently between Datastore, BigTable, and BigQuery Migrate existing Hadoop, Spark, and Pig workloads with minimal disruption to your existing data infrastructure, by using Dataproc intelligently Derive insights about the health, performance, and availability of cloud-powered applications with the help of monitoring, logging, and diagnostic tools in Stackdriver Who this book is for If you are a Cloud architect who is responsible to design and manage robust cloud solutions with Google Cloud Platform, then this book is for you. System engineers and Enterprise architects will also find this book useful. A basic understanding of distributed applications would be helpful, although not strictly necessary. Some working experience on other public cloud platforms would help too.

Google Cloud AI Services Quick Start Guide

Google Cloud AI Services Quick Start Guide PDF Author: Arvind Ravulavaru
Publisher: Packt Publishing Ltd
ISBN: 1788996534
Category : Computers
Languages : en
Pages : 228

Get Book Here

Book Description
Leverage the power of various Google Cloud AI Services by building a smart web application using MEAN Stack Key Features Start working with the Google Cloud Platform and the AI services it offers Build smart web applications by combining the power of Google Cloud AI services and the MEAN stack Build a web-based dashboard of smart applications that perform language processing, translation, and computer vision on the cloud Book Description Cognitive services are the new way of adding intelligence to applications and services. Now we can use Artificial Intelligence as a service that can be consumed by any application or other service, to add smartness and make the end result more practical and useful. Google Cloud AI enables you to consume Artificial Intelligence within your applications, from a REST API. Text, video and speech analysis are among the powerful machine learning features that can be used. This book is the easiest way to get started with the Google Cloud AI services suite and open up the world of smarter applications. This book will help you build a Smart Exchange, a forum application that will let you upload videos, images and perform text to speech conversions and translation services. You will use the power of Google Cloud AI Services to make our simple forum application smart by validating the images, videos, and text provided by users to Google Cloud AI Services and make sure the content which is uploaded follows the forum standards, without a human curator involvement. You will learn how to work with the Vision API, Video Intelligence API, Speech Recognition API, Cloud Language Process, and Cloud Translation API services to make your application smarter. By the end of this book, you will have a strong understanding of working with Google Cloud AI Services, and be well on the way to building smarter applications. What you will learn Understand Google Cloud Platform and its Cloud AI services Explore the Google ML Services Work with an Angular 5 MEAN stack application Integrate Vision API, Video Intelligence API for computer vision Be ready for conversational experiences with the Speech Recognition API, Cloud Language Process and Cloud Translation API services Build a smart web application that uses the power of Google Cloud AI services to make apps smarter Who this book is for This book is ideal for data professionals and web developers who want to use the power of Google Cloud AI services in their projects, without the going through the pain of mastering machine learning for images, videos and text. Some familiarity with the Google Cloud Platform will be helpful.

Scaling Google Cloud Platform

Scaling Google Cloud Platform PDF Author: Swapnil Dubey
Publisher: BPB Publications
ISBN: 9355512848
Category : Computers
Languages : en
Pages : 368

Get Book Here

Book Description
Managing Real-world Production-grade Challenges at Scale KEY FEATURES ● Built for GCP professionals and Cloud enthusiasts with cloud-agnostic tactics. ● Exhaustive coverage of automatic, manual, and predictive scaling and specialized strategies. ● Every concept is pragmatized with real-time production scenarios derived from prominent technologists. DESCRIPTION ‘Scaling Google Cloud Platform’ equips developers with the know-how to get the most out of its services in storage, serverless computing, networking, infrastructure monitoring, and other IT tasks. This book explains the fundamentals of cloud scaling, including Cloud Elasticity, creating cloud workloads, and selecting the appropriate cloud scaling key performance indicators (KPIs). The book explains the sections of GCP resources that can be scaled, as well as their architecture and internals, and best practices for using these components in an operational setting in detail. The book also discusses scaling techniques such as predictive scaling, auto-scaling, and manual scaling. This book includes real-world examples illustrating how to scale many Google Cloud services, including the compute engine, GKE, VMWare Engine, Cloud Function, Cloud Run, App Engine, BigTable, Spanner, Composer, Dataproc, and Dataflow. At the end of the book, the author delves into the two most common architectures—Microservices and Bigdata to examine how you can perform reliability engineering for them on GCP. WHAT YOU WILL LEARN ● Learn workload migration strategy and execution, both within and between clouds. ● Explore methods of increasing Google Cloud capacity for running VMware Engine and containerized applications. ● Scaling up and down methods include manual, predictive, and automatic approaches. ● Increase the capacity of your Dataproc cluster to handle your big data computing needs. ● Learn Google Dataflow's scalability considerations for large-scale installations. ● Explore Google Composer 2 and scale up your Cloud Spanner instances. ● Learn to set up Cloud functions and Cloud run. ● Discuss general SRE procedures on microservices and big data. WHO THIS BOOK IS FOR This book is designed for Cloud professionals, software developers, architects, DevOps team, and engineering managers to explain scaling strategies for GCP services and assumes readers know GCP basics. TABLE OF CONTENTS 1. Basics of Scaling Cloud Resources 2. KPI for Cloud Scalability 3. Cloud Elasticity 4. Challenges of Infrastructure Complexity and the Way Forward 5. Scaling Compute Engine 6. Scaling Kubernetes Engine 7. Scaling VMware Engine 8. Scaling App Engine 9. Scaling Google Cloud Function and Cloud Run 10. Configuring Bigtable for Scale 11. Configuring Cloud Spanner for Scale 12. Scaling Google Composer 2 13. Scaling Google Dataproc 14. Scaling Google Dataflow 15. Site Reliability Engineering 16. SRE Use Cases

GOOGLE CLOUD PLATFORM FOR ENTERPRISE MLOPS:A PRACTICAL GUIDE TO CLOUD COMPUTING: PART ONE

GOOGLE CLOUD PLATFORM FOR ENTERPRISE MLOPS:A PRACTICAL GUIDE TO CLOUD COMPUTING: PART ONE PDF Author: Jothi Periasamy
Publisher: Jothi Periasamy
ISBN:
Category : Computers
Languages : en
Pages : 305

Get Book Here

Book Description


Building Your Next Big Thing with Google Cloud Platform

Building Your Next Big Thing with Google Cloud Platform PDF Author: Jose Ugia Gonzalez
Publisher: Apress
ISBN: 1484210042
Category : Computers
Languages : en
Pages : 377

Get Book Here

Book Description
Building Your Next Big Thing with Google Cloud Platform shows you how to take advantage of the Google Cloud Platform technologies to build all kinds of cloud-hosted software and services for both public and private consumption. Whether you need a simple virtual server to run your legacy application or you need to architect a sophisticated high-traffic web application, Cloud Platform provides all the tools and products required to create innovative applications and a robust infrastructure to manage them. Google is known for the scalability, reliability, and efficiency of its various online products, from Google Search to Gmail. And, the results are impressive. Google Search, for example, returns results literally within fractions of second. How is this possible? Google custom-builds both hardware and software, including servers, switches, networks, data centers, the operating system’s stack, application frameworks, applications, and APIs. Have you ever imagined what you could build if you were able to tap the same infrastructure that Google uses to create and manage its products? Now you can! Building Your Next Big Thing with Google Cloud Platform shows you how to take advantage of the Google Cloud Platform technologies to build all kinds of cloud-hosted software and services for both public and private consumption. Whether you need a simple virtual server to run your legacy application or you need to architect a sophisticated high-traffic web application, Cloud Platform provides all the tools and products required to create innovative applications and a robust infrastructure to manage them. Using this book as your compass, you can navigate your way through the Google Cloud Platform and turn your ideas into reality. The authors, both Google Developer Experts in Google Cloud Platform, systematically introduce various Cloud Platform products one at a time and discuss their strengths and scenarios where they are a suitable fit. But rather than a manual-like "tell all" approach, the emphasis is on how to Get Things Done so that you get up to speed with Google Cloud Platform as quickly as possible. You will learn how to use the following technologies, among others: Google Compute Engine Google App Engine Google Container Engine Google App Engine Managed VMs Google Cloud SQL Google Cloud Storage Google Cloud Datastore Google BigQuery Google Cloud Dataflow Google Cloud DNS Google Cloud Pub/Sub Google Cloud Endpoints Google Cloud Deployment Manager Author on Google Cloud Platform Google APIs and Translate API Using real-world examples, the authors first walk you through the basics of cloud computing, cloud terminologies and public cloud services. Then they dive right into Google Cloud Platform and how you can use it to tackle your challenges, build new products, analyze big data, and much more. Whether you’re an independent developer, startup, or Fortune 500 company, you have never had easier to access to world-class production, product development, and infrastructure tools. Google Cloud Platform is your ticket to leveraging your skills and knowledge into making reliable, scalable, and efficient products—just like how Google builds its own products.

Data Engineering with Google Cloud Platform

Data Engineering with Google Cloud Platform PDF Author: Adi Wijaya
Publisher: Packt Publishing Ltd
ISBN: 1800565062
Category : Computers
Languages : en
Pages : 440

Get Book Here

Book Description
Build and deploy your own data pipelines on GCP, make key architectural decisions, and gain the confidence to boost your career as a data engineer Key Features Understand data engineering concepts, the role of a data engineer, and the benefits of using GCP for building your solution Learn how to use the various GCP products to ingest, consume, and transform data and orchestrate pipelines Discover tips to prepare for and pass the Professional Data Engineer exam Book DescriptionWith this book, you'll understand how the highly scalable Google Cloud Platform (GCP) enables data engineers to create end-to-end data pipelines right from storing and processing data and workflow orchestration to presenting data through visualization dashboards. Starting with a quick overview of the fundamental concepts of data engineering, you'll learn the various responsibilities of a data engineer and how GCP plays a vital role in fulfilling those responsibilities. As you progress through the chapters, you'll be able to leverage GCP products to build a sample data warehouse using Cloud Storage and BigQuery and a data lake using Dataproc. The book gradually takes you through operations such as data ingestion, data cleansing, transformation, and integrating data with other sources. You'll learn how to design IAM for data governance, deploy ML pipelines with the Vertex AI, leverage pre-built GCP models as a service, and visualize data with Google Data Studio to build compelling reports. Finally, you'll find tips on how to boost your career as a data engineer, take the Professional Data Engineer certification exam, and get ready to become an expert in data engineering with GCP. By the end of this data engineering book, you'll have developed the skills to perform core data engineering tasks and build efficient ETL data pipelines with GCP.What you will learn Load data into BigQuery and materialize its output for downstream consumption Build data pipeline orchestration using Cloud Composer Develop Airflow jobs to orchestrate and automate a data warehouse Build a Hadoop data lake, create ephemeral clusters, and run jobs on the Dataproc cluster Leverage Pub/Sub for messaging and ingestion for event-driven systems Use Dataflow to perform ETL on streaming data Unlock the power of your data with Data Studio Calculate the GCP cost estimation for your end-to-end data solutions Who this book is for This book is for data engineers, data analysts, and anyone looking to design and manage data processing pipelines using GCP. You'll find this book useful if you are preparing to take Google's Professional Data Engineer exam. Beginner-level understanding of data science, the Python programming language, and Linux commands is necessary. A basic understanding of data processing and cloud computing, in general, will help you make the most out of this book.