Monday September 24, 2018
Home Lead Story Twitter Moves...

Twitter Moves its Core Infrastructure to Google Cloud

The Hadoop compute system is the core of Twitter's data platform, and the company runs multiple large Hadoop clusters that are among the biggest in the world.

0
//
28
Google
Flagship 'Pixel Watch' not coming in 2018, says Google. Pixabay
Republish
Reprint

Twitter will move some of its core infrastructure to Google’s Cloud Platform for better data management, the company has announced.

“We are excited to announce that we are working with Google Cloud to move cold data storage and our flexible compute Hadoop clusters to Google Cloud Platform,” Parag Agrawal, Chief Technology Officer at Twitter, said in a blog post on Thursday.

“This will enable us to enhance the experience and productivity of our engineering teams working with our data platform,” he added.

"We are excited to announce that we are working with Google Cloud to move cold data storage and our flexible compute Hadoop clusters to Google Cloud Platform," Parag Agrawal, Chief Technology Officer at Twitter, said in a blog post on Thursday.
Twitter logo, Pixabay

Hadoop from Apache is an open-source software for organising Big Data.

The Hadoop compute system is the core of Twitter’s data platform, and the company runs multiple large Hadoop clusters that are among the biggest in the world.

“In fact, our Hadoop file systems host more than 300PB of data across tens of thousands of servers,” Agrawal said.

Google Cloud Platform’s data solutions and trusted infrastructure will provide Twitter with the technical flexibility and consistency that its platform requires.

Also Read: Facebook Ensuring Its AI System to be Equally Neutral For All

The migration, when complete, will enable faster capacity provisioning, increased flexibility, access to a broader ecosystem of tools and services and improvements to security.

“Architecturally, we will also be able to separate compute and storage for this class of Hadoop workloads, which has a number of long-term scaling and operational benefits,” the post read. (IANS)

 

Click here for reuse options!
Copyright 2018 NewsGram

Next Story

Google Sends Email to Employees Asking Them to Delete China Search Engine Memo

The China search engine would link users' search history to their personal phone numbers, according to the memo

0
Google
Google asks employees to delete China search engine memo: Report. Wikimedia Commons

In its bid to suppress a memo revealing information about a plan to launch a censored search engine in China, Google has sent an email to employees asking them to delete the sensitive document, The Intercept reported.

Authored by a Google engineer familiar with the project, the memo disclosed that the search system would require users in China to log in to perform searches.

Codenamed Dragonfly, the search engine would track the location of users and share the data with a Chinese partner who would have “unilateral access” to the data, said the report on Friday, citing the memo.

The news about Google’s plan to build a censored search engine in China broke in August when The Intercept reported that the search platform would blacklist “sensitive queries” about topics including politics, free speech, democracy, human rights and peaceful protest, triggering internal protests among some Google employees.

Two weeks after that report, Google CEO Sundar Pichai told the company’s employees that the China plan was in its “early stages” and “exploratory”.

Google CEO Sundar Pichai
Google CEO Sundar Pichai. (Wikimedia Commons)

A group of Google employees who were organising internal protests over the censored search system got access to the memo detailing information about the project.

The Google leadership, according to the The Intercept report, were furious when they discovered that the memo was being passed among employees who were not supposed to know about about the Dragonfly project.

Also Read- India Gets Its Sex Offender Registry

The China search engine would link users’ search history to their personal phone numbers, according to the memo.

This means if security agencies were to obtain the search records from Google, individual people could easily be tracked and users seeking out information banned by the government could potentially be at risk of interrogation or detention. (IANS)

Next Story