Tuesday March 19, 2019
Home Lead Story Twitter Moves...

Twitter Moves its Core Infrastructure to Google Cloud

The Hadoop compute system is the core of Twitter's data platform, and the company runs multiple large Hadoop clusters that are among the biggest in the world.

0
//
Google
Google will verify the identity of advertisers before their election ads run on its platforms, the company said in a statement.

Twitter will move some of its core infrastructure to Google’s Cloud Platform for better data management, the company has announced.

“We are excited to announce that we are working with Google Cloud to move cold data storage and our flexible compute Hadoop clusters to Google Cloud Platform,” Parag Agrawal, Chief Technology Officer at Twitter, said in a blog post on Thursday.

“This will enable us to enhance the experience and productivity of our engineering teams working with our data platform,” he added.

"We are excited to announce that we are working with Google Cloud to move cold data storage and our flexible compute Hadoop clusters to Google Cloud Platform," Parag Agrawal, Chief Technology Officer at Twitter, said in a blog post on Thursday.
Twitter logo, Pixabay

Hadoop from Apache is an open-source software for organising Big Data.

The Hadoop compute system is the core of Twitter’s data platform, and the company runs multiple large Hadoop clusters that are among the biggest in the world.

“In fact, our Hadoop file systems host more than 300PB of data across tens of thousands of servers,” Agrawal said.

Google Cloud Platform’s data solutions and trusted infrastructure will provide Twitter with the technical flexibility and consistency that its platform requires.

Also Read: Facebook Ensuring Its AI System to be Equally Neutral For All

The migration, when complete, will enable faster capacity provisioning, increased flexibility, access to a broader ecosystem of tools and services and improvements to security.

“Architecturally, we will also be able to separate compute and storage for this class of Hadoop workloads, which has a number of long-term scaling and operational benefits,” the post read. (IANS)

 

Next Story

Google Claims It Has “No Plans” To Relaunch A Search Engine in China

Technology companies have recently been a favorite target of many members of the U.S. Congress, who have criticized them over a wide range of issues such as privacy, work in China and allowing foreign meddling in U.S. elections.

0
Google
The Chinese flag is seen near the Google sign at the Google china headquarters in Beijing, China. VOA

The United States’ top general said on Thursday that the Chinese military was benefiting from the work Alphabet Inc’s Google was doing in China, where the technology giant has long sought to have a bigger presence.

“The work that Google is doing in China is indirectly benefiting the Chinese military,” Marine General Joseph Dunford, chairman of the Joint Chiefs of Staff, said during a Senate Armed Services Committee hearing.

“We watch with great concern when industry partners work in China knowing that there is that indirect benefit,” he said.

google
Lawmakers and Google employees have raised concerns the company would comply with China’s internet censorship and surveillance policies if it re-enters the Asian nation’s search engine market. Pixabay

“Frankly, ‘indirect’ may be not a full characterization of the way it really is, it is more of a direct benefit to the Chinese military.”

Last year Google said it was no longer vying for a $10 billion cloud computing contract with the U.S. Defense Department, in part because the company’s new ethical guidelines do not align with the project.

In June, Google said it would not renew a contract to help the U.S. military analyze aerial drone imagery when it expires, as the company sought to defuse an internal uproar over the deal.

At the same time, Google said it has “no plans” to relaunch a search engine in China, though it is continuing to study the idea.

During the hearing, Republican Senator Josh Hawley sharply criticized the tech company, referring to it as “a supposedly American company.”

FILE - Sen. Josh Hawley, R-Mo., speaks during a hearing of a Senate Judiciary Committee in Washington, March 6, 2019.
Sen. Josh Hawley, R-Mo., speaks during a hearing of a Senate Judiciary Committee in Washington, March 6, 2019. VOA

Technology companies have recently been a favorite target of many members of the U.S. Congress, who have criticized them over a wide range of issues such as privacy, work in China and allowing foreign meddling in U.S. elections.

Lawmakers and Google employees have raised concerns the company would comply with China’s internet censorship and surveillance policies if it re-enters the Asian nation’s search engine market.

Also Read: India and Pakistan Threaten to Release Missiles at Each Othe

Asked about Dunford’s comments, Google referred to previous statements.

Google Chief Executive Sundar Pichai has previously said the company has invested in China for years and plans to continue to do so, but that the company also was continuing to work with the U.S. government on projects in health care, cybersecurity and other fields. (VOA)