Loading…
Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Back To Schedule
Monday, May 9 • 4:10pm - 5:00pm
YARN: A Resource Manager for Analytic Platform - Tsuyoshi Ozawa, NTT

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Hadoop Yet Another Resource Negotiator (YARN) is a resource manager for processing big data. YARN can run various major distributed processing frameworks including not only MapReduce, but also Spark, Tez, Flink and so on to support various workloads.
I will talk about the architecture of YARN, how YARN manages resources in a cluster and how YARN is integrated with these processing frameworks. In particular, I will introduce the best practice to maximize the throughput of the processing frameworks on YARN with the optimization techniques of Spark on YARN and Tez on YARN as examples. I will talk about the points where our YARN community needs more helps and feedback.
Speakers
avatar for Tsuyoshi Ozawa

Tsuyoshi Ozawa

NTT
I’m a Research Engineer on topics in distributed computing working at NTT(Nippon Telegraph and Telephone corporation), which is one of the largest carrier company in Japan. I’ve been a committer and PMC on Apache Hadoop project. Prior to working on Hadoop, I researched the time... Read More →

YARN A Resource Manager for Analytic Platform pdf
Monday May 9, 2016 4:10pm - 5:00pm PDT
Regency A
  Managing Distributed Systems, Intermediate

Attendees (30)