0 votes
in HDFS by

How JobTracker schedules a task?

1 Answer

0 votes
by

The TaskTrackers send out heartbeat messages to the JobTracker, usually every few minutes, to reassure the JobTracker that it is still alive. These message also inform the JobTracker of the number of available slots, so the JobTracker can stay up to date with where in the cluster work can be delegated. When the JobTracker tries to find somewhere to schedule a task within the MapReduce operations, it first looks for an empty slot on the same server that hosts the DataNode containing the data, and if not, it looks for an empty slot on a machine in the same rack.

Related questions

0 votes
asked Jun 23, 2023 in HDFS by rajeshsharma
0 votes
asked Jun 21, 2023 in Hadoop by sharadyadav1986
...