org.seasar.robot.entity
クラス RobotsTxt

java.lang.Object
  org.seasar.robot.entity.RobotsTxt

public class RobotsTxt
extends Object

入れ子のクラスの概要

static class

RobotsTxt.Directives

フィールドの概要

protected Map<String,RobotsTxt.Directives>	agentsToDirectives
protected static String	ALL_BOTS

コンストラクタの概要

RobotsTxt()

メソッドの概要

void	addDirectives(String userAgent, RobotsTxt.Directives directives)
boolean	allows(String path, String userAgent)
int	getCrawlDelay(String userAgent)
RobotsTxt.Directives	getDirectives(String userAgent)
RobotsTxt.Directives	getDirectives(String userAgent, String defaultUserAgent)
String[]	getUserAgents()

クラス java.lang.Object から継承されたメソッド

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

フィールドの詳細

ALL_BOTS

protected static final String ALL_BOTS

関連項目:

定数フィールド値

agentsToDirectives

protected final Map<String,RobotsTxt.Directives> agentsToDirectives

コンストラクタの詳細

RobotsTxt

public RobotsTxt()

メソッドの詳細

allows

public boolean allows(String path,
                      String userAgent)

getCrawlDelay

public int getCrawlDelay(String userAgent)

getDirectives

public RobotsTxt.Directives getDirectives(String userAgent)

getDirectives

public RobotsTxt.Directives getDirectives(String userAgent,
                                          String defaultUserAgent)

addDirectives

public void addDirectives(String userAgent,
                          RobotsTxt.Directives directives)

getUserAgents

public String[] getUserAgents()