tweets_ar_en_parallel

참고자료:

• 암호
• 포옹하는 얼굴

평행트윗

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:tweets_ar_en_parallel/parallelTweets')

• 설명 :

Twitter users often post parallel tweets—tweets that contain the same content but are
    written in different languages. Parallel tweets can be an important resource for developing
    machine translation (MT) systems among other natural language processing (NLP) tasks. This
    resource is a result of a generic method for collecting parallel tweets. Using the method,
    we compiled a bilingual corpus of English-Arabic parallel tweets and a list of Twitter accounts
    who post English-Arabic tweets regularly. Additionally, we annotate a subset of Twitter accounts
    with their countries of origin and topic of interest, which provides insights about the population
    who post parallel tweets.

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

나뉘다	예
'test'	166706

• 특징 :

{
    "ArabicTweetID": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "EnglishTweetID": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    }
}

계정목록

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:tweets_ar_en_parallel/accountList')

• 설명 :

Twitter users often post parallel tweets—tweets that contain the same content but are
    written in different languages. Parallel tweets can be an important resource for developing
    machine translation (MT) systems among other natural language processing (NLP) tasks. This
    resource is a result of a generic method for collecting parallel tweets. Using the method,
    we compiled a bilingual corpus of English-Arabic parallel tweets and a list of Twitter accounts
    who post English-Arabic tweets regularly. Additionally, we annotate a subset of Twitter accounts
    with their countries of origin and topic of interest, which provides insights about the population
    who post parallel tweets.

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

나뉘다	예
'test'	1389

• 특징 :

{
    "account": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

국가 주제주석

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:tweets_ar_en_parallel/countryTopicAnnotation')

• 설명 :

Twitter users often post parallel tweets—tweets that contain the same content but are
    written in different languages. Parallel tweets can be an important resource for developing
    machine translation (MT) systems among other natural language processing (NLP) tasks. This
    resource is a result of a generic method for collecting parallel tweets. Using the method,
    we compiled a bilingual corpus of English-Arabic parallel tweets and a list of Twitter accounts
    who post English-Arabic tweets regularly. Additionally, we annotate a subset of Twitter accounts
    with their countries of origin and topic of interest, which provides insights about the population
    who post parallel tweets.

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

나뉘다	예
'test'	200

• 특징 :

{
    "account": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "country": {
        "num_classes": 12,
        "names": [
            "QA",
            "BH",
            "AE",
            "OM",
            "SA",
            "PL",
            "JO",
            "IQ",
            "Other",
            "EG",
            "KW",
            "SY"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "topic": {
        "num_classes": 12,
        "names": [
            "Gov",
            "Culture",
            "Education",
            "Sports",
            "Travel",
            "Events",
            "Business",
            "Science",
            "Politics",
            "Health",
            "Governoment",
            "Media"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}