Search in sources :

Example 11 with Token

use of com.google.cloud.language.v1.Token in project java-docs-samples by GoogleCloudPlatform.

the class Analyze method analyzeSyntaxFile.

/**
 * Get the syntax of the GCS hosted file.
 */
public static List<Token> analyzeSyntaxFile(String gcsUri) throws Exception {
    // Instantiate the Language client com.google.cloud.language.v1.LanguageServiceClient
    try (LanguageServiceClient language = LanguageServiceClient.create()) {
        Document doc = Document.newBuilder().setGcsContentUri(gcsUri).setType(Type.PLAIN_TEXT).build();
        AnalyzeSyntaxRequest request = AnalyzeSyntaxRequest.newBuilder().setDocument(doc).setEncodingType(EncodingType.UTF16).build();
        // analyze the syntax in the given text
        AnalyzeSyntaxResponse response = language.analyzeSyntax(request);
        // print the response
        for (Token token : response.getTokensList()) {
            System.out.printf("\tText: %s\n", token.getText().getContent());
            System.out.printf("\tBeginOffset: %d\n", token.getText().getBeginOffset());
            System.out.printf("Lemma: %s\n", token.getLemma());
            System.out.printf("PartOfSpeechTag: %s\n", token.getPartOfSpeech().getTag());
            System.out.printf("\tAspect: %s\n", token.getPartOfSpeech().getAspect());
            System.out.printf("\tCase: %s\n", token.getPartOfSpeech().getCase());
            System.out.printf("\tForm: %s\n", token.getPartOfSpeech().getForm());
            System.out.printf("\tGender: %s\n", token.getPartOfSpeech().getGender());
            System.out.printf("\tMood: %s\n", token.getPartOfSpeech().getMood());
            System.out.printf("\tNumber: %s\n", token.getPartOfSpeech().getNumber());
            System.out.printf("\tPerson: %s\n", token.getPartOfSpeech().getPerson());
            System.out.printf("\tProper: %s\n", token.getPartOfSpeech().getProper());
            System.out.printf("\tReciprocity: %s\n", token.getPartOfSpeech().getReciprocity());
            System.out.printf("\tTense: %s\n", token.getPartOfSpeech().getTense());
            System.out.printf("\tVoice: %s\n", token.getPartOfSpeech().getVoice());
            System.out.println("DependencyEdge");
            System.out.printf("\tHeadTokenIndex: %d\n", token.getDependencyEdge().getHeadTokenIndex());
            System.out.printf("\tLabel: %s\n\n", token.getDependencyEdge().getLabel());
        }
        return response.getTokensList();
    }
// [END analyze_syntax_file]
}
Also used : LanguageServiceClient(com.google.cloud.language.v1.LanguageServiceClient) AnalyzeSyntaxRequest(com.google.cloud.language.v1.AnalyzeSyntaxRequest) Token(com.google.cloud.language.v1.Token) Document(com.google.cloud.language.v1.Document) AnalyzeSyntaxResponse(com.google.cloud.language.v1.AnalyzeSyntaxResponse)

Example 12 with Token

use of com.google.cloud.language.v1.Token in project SmartMesh_Android by SmartMeshFoundation.

the class PinYin method getPinYin.

// The same return return pinyin Chinese characters, letters, are converted to lowercase
public static String getPinYin(String input) {
    ArrayList<Token> tokens = HanziToPinyin3.getInstance().get(input);
    StringBuilder sb = new StringBuilder();
    if (tokens != null && tokens.size() > 0) {
        for (Token token : tokens) {
            if (Token.PINYIN == token.type) {
                sb.append(token.target);
            } else {
                sb.append(token.source);
            }
        }
    }
    return sb.toString().toLowerCase();
}
Also used : Token(com.lingtuan.firefly.custom.contact.HanziToPinyin3.Token)

Example 13 with Token

use of com.google.cloud.language.v1.Token in project cloudbreak by hortonworks.

the class OpenStackClient method createAccessOrToken.

private void createAccessOrToken(AuthenticatedContext authenticatedContext) {
    Access access = createAccess(authenticatedContext.getCloudCredential());
    Token token = createToken(authenticatedContext.getCloudCredential());
    if (token == null && access == null) {
        throw new CloudConnectorException("Unsupported keystone version");
    } else if (token != null) {
        authenticatedContext.putParameter(Token.class, token);
    } else {
        authenticatedContext.putParameter(Access.class, access);
    }
}
Also used : CloudConnectorException(com.sequenceiq.cloudbreak.cloud.exception.CloudConnectorException) Access(org.openstack4j.model.identity.v2.Access) Token(org.openstack4j.model.identity.v3.Token)

Example 14 with Token

use of com.google.cloud.language.v1.Token in project cloudbreak by hortonworks.

the class OpenStackClient method getRegion.

public Set<String> getRegion(CloudCredential cloudCredential) {
    Access access = createAccess(cloudCredential);
    Token token = createToken(cloudCredential);
    Set<String> regions = new HashSet<>();
    if (token == null && access == null) {
        throw new CloudConnectorException("Unsupported keystone version");
    } else if (token != null) {
        for (Service service : token.getCatalog()) {
            for (Endpoint endpoint : service.getEndpoints()) {
                regions.add(endpoint.getRegion());
            }
        }
    } else {
        for (Access.Service service : access.getServiceCatalog()) {
            for (org.openstack4j.model.identity.v2.Endpoint endpoint : service.getEndpoints()) {
                regions.add(endpoint.getRegion());
            }
        }
    }
    LOGGER.info("regions from openstack: {}", regions);
    return regions;
}
Also used : Endpoint(org.openstack4j.model.identity.v3.Endpoint) CloudConnectorException(com.sequenceiq.cloudbreak.cloud.exception.CloudConnectorException) Access(org.openstack4j.model.identity.v2.Access) Service(org.openstack4j.model.identity.v3.Service) Token(org.openstack4j.model.identity.v3.Token) HashSet(java.util.HashSet)

Aggregations

Token (edu.rice.cs.caper.bayou.core.lexer.evidencel._1_0.Token)7 EvidenceLLexer (edu.rice.cs.caper.bayou.core.lexer.evidencel._1_0.EvidenceLLexer)6 Test (org.junit.Test)6 TokenTypeIdentifier (edu.rice.cs.caper.bayou.core.lexer.evidencel._1_0.TokenTypeIdentifier)4 TokenTypeColon (edu.rice.cs.caper.bayou.core.lexer.evidencel._1_0.TokenTypeColon)3 Token (org.openstack4j.model.identity.v3.Token)3 AnalyzeSyntaxRequest (com.google.cloud.language.v1.AnalyzeSyntaxRequest)2 AnalyzeSyntaxResponse (com.google.cloud.language.v1.AnalyzeSyntaxResponse)2 Document (com.google.cloud.language.v1.Document)2 LanguageServiceClient (com.google.cloud.language.v1.LanguageServiceClient)2 Token (com.google.cloud.language.v1.Token)2 CloudConnectorException (com.sequenceiq.cloudbreak.cloud.exception.CloudConnectorException)2 Access (org.openstack4j.model.identity.v2.Access)2 Token (com.lingtuan.firefly.custom.contact.HanziToPinyin3.Token)1 HashSet (java.util.HashSet)1 Access (org.openstack.docs.identity.api.v2.Access)1 Token (org.openstack.docs.identity.api.v2.Token)1 KeystoneAuthenticationToken (org.openstack.keystone.auth.client.KeystoneAuthenticationToken)1 Endpoint (org.openstack4j.model.identity.v3.Endpoint)1 Service (org.openstack4j.model.identity.v3.Service)1