Search in sources :

Example 1 with JSONException

use of json.JSONException in project IR_Base by Linda-sunshine.

the class DocAnalyzer method LoadJsonDoc.

// Load a document and analyze it.
protected void LoadJsonDoc(String filename) {
    _Product prod = null;
    JSONArray jarray = null;
    try {
        JSONObject json = LoadJSON(filename);
        prod = new _Product(json.getJSONObject("ProductInfo"));
        jarray = json.getJSONArray("Reviews");
    } catch (Exception e) {
        // fail to parse a json document
        System.err.print('X');
        return;
    }
    for (int i = 0; i < jarray.length(); i++) {
        try {
            _Post post = new _Post(jarray.getJSONObject(i));
            if (post.isValid(m_dateFormatter)) {
                long timeStamp = m_dateFormatter.parse(post.getDate()).getTime();
                String content;
                // append document title into document content
                if (Utils.endWithPunct(post.getTitle()))
                    content = post.getTitle() + " " + post.getContent();
                else
                    content = post.getTitle() + ". " + post.getContent();
                // int ID, String name, String prodID, String title, String source, int ylabel, long timeStamp
                _Doc review = new _Doc(m_corpus.getSize(), post.getID(), prod.getID(), post.getTitle(), content, post.getLabel() - 1, timeStamp);
                if (this.m_stnDetector != null)
                    AnalyzeDocWithStnSplit(review);
                else
                    AnalyzeDoc(review);
            }
        } catch (ParseException e) {
            System.out.print('T');
        } catch (JSONException e) {
            System.out.print('P');
        }
    }
}
Also used : JSONObject(json.JSONObject) structures._Doc(structures._Doc) structures._Product(structures._Product) JSONArray(json.JSONArray) JSONException(json.JSONException) ParseException(java.text.ParseException) JSONException(json.JSONException) InvalidFormatException(opennlp.tools.util.InvalidFormatException) ParseException(java.text.ParseException) IOException(java.io.IOException) FileNotFoundException(java.io.FileNotFoundException) structures._Post(structures._Post)

Example 2 with JSONException

use of json.JSONException in project IR_Base by Linda-sunshine.

the class HTSMAnalyzer method LoadNewEggDoc.

// Load a document and analyze it.
public void LoadNewEggDoc(String filename) {
    JSONObject prod = null;
    String item;
    JSONArray itemIds, reviews;
    try {
        JSONObject json = LoadJSON(filename);
        prod = json.getJSONObject(m_category);
        itemIds = prod.names();
        System.out.printf("Under %s category, Number of Items: %d\n", m_category, itemIds.length());
    } catch (Exception e) {
        System.out.print('X');
        return;
    }
    for (int i = 0; i < itemIds.length(); i++) {
        try {
            item = itemIds.getString(i);
            reviews = prod.getJSONArray(item);
            for (int j = 0; j < reviews.length(); j++) {
                if (this.m_stnDetector != null)
                    AnalyzeNewEggPostWithSentence(new _NewEggPost(reviews.getJSONObject(j), item));
                else
                    AnalyzeNewEggPost(new _NewEggPost(reviews.getJSONObject(j), item));
            }
        } catch (JSONException e) {
            System.out.print('P');
            e.printStackTrace();
        } catch (ParseException e) {
            e.printStackTrace();
        }
    }
}
Also used : JSONObject(json.JSONObject) JSONArray(json.JSONArray) structures._NewEggPost(structures._NewEggPost) JSONException(json.JSONException) ParseException(java.text.ParseException) JSONException(json.JSONException) IOException(java.io.IOException) InvalidFormatException(opennlp.tools.util.InvalidFormatException) FileNotFoundException(java.io.FileNotFoundException) ParseException(java.text.ParseException)

Example 3 with JSONException

use of json.JSONException in project IR_Base by Linda-sunshine.

the class MultiThreadedLMAnalyzer method LoadJsonDoc.

// Load a document and analyze it.
@Override
public void LoadJsonDoc(String filename) {
    _Product prod = null;
    JSONArray jarray = null;
    try {
        JSONObject json = LoadJSON(filename);
        prod = new _Product(json.getJSONObject("asin"));
        jarray = json.getJSONArray("related");
    } catch (Exception e) {
        // fail to parse a json document
        System.err.print('X');
        return;
    }
    for (int i = 0; i < jarray.length(); i++) {
        try {
            _Post post = new _Post(jarray.getJSONObject(i));
            if (post.isValid(m_dateFormatter)) {
                long timeStamp = m_dateFormatter.parse(post.getDate()).getTime();
                String content;
                // append document title into document content
                if (Utils.endWithPunct(post.getTitle()))
                    content = post.getTitle() + " " + post.getContent();
                else
                    content = post.getTitle() + ". " + post.getContent();
                // int ID, String name, String prodID, String title, String source, int ylabel, long timeStamp
                _Doc review = new _Doc(m_corpus.getSize(), post.getID(), prod.getID(), post.getTitle(), content, post.getLabel() - 1, timeStamp);
                if (this.m_stnDetector != null)
                    AnalyzeDocWithStnSplit(review);
                else
                    AnalyzeDoc(review);
            }
        } catch (ParseException e) {
            System.out.print('T');
        } catch (JSONException e) {
            System.out.print('P');
        }
    }
}
Also used : JSONObject(json.JSONObject) structures._Doc(structures._Doc) structures._Product(structures._Product) JSONArray(json.JSONArray) JSONException(json.JSONException) ParseException(java.text.ParseException) JSONException(json.JSONException) InvalidFormatException(opennlp.tools.util.InvalidFormatException) ParseException(java.text.ParseException) IOException(java.io.IOException) FileNotFoundException(java.io.FileNotFoundException) structures._Post(structures._Post)

Example 4 with JSONException

use of json.JSONException in project IR_Base by Linda-sunshine.

the class ParentChildAnalyzer method loadParentDoc.

public void loadParentDoc(String fileName) {
    if (fileName == null || fileName.isEmpty())
        return;
    JSONObject json = LoadJSON(fileName);
    String title = Utils.getJSONValue(json, "title");
    String content = Utils.getJSONValue(json, "content");
    String name = Utils.getJSONValue(json, "name");
    String[] sentences = null;
    // _ParentDoc d = new _ParentDoc(m_corpus.getSize(), name, title,
    // content, 0);
    _ParentDoc d = new _ParentDoc4DCM(m_corpus.getSize(), name, title, content, 0);
    try {
        JSONArray sentenceArray = json.getJSONArray("sentences");
        sentences = new String[sentenceArray.length()];
        // shall we add title into this sentence array
        for (int i = 0; i < sentenceArray.length(); i++) sentences[i] = Utils.getJSONValue(sentenceArray.getJSONObject(i), "sentence");
        if (AnalyzeDocByStn(d, sentences))
            parentHashMap.put(name, d);
    } catch (JSONException e) {
        e.printStackTrace();
    }
}
Also used : JSONObject(json.JSONObject) structures._ParentDoc(structures._ParentDoc) structures._ParentDoc4DCM(structures._ParentDoc4DCM) JSONArray(json.JSONArray) JSONException(json.JSONException)

Aggregations

JSONArray (json.JSONArray)4 JSONException (json.JSONException)4 JSONObject (json.JSONObject)4 FileNotFoundException (java.io.FileNotFoundException)3 IOException (java.io.IOException)3 ParseException (java.text.ParseException)3 InvalidFormatException (opennlp.tools.util.InvalidFormatException)3 structures._Doc (structures._Doc)2 structures._Post (structures._Post)2 structures._Product (structures._Product)2 structures._NewEggPost (structures._NewEggPost)1 structures._ParentDoc (structures._ParentDoc)1 structures._ParentDoc4DCM (structures._ParentDoc4DCM)1