Search in sources :

Example 6 with Config

use of com.typesafe.config.Config in project aerosolve by airbnb.

the class CapFloatTransformTest method testTransformWithNewOutput.

@Test
public void testTransformWithNewOutput() {
    Config config = ConfigFactory.parseString(makeConfigWithOutput());
    Transform transform = TransformFactory.createTransform(config, "test_cap");
    FeatureVector featureVector = TransformTestingHelper.makeFeatureVector();
    transform.doTransform(featureVector);
    Map<String, Set<String>> stringFeatures = featureVector.getStringFeatures();
    assertTrue(stringFeatures.size() == 1);
    // original feature should not change
    Map<String, Double> feat1 = featureVector.getFloatFeatures().get("loc");
    assertEquals(3, feat1.size());
    assertEquals(37.7, feat1.get("lat"), 0.1);
    assertEquals(40.0, feat1.get("long"), 0.1);
    assertEquals(-20, feat1.get("z"), 0.1);
    // capped features are in a new feature family
    assertTrue(featureVector.getFloatFeatures().containsKey("new_output"));
    Map<String, Double> feat2 = featureVector.getFloatFeatures().get("new_output");
    assertEquals(3, feat2.size());
    assertEquals(37.7, feat2.get("lat"), 0.1);
    assertEquals(39.0, feat2.get("long"), 0.1);
    assertEquals(1.0, feat2.get("z"), 0.1);
}
Also used : FeatureVector(com.airbnb.aerosolve.core.FeatureVector) Config(com.typesafe.config.Config) Test(org.junit.Test)

Example 7 with Config

use of com.typesafe.config.Config in project aerosolve by airbnb.

the class ConvertStringCaseTransformTest method testEmptyFeatureVector.

@Test
public void testEmptyFeatureVector() {
    Config config = ConfigFactory.parseString(makeConfig(false, false));
    Transform transform = TransformFactory.createTransform(config, "test_convert_string_case");
    FeatureVector featureVector = new FeatureVector();
    transform.doTransform(featureVector);
    assertTrue(featureVector.getStringFeatures() == null);
}
Also used : FeatureVector(com.airbnb.aerosolve.core.FeatureVector) Config(com.typesafe.config.Config) Test(org.junit.Test)

Example 8 with Config

use of com.typesafe.config.Config in project aerosolve by airbnb.

the class ConvertStringCaseTransformTest method testTransformConvertToLowercase.

@Test
public void testTransformConvertToLowercase() {
    Config config = ConfigFactory.parseString(makeConfig(false, false));
    Transform transform = TransformFactory.createTransform(config, "test_convert_string_case");
    FeatureVector featureVector = makeFeatureVector();
    transform.doTransform(featureVector);
    Map<String, Set<String>> stringFeatures = featureVector.getStringFeatures();
    assertNotNull(stringFeatures);
    assertEquals(2, stringFeatures.size());
    Set<String> output = stringFeatures.get("bar");
    assertNotNull(output);
    assertEquals(2, output.size());
    assertTrue(output.contains("i like blueberry pie, apple pie; and i also like blue!"));
    assertTrue(output.contains("i'm so  excited: i   like blue!?!!"));
}
Also used : FeatureVector(com.airbnb.aerosolve.core.FeatureVector) Set(java.util.Set) HashSet(java.util.HashSet) Config(com.typesafe.config.Config) Test(org.junit.Test)

Example 9 with Config

use of com.typesafe.config.Config in project aerosolve by airbnb.

the class CrossTransformTest method testTransform.

@Test
public void testTransform() {
    Config config = ConfigFactory.parseString(makeConfig());
    Transform transform = TransformFactory.createTransform(config, "test_cross");
    FeatureVector featureVector = makeFeatureVector();
    transform.doTransform(featureVector);
    Map<String, Set<String>> stringFeatures = featureVector.getStringFeatures();
    assertTrue(stringFeatures.size() == 3);
    Set<String> out = stringFeatures.get("out");
    assertTrue(out.size() == 4);
    log.info("Cross output");
    for (String string : out) {
        log.info(string);
    }
    assertTrue(out.contains("aaa^11"));
    assertTrue(out.contains("aaa^22"));
    assertTrue(out.contains("bbb^11"));
    assertTrue(out.contains("bbb^22"));
}
Also used : FeatureVector(com.airbnb.aerosolve.core.FeatureVector) HashSet(java.util.HashSet) Set(java.util.Set) Config(com.typesafe.config.Config) Test(org.junit.Test)

Example 10 with Config

use of com.typesafe.config.Config in project aerosolve by airbnb.

the class CrossTransformTest method testTwoKeysTransform.

@Test
public void testTwoKeysTransform() {
    Config config = ConfigFactory.parseString(makeBothKeyConfig());
    Transform transform = TransformFactory.createTransform(config, "test_cross");
    FeatureVector featureVector = makeFeatureVector();
    transform.doTransform(featureVector);
    Map<String, Set<String>> stringFeatures = featureVector.getStringFeatures();
    assertTrue(stringFeatures.size() == 3);
    Set<String> out = stringFeatures.get("out");
    log.info("Cross output");
    for (String string : out) {
        log.info(string);
    }
    assertEquals(1, out.size());
    assertTrue(out.contains("aaa^22"));
}
Also used : FeatureVector(com.airbnb.aerosolve.core.FeatureVector) HashSet(java.util.HashSet) Set(java.util.Set) Config(com.typesafe.config.Config) Test(org.junit.Test)

Aggregations

Config (com.typesafe.config.Config)138 Test (org.junit.Test)120 FeatureVector (com.airbnb.aerosolve.core.FeatureVector)117 Set (java.util.Set)35 HashSet (java.util.HashSet)29 HashMap (java.util.HashMap)19 Map (java.util.Map)19 ActorSystem (akka.actor.ActorSystem)2 ConfigObject (com.typesafe.config.ConfigObject)2 ConfigValue (com.typesafe.config.ConfigValue)2 IOException (java.io.IOException)2 URI (java.net.URI)2 ArrayList (java.util.ArrayList)2 List (java.util.List)2 DrillConfig (org.apache.drill.common.config.DrillConfig)2 BeforeClass (org.junit.BeforeClass)2 Example (com.airbnb.aerosolve.core.Example)1 Stopwatch (com.google.common.base.Stopwatch)1 ServerConfig (com.nike.riposte.server.config.ServerConfig)1 ContainerConfig (com.spotify.docker.client.messages.ContainerConfig)1