Search in sources :

Example 6 with ArchiverImpl

use of com.yelp.nrtsearch.server.backup.ArchiverImpl in project nrtsearch by Yelp.

the class WarmerTest method setup.

@Before
public void setup() throws IOException {
    Path s3Directory = folder.newFolder("s3").toPath();
    Path archiverDirectory = folder.newFolder("archiver").toPath();
    api = S3Mock.create(8011, s3Directory.toAbsolutePath().toString());
    api.start();
    s3 = new AmazonS3Client(new AnonymousAWSCredentials());
    s3.setEndpoint("http://127.0.0.1:8011");
    String bucketName = "warmer-unittest";
    s3.createBucket(bucketName);
    archiver = new ArchiverImpl(s3, bucketName, archiverDirectory, new TarImpl(TarImpl.CompressionMode.LZ4));
    warmer = new Warmer(archiver, service, index, 2);
}
Also used : Path(java.nio.file.Path) AmazonS3Client(com.amazonaws.services.s3.AmazonS3Client) ArchiverImpl(com.yelp.nrtsearch.server.backup.ArchiverImpl) AnonymousAWSCredentials(com.amazonaws.auth.AnonymousAWSCredentials) TarImpl(com.yelp.nrtsearch.server.backup.TarImpl) Before(org.junit.Before)

Example 7 with ArchiverImpl

use of com.yelp.nrtsearch.server.backup.ArchiverImpl in project nrtsearch by Yelp.

the class LuceneServerTest method setUpArchiver.

private Archiver setUpArchiver() throws IOException {
    Path s3Directory = folder.newFolder("s3").toPath();
    Path archiverDirectory = folder.newFolder("archiver").toPath();
    api = S3Mock.create(8011, s3Directory.toAbsolutePath().toString());
    api.start();
    s3 = new AmazonS3Client(new AnonymousAWSCredentials());
    s3.setEndpoint("http://127.0.0.1:8011");
    String bucketName = "warmer-unittest";
    s3.createBucket(bucketName);
    return new ArchiverImpl(s3, bucketName, archiverDirectory, new TarImpl(TarImpl.CompressionMode.LZ4));
}
Also used : Path(java.nio.file.Path) AmazonS3Client(com.amazonaws.services.s3.AmazonS3Client) ArchiverImpl(com.yelp.nrtsearch.server.backup.ArchiverImpl) AnonymousAWSCredentials(com.amazonaws.auth.AnonymousAWSCredentials) TarImpl(com.yelp.nrtsearch.server.backup.TarImpl)

Example 8 with ArchiverImpl

use of com.yelp.nrtsearch.server.backup.ArchiverImpl in project nrtsearch by Yelp.

the class ReplicationTestFailureScenarios method setUp.

@Before
public void setUp() throws IOException {
    // setup S3 for backup/restore
    s3Directory = folder.newFolder("s3").toPath();
    archiverDirectory = folder.newFolder("archiver").toPath();
    api = S3Mock.create(8011, s3Directory.toAbsolutePath().toString());
    api.start();
    s3 = new AmazonS3Client(new AnonymousAWSCredentials());
    s3.setEndpoint("http://127.0.0.1:8011");
    s3.createBucket(BUCKET_NAME);
    archiver = new ArchiverImpl(s3, BUCKET_NAME, archiverDirectory, new TarImpl(Tar.CompressionMode.LZ4));
    startPrimaryServer();
    startSecondaryServer();
}
Also used : AmazonS3Client(com.amazonaws.services.s3.AmazonS3Client) ArchiverImpl(com.yelp.nrtsearch.server.backup.ArchiverImpl) AnonymousAWSCredentials(com.amazonaws.auth.AnonymousAWSCredentials) TarImpl(com.yelp.nrtsearch.server.backup.TarImpl) Before(org.junit.Before)

Aggregations

ArchiverImpl (com.yelp.nrtsearch.server.backup.ArchiverImpl)8 TarImpl (com.yelp.nrtsearch.server.backup.TarImpl)8 AnonymousAWSCredentials (com.amazonaws.auth.AnonymousAWSCredentials)7 AmazonS3Client (com.amazonaws.services.s3.AmazonS3Client)7 Before (org.junit.Before)6 LuceneServerConfiguration (com.yelp.nrtsearch.server.config.LuceneServerConfiguration)3 GlobalState (com.yelp.nrtsearch.server.luceneserver.GlobalState)2 Path (java.nio.file.Path)2 CountDownLatch (java.util.concurrent.CountDownLatch)1