Pig Error: Pig 0.11.2/Hadoop 0.21.0

[dbl001]

pig -l /tmp -x local -v -w sent_counts.pig
2014-08-13 22:26:16,744 [main] INFO org.apache.pig.Main - Apache Pig version 0.11.2-SNAPSHOT (rUnversioned directory) compiled Aug 13 2014, 21:53:01
2014-08-13 22:26:16,745 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1407990376721.log
2014-08-13 22:26:17,005 [main] INFO org.apache.hadoop.security.Groups - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
2014-08-13 22:26:17,222 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /Users/davidlaxer/.pigbootup not found
2014-08-13 22:26:17,271 [main] INFO org.apache.pig.tools.parameters.PreprocessorContext - Executing command : echo $HOME
2014-08-13 22:26:17,443 [main] WARN org.apache.hadoop.conf.Configuration - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-13 22:26:17,445 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
2014-08-13 22:26:17,449 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,450 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,451 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,452 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,538 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,539 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,608 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,608 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,687 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,696 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,783 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,788 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:18,926 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:18,930 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:18,996 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-08-13 22:26:19,670 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,671 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,672 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:19,767 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,767 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,768 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:19,874 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,874 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,886 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:19,980 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,981 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,987 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,018 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,018 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,039 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,145 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,158 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,159 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,210 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,210 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,211 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,322 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,322 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,323 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,412 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: GROUP_BY,ORDER_BY,FILTER
2014-08-13 22:26:20,497 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,521 [main] INFO org.apache.pig.newplan.logical.rules.ColumnPruneVisitor - Columns pruned for messages: $0, $1, $2, $3, $4, $5, $8, $9, $10
2014-08-13 22:26:20,561 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,562 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,583 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,583 [main] WARN org.apache.hadoop.conf.Configuration - mapred.textoutputformat.separator is deprecated. Instead, use mapreduce.output.textoutputformat.separator
2014-08-13 22:26:20,803 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false
2014-08-13 22:26:20,874 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,875 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,905 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer - Choosing to move algebraic foreach to combiner
2014-08-13 22:26:20,952 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 3
2014-08-13 22:26:20,952 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 3
2014-08-13 22:26:20,959 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,961 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,973 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,014 [main] WARN org.apache.pig.backend.hadoop20.PigJobControl - falling back to default JobControl (not using hadoop 0.20 ?)
java.lang.NoSuchFieldException: runnerState
at java.lang.Class.getDeclaredField(Class.java:2057)
at org.apache.pig.backend.hadoop20.PigJobControl.(PigJobControl.java:51)
at org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:97)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:285)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
at org.apache.pig.PigServer.execute(PigServer.java:1239)
at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:604)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
2014-08-13 22:26:21,052 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,055 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2014-08-13 22:26:21,106 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2014-08-13 22:26:21,107 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2014-08-13 22:26:21,107 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2014-08-13 22:26:21,107 [main] WARN org.apache.hadoop.conf.Configuration - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-13 22:26:21,114 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Using reducer estimator: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator
2014-08-13 22:26:21,116 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator - BytesPerReducer=1000000000 maxReducers=999 totalInputFileSize=23891952
2014-08-13 22:26:21,117 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1
2014-08-13 22:26:21,118 [main] WARN org.apache.hadoop.conf.Configuration - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2014-08-13 22:26:21,260 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
2014-08-13 22:26:21,274 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
2014-08-13 22:26:21,275 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cacche
2014-08-13 22:26:21,275 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /var/folders/nj/nphdkhyj6s1dttb0pd9zb2wc0000gn/T/1407990381274-0
2014-08-13 22:26:21,488 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,491 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
2014-08-13 22:26:21,492 [main] ERROR org.apache.pig.tools.grunt.Grunt - java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:296)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
at org.apache.pig.PigServer.execute(PigServer.java:1239)
at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:604)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)

Details also at logfile: /private/tmp/pig_1407990376721.log
David-Laxers-MacBook-Pro:pig davidlaxer$

sudo ant clean jar-withouthadoop
Buildfile: /Users/davidlaxer/pig-0.11.1-src/build.xml

clean:
[delete] Deleting directory /Users/davidlaxer/pig-0.11.1-src/build

clean:

clean:

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/lib
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/report
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/maven

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml

ivy-resolve:
[ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.11.2-SNAPSHOT
[ivy:resolve] confs: [master, default, runtime, compile, test, javadoc, releaseaudit, jdiff, checkstyle, buildJar, hadoop20, hadoop23]
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.2 in maven2
[ivy:resolve] found xmlenc#xmlenc;0.52 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-codec#commons-codec;1.4 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve] found commons-digester#commons-digester;1.8 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2
[ivy:resolve] found commons-net#commons-net;1.4.1 in maven2
[ivy:resolve] found oro#oro;2.0.8 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2
[ivy:resolve] found tomcat#jasper-runtime;5.5.12 in maven2
[ivy:resolve] found tomcat#jasper-compiler;5.5.12 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in maven2
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in maven2
[ivy:resolve] found ant#ant;1.6.5 in maven2
[ivy:resolve] found commons-el#commons-el;1.0 in maven2
[ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in maven2
[ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in maven2
[ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in maven2
[ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in maven2
[ivy:resolve] found commons-io#commons-io;2.3 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:resolve] found log4j#log4j;1.2.16 in maven2
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:resolve] found org.apache.avro#avro;1.5.3 in maven2
[ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in maven2
[ivy:resolve] found org.xerial.snappy#snappy-java;1.0.3.2 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in maven2
[ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in maven2
[ivy:resolve] found com.jcraft#jsch;0.1.38 in maven2
[ivy:resolve] found jline#jline;0.9.94 in maven2
[ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:resolve] found joda-time#joda-time;1.6 in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:resolve] found rhino#js;1.7R2 in maven2
[ivy:resolve] found org.antlr#antlr;3.4 in maven2
[ivy:resolve] found org.antlr#antlr-runtime;3.4 in maven2
[ivy:resolve] found org.antlr#stringtemplate;3.2.1 in maven2
[ivy:resolve] found antlr#antlr;2.7.7 in maven2
[ivy:resolve] found org.antlr#ST4;4.0.4 in maven2
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.3.3 in maven2
[ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:resolve] found org.apache.hbase#hbase;0.90.0 in maven2
[ivy:resolve] found org.vafer#jdeb;0.8 in maven2
[ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:resolve] found xalan#xalan;2.7.1 in maven2
[ivy:resolve] found xalan#serializer;2.7.1 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.3.04 in maven2
[ivy:resolve] found xerces#xercesImpl;2.10.0 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.4.01 in maven2
[ivy:resolve] found junit#junit;4.11 in maven2
[ivy:resolve] found org.hamcrest#hamcrest-core;1.3 in maven2
[ivy:resolve] found org.jboss.netty#netty;3.2.2.Final in maven2
[ivy:resolve] found org.apache.hive#hive-exec;0.8.0 in maven2
[ivy:resolve] found junit#junit;3.8.1 in maven2
[ivy:resolve] found com.google.code.p.arat#rat-lib;0.5.1 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.1 in maven2
[ivy:resolve] found jdiff#jdiff;1.0.9 in maven2
[ivy:resolve] found checkstyle#checkstyle;4.2 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.7.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.0 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.0.3 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in maven2
[ivy:resolve] found com.sun.jersey#jersey-bundle;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in maven2
[ivy:resolve] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.1 in maven2
[ivy:resolve] found javax.servlet#servlet-api;2.5 in maven2
[ivy:resolve] found javax.ws.rs#jsr311-api;1.1.1 in maven2
[ivy:resolve] found com.google.protobuf#protobuf-java;2.4.0a in maven2
[ivy:resolve] found javax.inject#javax.inject;1 in maven2
[ivy:resolve] found javax.xml.bind#jaxb-api;2.2.2 in maven2
[ivy:resolve] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in maven2
[ivy:resolve] found com.google.inject#guice;3.0 in maven2
[ivy:resolve] found com.google.inject.extensions#guice-servlet;3.0 in maven2
[ivy:resolve] found aopalliance#aopalliance;1.0 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-annotations;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-auth;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-hdfs;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-core;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-tests;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-app;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-api;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-web-proxy;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-nodemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-hs;2.0.0-alpha in maven2
[ivy:resolve] :: resolution report :: resolve 6281ms :: artifacts dl 178ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] junit#junit;3.8.1 by [junit#junit;4.11] in [javadoc, default, test, buildJar, runtime]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.1] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.7.3 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [javadoc, default, test, buildJar, runtime]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| master | 0 | 0 | 0 | 0 || 0 | 0 |
| default | 91 | 0 | 0 | 16 || 76 | 0 |
| runtime | 91 | 0 | 0 | 16 || 76 | 0 |
| compile | 82 | 0 | 0 | 14 || 69 | 0 |
| test | 91 | 0 | 0 | 16 || 76 | 0 |
| javadoc | 91 | 0 | 0 | 16 || 76 | 0 |
| releaseaudit | 3 | 0 | 0 | 0 || 3 | 0 |
| jdiff | 3 | 0 | 0 | 0 || 3 | 0 |
| checkstyle | 6 | 0 | 0 | 0 || 6 | 0 |
| buildJar | 91 | 0 | 0 | 16 || 76 | 0 |
| hadoop20 | 48 | 0 | 0 | 9 || 39 | 0 |
| hadoop23 | 39 | 0 | 0 | 0 || 41 | 0 |
---------------------------------------------------------------------

ivy-compile:
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [compile]
[ivy:retrieve] 69 artifacts copied, 0 already retrieved (66821kB/2244ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml

init:
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/impl/logicalLayer/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/tools/pigscript/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/tools/parameters
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/test/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/data/parser
[move] Moving 1 file to /Users/davidlaxer/pig-0.11.1-src/build/ivy/lib/Pig

cc-compile:
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/pigscript/parser/PigScriptParser.jj . . .
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated successfully.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/parameters/PigFileParser.jj . . .
[javacc] Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated with 0 errors and 1 warnings.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/parameters/ParamLoader.jj . . .
[javacc] File "TokenMgrError.java" is being rebuilt.
[javacc] File "ParseException.java" is being rebuilt.
[javacc] File "Token.java" is being rebuilt.
[javacc] File "JavaCharStream.java" is being rebuilt.
[javacc] Parser generated successfully.
[jjtree] Java Compiler Compiler Version 4.2 (Tree Builder)
[jjtree](type "jjtree" with no arguments for help)
[jjtree] Reading from file /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/DOTParser.jjt . . .
[jjtree] File "Node.java" does not exist. Will create one.
[jjtree] File "SimpleNode.java" does not exist. Will create one.
[jjtree] File "DOTParserTreeConstants.java" does not exist. Will create one.
[jjtree] File "JJTDOTParserState.java" does not exist. Will create one.
[jjtree] Annotated grammar generated successfully in /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj . . .
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "SimpleCharStream.java" does not exist. Will create one.
[javacc] Parser generated successfully.

prepare:
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/parser

genLexer:

genParser:

genTreeParser:

gen:

compile:
[echo] *** Building Main Sources ***
[echo] *** To compile with all warnings enabled, supply -Dall.warnings=1 on command line ***
[echo] *** If all.warnings property is supplied, compile-sources-all-warnings target will be executed ***
[echo] *** Else, compile-sources (which only warns about deprecations) target will be executed ***

compile-sources:
[javac] /Users/davidlaxer/pig-0.11.1-src/build.xml:531: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 787 source files to /Users/davidlaxer/pig-0.11.1-src/build/classes
[javac] warning: [options] bootstrap class path not set in conjunction with -source 1.5
[javac] warning: [options] source value 1.5 is obsolete and will be removed in a future release
[javac] warning: [options] target value 1.5 is obsolete and will be removed in a future release
[javac] warning: [options] To suppress warnings about obsolete options, use -Xlint:-options.
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 4 warnings
[copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src/build/classes/org/apache/pig/tools/grunt
[copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src/build/classes/org/apache/pig/tools/grunt

compile-sources-all-warnings:

jar-withouthadoop:

jar-withouthadoopWithSvn:

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:

ivy-resolve:

ivy-buildJar:
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [buildJar]
[ivy:retrieve] 9 artifacts copied, 67 already retrieved (9631kB/208ms)

buildJar-withouthadoop:
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.11.1-src/build/pig-0.11.2-SNAPSHOT.jar
[jar] Building jar: /Users/davidlaxer/pig-0.11.1-src/build/pig-0.11.2-SNAPSHOT-withouthadoop.jar
[copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src

jar-withouthadoopWithOutSvn:

BUILD SUCCESSFUL
Total time: 1 minute 55 seconds
David-Laxers-MacBook-Pro:pig-0.11.1-src davidlaxer$ ant test
Buildfile: /Users/davidlaxer/pig-0.11.1-src/build.xml

test:

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml

ivy-resolve:
[ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.11.2-SNAPSHOT
[ivy:resolve] confs: [master, default, runtime, compile, test, javadoc, releaseaudit, jdiff, checkstyle, buildJar, hadoop20, hadoop23]
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in default
[ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.2 in fs
[ivy:resolve] found xmlenc#xmlenc;0.52 in default
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-codec#commons-codec;1.4 in fs
[ivy:resolve] found org.apache.commons#commons-math;2.1 in default
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in default
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in fs
[ivy:resolve] found commons-lang#commons-lang;2.4 in fs
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in fs
[ivy:resolve] found commons-digester#commons-digester;1.8 in fs
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in fs
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in default
[ivy:resolve] found commons-net#commons-net;1.4.1 in maven2
[ivy:resolve] found oro#oro;2.0.8 in fs
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in fs
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in fs
[ivy:resolve] found tomcat#jasper-runtime;5.5.12 in maven2
[ivy:resolve] found tomcat#jasper-compiler;5.5.12 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in default
[ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in default
[ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in default
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in default
[ivy:resolve] found ant#ant;1.6.5 in maven2
[ivy:resolve] found commons-el#commons-el;1.0 in default
[ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in default
[ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in maven2
[ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in default
[ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in maven2
[ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in fs
[ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in maven2
[ivy:resolve] found commons-io#commons-io;2.3 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:resolve] found log4j#log4j;1.2.16 in maven2
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:resolve] found org.apache.avro#avro;1.5.3 in maven2
[ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in maven2
[ivy:resolve] found org.xerial.snappy#snappy-java;1.0.3.2 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in maven2
[ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in default
[ivy:resolve] found com.jcraft#jsch;0.1.38 in fs
[ivy:resolve] found jline#jline;0.9.94 in fs
[ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:resolve] found joda-time#joda-time;1.6 in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:resolve] found rhino#js;1.7R2 in maven2
[ivy:resolve] found org.antlr#antlr;3.4 in default
[ivy:resolve] found org.antlr#antlr-runtime;3.4 in default
[ivy:resolve] found org.antlr#stringtemplate;3.2.1 in default
[ivy:resolve] found antlr#antlr;2.7.7 in fs
[ivy:resolve] found org.antlr#ST4;4.0.4 in default
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.3.3 in maven2
[ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:resolve] found org.apache.hbase#hbase;0.90.0 in maven2
[ivy:resolve] found org.vafer#jdeb;0.8 in maven2
[ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:resolve] found xalan#xalan;2.7.1 in maven2
[ivy:resolve] found xalan#serializer;2.7.1 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.3.04 in fs
[ivy:resolve] found xerces#xercesImpl;2.10.0 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.4.01 in maven2
[ivy:resolve] found junit#junit;4.11 in fs
[ivy:resolve] found org.hamcrest#hamcrest-core;1.3 in fs
[ivy:resolve] found org.jboss.netty#netty;3.2.2.Final in maven2
[ivy:resolve] found org.apache.hive#hive-exec;0.8.0 in maven2
[ivy:resolve] found junit#junit;3.8.1 in fs
[ivy:resolve] found com.google.code.p.arat#rat-lib;0.5.1 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2 in fs
[ivy:resolve] found commons-lang#commons-lang;2.1 in fs
[ivy:resolve] found jdiff#jdiff;1.0.9 in fs
[ivy:resolve] found checkstyle#checkstyle;4.2 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.7.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.0 in fs
[ivy:resolve] found commons-logging#commons-logging;1.0.3 in fs
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in default
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in default
[ivy:resolve] found com.sun.jersey#jersey-bundle;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in default
[ivy:resolve] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.1 in fs
[ivy:resolve] found javax.servlet#servlet-api;2.5 in fs
[ivy:resolve] found javax.ws.rs#jsr311-api;1.1.1 in maven2
[ivy:resolve] found com.google.protobuf#protobuf-java;2.4.0a in default
[ivy:resolve] found javax.inject#javax.inject;1 in maven2
[ivy:resolve] found javax.xml.bind#jaxb-api;2.2.2 in maven2
[ivy:resolve] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in default
[ivy:resolve] found com.google.inject#guice;3.0 in maven2
[ivy:resolve] found com.google.inject.extensions#guice-servlet;3.0 in maven2
[ivy:resolve] found aopalliance#aopalliance;1.0 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-annotations;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-auth;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-hdfs;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-core;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-tests;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-app;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-api;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-web-proxy;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-nodemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-hs;2.0.0-alpha in maven2
[ivy:resolve] :: resolution report :: resolve 13603ms :: artifacts dl 5473ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] junit#junit;3.8.1 by [junit#junit;4.11] in [default, test, runtime, javadoc, buildJar]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.1] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.7.3 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [default, test, runtime, javadoc, buildJar]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| master | 0 | 0 | 0 | 0 || 0 | 0 |
| default | 90 | 0 | 0 | 16 || 75 | 0 |
| runtime | 90 | 0 | 0 | 16 || 75 | 0 |
| compile | 81 | 0 | 0 | 14 || 68 | 0 |
| test | 90 | 0 | 0 | 16 || 75 | 0 |
| javadoc | 90 | 0 | 0 | 16 || 75 | 0 |
| releaseaudit | 3 | 0 | 0 | 0 || 3 | 0 |
| jdiff | 3 | 0 | 0 | 0 || 3 | 0 |
| checkstyle | 6 | 0 | 0 | 0 || 6 | 0 |
| buildJar | 90 | 0 | 0 | 16 || 75 | 0 |
| hadoop20 | 47 | 0 | 0 | 9 || 38 | 0 |
| hadoop23 | 39 | 0 | 0 | 0 || 41 | 0 |
---------------------------------------------------------------------
[ivy:resolve]
[ivy:resolve] :: problems summary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve] [FAILED ] org.mortbay.jetty#jetty;6.1.26!jetty.zip: (0ms)
[ivy:resolve] ==== local: tried
[ivy:resolve] /Users/davidlaxer/.ivy2/local/org.mortbay.jetty/jetty/6.1.26/zips/jetty.zip
[ivy:resolve] ==== maven2: tried
[ivy:resolve] http://repo2.maven.org/maven2/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip
[ivy:resolve] ==== jboss-maven2: tried
[ivy:resolve] http://repository.jboss.com/nexus/content/groups/public/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip
[ivy:resolve] ==== apache-snapshots: tried
[ivy:resolve] http://repository.apache.org/content/groups/snapshots-group/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: FAILED DOWNLOADS ::
[ivy:resolve] :: ^ see resolution messages for details ^ ::
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: org.mortbay.jetty#jetty;6.1.26!jetty.zip
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS

BUILD FAILED
/Users/davidlaxer/pig-0.11.1-src/build.xml:941: The following error occurred while executing this line:
/Users/davidlaxer/pig-0.11.1-src/build.xml:1723: impossible to resolve dependencies:
resolve failed - see output for details

Total time: 23 seconds

find ~ -name '6.1.26' -ls
42361118 1056 -rw-r--r-- 1 davidlaxer staff 540234 Dec 22 2012 /Users/davidlaxer/.bundler/ruby/1.8/sunspot-78717a338942/sunspot_solr/solr/lib/jetty-6.1.26-patched-JETTY-1340.jar
42361119 352 -rw-r--r-- 1 davidlaxer staff 177393 Dec 22 2012 /Users/davidlaxer/.bundler/ruby/1.8/sunspot-78717a338942/sunspot_solr/solr/lib/jetty-util-6.1.26-patched-JETTY-1340.jar
80795382 8 -rw-r--r-- 1 davidlaxer staff 2189 May 22 18:03 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivy-6.1.26.xml
82151461 8 -rw-r--r-- 1 davidlaxer staff 425 May 22 18:03 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivy-6.1.26.xml.original
80795336 8 -rw-r--r-- 1 davidlaxer staff 838 Aug 13 20:52 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivydata-6.1.26.properties
80796510 1056 -rw-r--r-- 1 davidlaxer staff 539912 Nov 10 2010 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/jars/jetty-6.1.26.jar
80795393 16 -rw-r--r-- 1 davidlaxer staff 7327 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivy-6.1.26.xml
82151464 8 -rw-r--r-- 1 davidlaxer staff 3876 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivy-6.1.26.xml.original
80795391 8 -rw-r--r-- 1 davidlaxer staff 900 Aug 13 20:52 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivydata-6.1.26.properties
80796764 352 -rw-r--r-- 1 davidlaxer staff 177131 Nov 10 2010 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar
80795380 16 -rw-r--r-- 1 davidlaxer staff 5000 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivy-6.1.26.xml
82151467 24 -rw-r--r-- 1 davidlaxer staff 9205 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivy-6.1.26.xml.original
80795345 8 -rw-r--r-- 1 davidlaxer staff 620 Aug 9 18:00 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivydata-6.1.26.properties
75248719 0 drwxr-xr-x 9 davidlaxer staff 306 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26
75248840 1056 -rw-r--r-- 1 davidlaxer staff 539912 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar
75248805 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar.lastUpdated
75248848 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar.sha1
75248723 8 -rw-r--r-- 1 davidlaxer staff 425 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom
75248720 8 -rw-r--r-- 1 davidlaxer staff 376 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom.lastUpdated
75248725 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom.sha1
75248696 0 drwxr-xr-x 9 davidlaxer staff 306 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26
75248830 352 -rw-r--r-- 1 davidlaxer staff 177131 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar
75248804 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar.lastUpdated
75248835 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar.sha1
75248705 8 -rw-r--r-- 1 davidlaxer staff 3876 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom
75248698 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom.lastUpdated
75248707 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom.sha1
75248709 0 drwxr-xr-x 6 davidlaxer staff 204 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26
75248715 24 -rw-r--r-- 1 davidlaxer staff 9205 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom
75248711 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom.lastUpdated
75248717 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom.sha1
42356239 1056 -rw-r--r-- 1 davidlaxer staff 540234 Dec 22 2012 /Users/davidlaxer/chorus/vendor/solr/lib/jetty-6.1.26-patched-JETTY-1340.jar
42356240 352 -rw-r--r-- 1 davidlaxer staff 177393 Dec 22 2012 /Users/davidlaxer/chorus/vendor/solr/lib/jetty-util-6.1.26-patched-JETTY-1340.jar
75177741 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/common/lib/jetty-6.1.26.jar
75177736 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/common/lib/jetty-util-6.1.26.jar
75184493 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar
75184491 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar
75184734 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/tools/lib/jetty-6.1.26.jar
75184730 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/tools/lib/jetty-util-6.1.26.jar
75184619 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-6.1.26.jar
75184615 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar
82312261 3400 -rw-r--r-- 1 davidlaxer staff 1740076 Aug 13 21:01 /Users/davidlaxer/Downloads/jetty-hadoop-fix-6.1.26.cloudera.zip
82312276 0 drwxr-xr-x 16 davidlaxer staff 544 Aug 13 21:04 /Users/davidlaxer/jetty-hadoop-fix-6.1.26.cloudera

[rjurney]

Try downloading Pig 12 or 13 and report back.

[dbl001]

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:

Try downloading Pig 12 or 13 and report back.

—
Reply to this email directly or view it on GitHub.

[dbl001]

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:

Try downloading Pig 12 or 13 and report back.

�
Reply to this email directly or view it on GitHub.

[dbl001]

David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf

On Oct 9, 2014, at 1:37 AM, David Laxer davidl@softintel.com wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:

Try downloading Pig 12 or 13 and report back.

�
Reply to this email directly or view it on GitHub.

[dbl001]

The requirements for the virtual environment finally completed:

(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install snappy
Password:
---> Computing dependencies for snappy
---> Cleaning snappy
---> Scanning binaries for linking errors
---> No broken files found.
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install python-snappy
Error: Port python-snappy not found
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pip install python-snappy
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pwd
/users/davidlaxer/hadoop-2.3.0-src
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ dirs
/users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pushd ~/Agile_Data_Code/
~/Agile_Data_Code /users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ history | grep pip
146 pip install -r python/requirements.txt
175 pip install --upgrade --no-deps git+git://github.com/Theano/Theano.git
441 pip freeze
442 sudo pip install virtualenv
448 sudo pip install virtualenv
451 pip install graphlab-create==0.9.1
502 pip install virtualenv
508 pip install -r requirements.txt
509 pip install snappy
510 pip install python-snappy
512 pip install python-snappy
513 pip install -r requirements.txt
514 pip install -r requirements.txt
529 pip install python-snappy
551 pip install python-snappy
555 history | grep pip
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo !513
sudo pip install -r requirements.txt
Requirement already satisfied (use --upgrade to upgrade): BareNecessities==0.2.8 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 1))
Requirement already satisfied (use --upgrade to upgrade): ESClient==0.5.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 2))
Requirement already satisfied (use --upgrade to upgrade): Flask==0.9 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 3))
Requirement already satisfied (use --upgrade to upgrade): Jinja2==2.6 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 4))
Requirement already satisfied (use --upgrade to upgrade): LEPL==5.1.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 5))
Requirement already satisfied (use --upgrade to upgrade): Mail==2.1.0 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 6))
Requirement already satisfied (use --upgrade to upgrade): Werkzeug==0.8.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 7))
Requirement already satisfied (use --upgrade to upgrade): distribute==0.6.31 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 8))
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 9))
Requirement already satisfied (use --upgrade to upgrade): avro==1.7.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 10))
Obtaining pyelasticsearch from git+https://github.com/rhec/pyelasticsearch.git#egg=pyelasticsearch (from -r requirements.txt (line 11))
Updating ./src/pyelasticsearch clone
Running setup.py (path:/Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch/setup.py) egg_info for package pyelasticsearch

Installing extra requirements: 'egg'
Requirement already satisfied (use --upgrade to upgrade): pymongo==2.4.1 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 12))
Downloading/unpacking requests==1.0.4 (from -r requirements.txt (line 13))
Downloading requests-1.0.4.tar.gz (336kB): 336kB downloaded
Running setup.py (path:/private/tmp/pip_build_root/requests/setup.py) egg_info for package requests

Requirement already satisfied (use --upgrade to upgrade): simplejson==2.6.2 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): wsgiref==0.1.2 in /Users/davidlaxer/anaconda/lib/python2.7 (from -r requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): numpy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): honcho in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 17))
Requirement already satisfied (use --upgrade to upgrade): scipy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): dotcloud in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): python-dateutil in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): nltk in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): six in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from pyelasticsearch->-r requirements.txt (line 11))
Requirement already satisfied (use --upgrade to upgrade): argparse in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): colorama in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Installing collected packages: pyelasticsearch, requests
Running setup.py develop for pyelasticsearch

Creating /Users/davidlaxer/anaconda/lib/python2.7/site-packages/pyelasticsearch.egg-link (link to .)
pyelasticsearch 0.6.1 is already the active version in easy-install.pth

Installed /Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch

Found existing installation: requests 2.3.0
Uninstalling requests:
Successfully uninstalled requests
Running setup.py install for requests

Successfully installed pyelasticsearch requests
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo pip install avro
Requirement already satisfied (use --upgrade to upgrade): avro in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$

On Oct 9, 2014, at 7:29 AM, David Laxer davidl@softintel.com wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf

On Oct 9, 2014, at 1:37 AM, David Laxer davidl@softintel.com wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:

Try downloading Pig 12 or 13 and report back.

�
Reply to this email directly or view it on GitHub.

[dbl001]

Here’s what happened with Pig 0.13

(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ./bin/pig -x

Apache Pig version 0.13.0 (r1606446)
compiled Jun 29 2014, 02:27:58

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ./bin/pig
14/10/09 11:36:34 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/09 11:36:34 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
14/10/09 11:36:34 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2014-10-09 11:36:34,366 [main] INFO org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58
2014-10-09 11:36:34,366 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/davidlaxer/pig-0.13.0/pig_1412872594365.log
2014-10-09 11:36:34,421 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
Details at logfile: /Users/davidlaxer/pig-0.13.0/pig_1412872594365.log
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ !v
vi RELEASE_NOTES.txt
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ant
Buildfile: /Users/davidlaxer/pig-0.13.0/build.xml

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.13.0/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Apache Ivy ${target.ivy.version}-local-20140820125617 - 20140820125617 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.13.0/ivy/ivysettings.xml

ivy-resolve:
[ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.13.1-SNAPSHOT
[ivy:resolve] confs: [compile]
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in fs
[ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.4 in default
[ivy:resolve] found commons-cli#commons-cli;1.2 in default
[ivy:resolve] found xmlenc#xmlenc;0.52 in fs
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in fs
[ivy:resolve] found junit#junit;3.8.1 in default
[ivy:resolve] found commons-codec#commons-codec;1.4 in default
[ivy:resolve] found org.apache.commons#commons-math;2.1 in fs
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in fs
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in default
[ivy:resolve] found commons-lang#commons-lang;2.4 in default
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in default
[ivy:resolve] found commons-digester#commons-digester;1.8 in default
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in default
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in fs
[ivy:resolve] found commons-net#commons-net;1.4.1 in fs
[ivy:resolve] found oro#oro;2.0.8 in default
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in default
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in default
[ivy:resolve] found tomcat#jasper-runtime;5.5.12 in fs
[ivy:resolve] found tomcat#jasper-compiler;5.5.12 in fs
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in fs
[ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in fs
[ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in fs
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in fs
[ivy:resolve] found ant#ant;1.6.5 in fs
[ivy:resolve] found commons-el#commons-el;1.0 in fs
[ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in fs
[ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in fs
[ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in fs
[ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.4 in maven2
[ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in fs
[ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in fs
[ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in fs
[ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in fs
[ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in fs
[ivy:resolve] found org.apache.hbase#hbase;0.94.1 in maven2
[ivy:resolve] found commons-io#commons-io;2.3 in default
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:resolve] found log4j#log4j;1.2.16 in fs
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:resolve] found org.apache.avro#avro;1.7.5 in default
[ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in fs
[ivy:resolve] found org.xerial.snappy#snappy-java;1.0.5 in fs
[ivy:resolve] found org.apache.commons#commons-compress;1.4.1 in fs
[ivy:resolve] found org.tukaani#xz;1.0 in fs
[ivy:resolve] found org.slf4j#slf4j-api;1.6.4 in fs
[ivy:resolve] found org.apache.avro#avro-mapred;1.7.5 in maven2
[ivy:resolve] found org.apache.avro#avro-ipc;1.7.5 in maven2
[ivy:resolve] found io.netty#netty;3.4.0.Final in fs
[ivy:resolve] found org.apache.velocity#velocity;1.7 in default
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in fs
[ivy:resolve] found org.apache.avro#trevni-core;1.7.5 in maven2
[ivy:resolve] found org.apache.avro#trevni-avro;1.7.5 in maven2
[ivy:resolve] found org.xerial.snappy#snappy-java;1.1.0.1 in maven2
[ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in fs
[ivy:resolve] found jline#jline;1.0 in default
[ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in fs
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in fs
[ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:resolve] found joda-time#joda-time;2.1 in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:resolve] found rhino#js;1.7R2 in maven2
[ivy:resolve] found org.antlr#antlr;3.4 in default
[ivy:resolve] found org.antlr#antlr-runtime;3.4 in default
[ivy:resolve] found org.antlr#stringtemplate;3.2.1 in default
[ivy:resolve] found antlr#antlr;2.7.7 in default
[ivy:resolve] found org.antlr#ST4;4.0.4 in default
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.4.5 in fs
[ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:resolve] found asm#asm;3.3.1 in fs
[ivy:resolve] found org.apache.accumulo#accumulo-core;1.5.0 in maven2
[ivy:resolve] found com.beust#jcommander;1.30 in maven2
[ivy:resolve] found org.apache.accumulo#accumulo-fate;1.5.0 in maven2
[ivy:resolve] found org.apache.accumulo#accumulo-start;1.5.0 in maven2
[ivy:resolve] found org.apache.commons#commons-vfs2;2.0 in maven2
[ivy:resolve] found org.apache.maven.scm#maven-scm-api;1.4 in fs
[ivy:resolve] found org.codehaus.plexus#plexus-utils;1.5.6 in fs
[ivy:resolve] found org.apache.maven.scm#maven-scm-provider-svnexe;1.4 in fs
[ivy:resolve] found org.apache.maven.scm#maven-scm-provider-svn-commons;1.4 in fs
[ivy:resolve] found regexp#regexp;1.3 in fs
[ivy:resolve] found org.apache.accumulo#accumulo-trace;1.5.0 in maven2
[ivy:resolve] found org.apache.thrift#libthrift;0.9.0 in default
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1.3 in default
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1.3 in fs
[ivy:resolve] found org.apache.accumulo#accumulo-minicluster;1.5.0 in maven2
[ivy:resolve] found org.apache.accumulo#accumulo-server;1.5.0 in maven2
[ivy:resolve] found com.google.code.gson#gson;2.2.2 in maven2
[ivy:resolve] found org.vafer#jdeb;0.8 in maven2
[ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:resolve] found com.twitter#parquet-pig-bundle;1.2.3 in maven2
[ivy:resolve] :: resolution report :: resolve 10876ms :: artifacts dl 111ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [compile]
[ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [compile]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [compile]
[ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [compile]
[ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [compile]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [compile]
[ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.4] in [compile]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [compile]
[ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [compile]
[ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [compile]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [compile]
[ivy:resolve] org.apache.httpcomponents#httpclient;4.1 by [org.apache.httpcomponents#httpclient;4.1.3] in [compile]
[ivy:resolve] org.apache.httpcomponents#httpcore;4.1 by [org.apache.httpcomponents#httpcore;4.1.3] in [compile]
[ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [compile]
[ivy:resolve] org.xerial.snappy#snappy-java;1.0.5 by [org.xerial.snappy#snappy-java;1.1.0.1] in [compile]
[ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [compile]
[ivy:resolve] org.apache.httpcomponents#httpcore;4.1.4 by [org.apache.httpcomponents#httpcore;4.1.3] in [compile]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| compile | 109 | 55 | 0 | 17 || 95 | 0 |
---------------------------------------------------------------------

ivy-compile:
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [compile]
[ivy:retrieve] 95 artifacts copied, 0 already retrieved (81667kB/3564ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /Users/davidlaxer/pig-0.13.0/ivy/ivysettings.xml

init:
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/impl/logicalLayer/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/tools/pigscript/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/tools/parameters
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/build/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/build/test/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/data/parser
[move] Moving 1 file to /Users/davidlaxer/pig-0.13.0/build/ivy/lib/Pig

cc-compile:
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/pigscript/parser/PigScriptParser.jj . . .
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated successfully.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/parameters/PigFileParser.jj . . .
[javacc] Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated with 0 errors and 1 warnings.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/parameters/ParamLoader.jj . . .
[javacc] File "TokenMgrError.java" is being rebuilt.
[javacc] File "ParseException.java" is being rebuilt.
[javacc] File "Token.java" is being rebuilt.
[javacc] File "JavaCharStream.java" is being rebuilt.
[javacc] Parser generated successfully.
[jjtree] Java Compiler Compiler Version 4.2 (Tree Builder)
[jjtree](type "jjtree" with no arguments for help)
[jjtree] Reading from file /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/DOTParser.jjt . . .
[jjtree] File "Node.java" is being rebuilt.
[jjtree] File "SimpleNode.java" is being rebuilt.
[jjtree] File "DOTParserTreeConstants.java" is being rebuilt.
[jjtree] File "JJTDOTParserState.java" is being rebuilt.
[jjtree] Annotated grammar generated successfully in /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj . . .
[javacc] File "TokenMgrError.java" is being rebuilt.
[javacc] File "ParseException.java" is being rebuilt.
[javacc] File "Token.java" is being rebuilt.
[javacc] File "SimpleCharStream.java" is being rebuilt.
[javacc] Parser generated successfully.

prepare:
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/parser

genLexer:

genParser:

genTreeParser:

gen:

compile:
[echo] *** Building Main Sources ***
[echo] *** To compile with all warnings enabled, supply -Dall.warnings=1 on command line ***
[echo] *** Else, you will only be warned about deprecations ***
[javac] Compiling 887 source files to /Users/davidlaxer/pig-0.13.0/build/classes
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0/build/classes/org/apache/pig/tools/grunt
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0/build/classes/org/apache/pig/tools/grunt
[copy] Copying 2 files to /Users/davidlaxer/pig-0.13.0/build/classes/python
[copy] Copying 2 files to /Users/davidlaxer/pig-0.13.0/build/classes/META-INF

ivy-buildJar:
[ivy:retrieve] :: resolving dependencies :: org.apache.pig#pig;0.13.1-SNAPSHOT
[ivy:retrieve] confs: [buildJar]
[ivy:retrieve] found com.sun.jersey#jersey-core;1.8 in fs
[ivy:retrieve] found org.apache.hadoop#hadoop-core;1.0.4 in default
[ivy:retrieve] found commons-cli#commons-cli;1.2 in default
[ivy:retrieve] found xmlenc#xmlenc;0.52 in fs
[ivy:retrieve] found commons-httpclient#commons-httpclient;3.0.1 in fs
[ivy:retrieve] found commons-codec#commons-codec;1.4 in default
[ivy:retrieve] found org.apache.commons#commons-math;2.1 in fs
[ivy:retrieve] found commons-configuration#commons-configuration;1.6 in fs
[ivy:retrieve] found commons-collections#commons-collections;3.2.1 in default
[ivy:retrieve] found commons-lang#commons-lang;2.4 in default
[ivy:retrieve] found commons-logging#commons-logging;1.1.1 in default
[ivy:retrieve] found commons-digester#commons-digester;1.8 in default
[ivy:retrieve] found commons-beanutils#commons-beanutils;1.7.0 in default
[ivy:retrieve] found commons-beanutils#commons-beanutils-core;1.8.0 in fs
[ivy:retrieve] found commons-net#commons-net;1.4.1 in fs
[ivy:retrieve] found oro#oro;2.0.8 in default
[ivy:retrieve] found org.mortbay.jetty#jetty;6.1.26 in default
[ivy:retrieve] found org.mortbay.jetty#jetty-util;6.1.26 in default
[ivy:retrieve] found tomcat#jasper-runtime;5.5.12 in fs
[ivy:retrieve] found tomcat#jasper-compiler;5.5.12 in fs
[ivy:retrieve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in fs
[ivy:retrieve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in fs
[ivy:retrieve] found org.mortbay.jetty#jsp-2.1;6.1.14 in fs
[ivy:retrieve] found org.eclipse.jdt#core;3.1.1 in fs
[ivy:retrieve] found ant#ant;1.6.5 in fs
[ivy:retrieve] found commons-el#commons-el;1.0 in fs
[ivy:retrieve] found net.java.dev.jets3t#jets3t;0.7.1 in fs
[ivy:retrieve] found net.sf.kosmosfs#kfs;0.3 in fs
[ivy:retrieve] found hsqldb#hsqldb;1.8.0.10 in fs
[ivy:retrieve] found org.apache.hadoop#hadoop-test;1.0.4 in maven2
[ivy:retrieve] found org.apache.ftpserver#ftplet-api;1.0.0 in fs
[ivy:retrieve] found org.apache.mina#mina-core;2.0.0-M5 in fs
[ivy:retrieve] found org.slf4j#slf4j-api;1.5.2 in fs
[ivy:retrieve] found org.apache.ftpserver#ftpserver-core;1.0.0 in fs
[ivy:retrieve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in fs
[ivy:retrieve] found org.apache.hbase#hbase;0.94.1 in maven2
[ivy:retrieve] found commons-io#commons-io;2.3 in default
[ivy:retrieve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:retrieve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:retrieve] found log4j#log4j;1.2.16 in fs
[ivy:retrieve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:retrieve] found org.apache.avro#avro;1.7.5 in default
[ivy:retrieve] found com.thoughtworks.paranamer#paranamer;2.3 in fs
[ivy:retrieve] found org.xerial.snappy#snappy-java;1.0.5 in fs
[ivy:retrieve] found org.apache.commons#commons-compress;1.4.1 in fs
[ivy:retrieve] found org.tukaani#xz;1.0 in fs
[ivy:retrieve] found org.slf4j#slf4j-api;1.6.4 in fs
[ivy:retrieve] found org.apache.avro#avro-mapred;1.7.5 in maven2
[ivy:retrieve] found org.apache.avro#avro-ipc;1.7.5 in maven2
[ivy:retrieve] found io.netty#netty;3.4.0.Final in fs
[ivy:retrieve] found org.apache.velocity#velocity;1.7 in default
[ivy:retrieve] found org.mortbay.jetty#servlet-api;2.5-20081211 in fs
[ivy:retrieve] found org.apache.avro#trevni-core;1.7.5 in maven2
[ivy:retrieve] found org.apache.avro#trevni-avro;1.7.5 in maven2
[ivy:retrieve] found org.xerial.snappy#snappy-java;1.1.0.1 in maven2
[ivy:retrieve] found com.googlecode.json-simple#json-simple;1.1 in fs
[ivy:retrieve] found jline#jline;1.0 in default
[ivy:retrieve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:retrieve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:retrieve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in fs
[ivy:retrieve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in fs
[ivy:retrieve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:retrieve] found joda-time#joda-time;2.1 in maven2
[ivy:retrieve] found com.google.guava#guava;11.0 in maven2
[ivy:retrieve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:retrieve] found rhino#js;1.7R2 in maven2
[ivy:retrieve] found org.antlr#antlr;3.4 in default
[ivy:retrieve] found org.antlr#antlr-runtime;3.4 in default
[ivy:retrieve] found org.antlr#stringtemplate;3.2.1 in default
[ivy:retrieve] found antlr#antlr;2.7.7 in default
[ivy:retrieve] found org.antlr#ST4;4.0.4 in default
[ivy:retrieve] found org.apache.zookeeper#zookeeper;3.4.5 in fs
[ivy:retrieve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:retrieve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:retrieve] found asm#asm;3.3.1 in fs
[ivy:retrieve] found org.apache.accumulo#accumulo-core;1.5.0 in maven2
[ivy:retrieve] found com.beust#jcommander;1.30 in maven2
[ivy:retrieve] found org.apache.accumulo#accumulo-fate;1.5.0 in maven2
[ivy:retrieve] found org.apache.accumulo#accumulo-start;1.5.0 in maven2
[ivy:retrieve] found org.apache.commons#commons-vfs2;2.0 in maven2
[ivy:retrieve] found org.apache.maven.scm#maven-scm-api;1.4 in fs
[ivy:retrieve] found org.codehaus.plexus#plexus-utils;1.5.6 in fs
[ivy:retrieve] found org.apache.maven.scm#maven-scm-provider-svnexe;1.4 in fs
[ivy:retrieve] found org.apache.maven.scm#maven-scm-provider-svn-commons;1.4 in fs
[ivy:retrieve] found regexp#regexp;1.3 in fs
[ivy:retrieve] found org.apache.accumulo#accumulo-trace;1.5.0 in maven2
[ivy:retrieve] found org.apache.thrift#libthrift;0.9.0 in default
[ivy:retrieve] found org.apache.httpcomponents#httpclient;4.1.3 in default
[ivy:retrieve] found org.apache.httpcomponents#httpcore;4.1.3 in fs
[ivy:retrieve] found org.apache.accumulo#accumulo-minicluster;1.5.0 in maven2
[ivy:retrieve] found org.apache.accumulo#accumulo-server;1.5.0 in maven2
[ivy:retrieve] found com.google.code.gson#gson;2.2.2 in maven2
[ivy:retrieve] found org.vafer#jdeb;0.8 in maven2
[ivy:retrieve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:retrieve] found com.twitter#parquet-pig-bundle;1.2.3 in maven2
[ivy:retrieve] found org.apache.avro#avro-tools;1.7.5 in maven2
[ivy:retrieve] found net.sf.jopt-simple#jopt-simple;4.1 in fs
[ivy:retrieve] found xalan#xalan;2.7.1 in maven2
[ivy:retrieve] found xalan#serializer;2.7.1 in maven2
[ivy:retrieve] found xml-apis#xml-apis;1.3.04 in fs
[ivy:retrieve] found xerces#xercesImpl;2.10.0 in maven2
[ivy:retrieve] found xml-apis#xml-apis;1.4.01 in maven2
[ivy:retrieve] found junit#junit;4.11 in fs
[ivy:retrieve] found org.hamcrest#hamcrest-core;1.3 in fs
[ivy:retrieve] found org.jboss.netty#netty;3.2.2.Final in fs
[ivy:retrieve] found com.github.stephenc.high-scale-lib#high-scale-lib;1.1.1 in fs
[ivy:retrieve] found com.google.protobuf#protobuf-java;2.4.0a in fs
[ivy:retrieve] found com.yammer.metrics#metrics-core;2.1.2 in fs
[ivy:retrieve] found org.apache.hive#hive-exec;0.8.0 in fs
[ivy:retrieve] :: resolution report :: resolve 13898ms :: artifacts dl 232ms
[ivy:retrieve] :: evicted modules:
[ivy:retrieve] junit#junit;3.8.1 by [junit#junit;4.11] in [buildJar]
[ivy:retrieve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [buildJar]
[ivy:retrieve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [buildJar]
[ivy:retrieve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [buildJar]
[ivy:retrieve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [buildJar]
[ivy:retrieve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [buildJar]
[ivy:retrieve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [buildJar]
[ivy:retrieve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.4] in [buildJar]
[ivy:retrieve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [buildJar]
[ivy:retrieve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [buildJar]
[ivy:retrieve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [buildJar]
[ivy:retrieve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [buildJar]
[ivy:retrieve] org.apache.httpcomponents#httpclient;4.1 by [org.apache.httpcomponents#httpclient;4.1.3] in [buildJar]
[ivy:retrieve] org.apache.httpcomponents#httpcore;4.1 by [org.apache.httpcomponents#httpcore;4.1.3] in [buildJar]
[ivy:retrieve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [buildJar]
[ivy:retrieve] org.xerial.snappy#snappy-java;1.0.5 by [org.xerial.snappy#snappy-java;1.1.0.1] in [buildJar]
[ivy:retrieve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [buildJar]
[ivy:retrieve] org.apache.httpcomponents#httpcore;4.1.4 by [org.apache.httpcomponents#httpcore;4.1.3] in [buildJar]
[ivy:retrieve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [buildJar]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| buildJar | 123 | 63 | 2 | 19 || 107 | 0 |
---------------------------------------------------------------------
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [buildJar]
[ivy:retrieve] 14 artifacts copied, 93 already retrieved (10371kB/493ms)

jar:
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT.jar
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT-withdependencies.jar
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] org/apache/commons/beanutils/BasicDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/BasicDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/BeanAccessLanguageException.class already added, skipping
[jar] org/apache/commons/beanutils/BeanUtils.class already added, skipping
[jar] org/apache/commons/beanutils/BeanUtilsBean$1.class already added, skipping
[jar] org/apache/commons/beanutils/BeanUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/ConstructorUtils.class already added, skipping
[jar] org/apache/commons/beanutils/ContextClassLoaderLocal.class already added, skipping
[jar] org/apache/commons/beanutils/ConversionException.class already added, skipping
[jar] org/apache/commons/beanutils/ConvertUtils.class already added, skipping
[jar] org/apache/commons/beanutils/ConvertUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/Converter.class already added, skipping
[jar] org/apache/commons/beanutils/ConvertingWrapDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/DynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/DynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/DynaProperty.class already added, skipping
[jar] org/apache/commons/beanutils/JDBCDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/LazyDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/LazyDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/LazyDynaMap.class already added, skipping
[jar] org/apache/commons/beanutils/MappedPropertyDescriptor.class already added, skipping
[jar] org/apache/commons/beanutils/MethodUtils$MethodDescriptor.class already added, skipping
[jar] org/apache/commons/beanutils/MethodUtils.class already added, skipping
[jar] org/apache/commons/beanutils/MutableDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/NestedNullException.class already added, skipping
[jar] org/apache/commons/beanutils/PropertyUtils.class already added, skipping
[jar] org/apache/commons/beanutils/PropertyUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/ResultSetDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/ResultSetIterator.class already added, skipping
[jar] org/apache/commons/beanutils/RowSetDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/WrapDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/WrapDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/converters/AbstractArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BigDecimalConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BigIntegerConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BooleanArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BooleanConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ByteArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ByteConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/CharacterArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/CharacterConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ClassConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/DoubleArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/DoubleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/FileConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/FloatArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/FloatConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/IntegerArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/IntegerConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/LongArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/LongConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ShortArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ShortConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/SqlDateConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/SqlTimeConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/SqlTimestampConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/StringArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/StringConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/URLConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/BaseLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtils$Descriptor.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtils.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$1.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$Descriptor.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleConvertUtils.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleConvertUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/BigDecimalLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/BigIntegerLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/ByteLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/DateLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/DecimalLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/DoubleLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/FloatLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/IntegerLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/LongLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/ShortLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/SqlDateLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/SqlTimeLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/SqlTimestampLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/StringLocaleConverter.class already added, skipping
[jar] org/apache/commons/collections/ArrayStack.class already added, skipping
[jar] org/apache/commons/collections/Buffer.class already added, skipping
[jar] org/apache/commons/collections/BufferUnderflowException.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$1.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$EntrySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$KeySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$Values.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap.class already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] org/apache/commons/collections/ArrayStack.class already added, skipping
[jar] org/apache/commons/collections/Buffer.class already added, skipping
[jar] org/apache/commons/collections/BufferUnderflowException.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$1.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$EntrySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$KeySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$Values.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap.class already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/ASL2.0 already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping

copyHadoop1:
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0

copyHadoop2:

jar-withouthadoop:
[echo] svnString Unversioned directory
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT-withouthadoop.jar
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/ASL2.0 already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping

copyHadoop1:
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0

copyHadoop2:

jar-all:

BUILD SUCCESSFUL
Total time: 3 minutes 6 seconds
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ export PIG_CLASSPATH=/users/davidlaxer/hadoop-2.3.0-src/src/conf
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ bin/pig
14/10/09 11:43:26 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/09 11:43:26 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
14/10/09 11:43:26 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2014-10-09 11:43:27,477 [main] INFO org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58
2014-10-09 11:43:27,478 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/davidlaxer/pig-0.13.0/pig_1412873007475.log
2014-10-09 11:43:27,737 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
Details at logfile: /Users/davidlaxer/pig-0.13.0/pig_1412873007475.log
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$

On Oct 9, 2014, at 11:07 AM, David Laxer davidl@softintel.com wrote:

The requirements for the virtual environment finally completed:

(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install snappy
Password:
---> Computing dependencies for snappy
---> Cleaning snappy
---> Scanning binaries for linking errors
---> No broken files found.
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install python-snappy
Error: Port python-snappy not found
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pip install python-snappy
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pwd
/users/davidlaxer/hadoop-2.3.0-src
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ dirs
/users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pushd ~/Agile_Data_Code/
~/Agile_Data_Code /users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ history | grep pip
146 pip install -r python/requirements.txt
175 pip install --upgrade --no-deps git+git://github.com/Theano/Theano.git
441 pip freeze
442 sudo pip install virtualenv
448 sudo pip install virtualenv
451 pip install graphlab-create==0.9.1
502 pip install virtualenv
508 pip install -r requirements.txt
509 pip install snappy
510 pip install python-snappy
512 pip install python-snappy
513 pip install -r requirements.txt
514 pip install -r requirements.txt
529 pip install python-snappy
551 pip install python-snappy
555 history | grep pip
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo !513
sudo pip install -r requirements.txt
Requirement already satisfied (use --upgrade to upgrade): BareNecessities==0.2.8 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 1))
Requirement already satisfied (use --upgrade to upgrade): ESClient==0.5.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 2))
Requirement already satisfied (use --upgrade to upgrade): Flask==0.9 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 3))
Requirement already satisfied (use --upgrade to upgrade): Jinja2==2.6 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 4))
Requirement already satisfied (use --upgrade to upgrade): LEPL==5.1.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 5))
Requirement already satisfied (use --upgrade to upgrade): Mail==2.1.0 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 6))
Requirement already satisfied (use --upgrade to upgrade): Werkzeug==0.8.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 7))
Requirement already satisfied (use --upgrade to upgrade): distribute==0.6.31 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 8))
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 9))
Requirement already satisfied (use --upgrade to upgrade): avro==1.7.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 10))
Obtaining pyelasticsearch from git+https://github.com/rhec/pyelasticsearch.git#egg=pyelasticsearch (from -r requirements.txt (line 11))
Updating ./src/pyelasticsearch clone
Running setup.py (path:/Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch/setup.py) egg_info for package pyelasticsearch

Installing extra requirements: 'egg'
Requirement already satisfied (use --upgrade to upgrade): pymongo==2.4.1 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 12))
Downloading/unpacking requests==1.0.4 (from -r requirements.txt (line 13))
Downloading requests-1.0.4.tar.gz (336kB): 336kB downloaded
Running setup.py (path:/private/tmp/pip_build_root/requests/setup.py) egg_info for package requests

Requirement already satisfied (use --upgrade to upgrade): simplejson==2.6.2 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): wsgiref==0.1.2 in /Users/davidlaxer/anaconda/lib/python2.7 (from -r requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): numpy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): honcho in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 17))
Requirement already satisfied (use --upgrade to upgrade): scipy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): dotcloud in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): python-dateutil in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): nltk in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): six in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from pyelasticsearch->-r requirements.txt (line 11))
Requirement already satisfied (use --upgrade to upgrade): argparse in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): colorama in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Installing collected packages: pyelasticsearch, requests
Running setup.py develop for pyelasticsearch

Creating /Users/davidlaxer/anaconda/lib/python2.7/site-packages/pyelasticsearch.egg-link (link to .)
pyelasticsearch 0.6.1 is already the active version in easy-install.pth

Installed /Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch

Found existing installation: requests 2.3.0
Uninstalling requests:
Successfully uninstalled requests
Running setup.py install for requests

Successfully installed pyelasticsearch requests
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo pip install avro
Requirement already satisfied (use --upgrade to upgrade): avro in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$

On Oct 9, 2014, at 7:29 AM, David Laxer davidl@softintel.com wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf

On Oct 9, 2014, at 1:37 AM, David Laxer davidl@softintel.com wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:

Try downloading Pig 12 or 13 and report back.

—
Reply to this email directly or view it on GitHub.