intermittent assertion errors in pyunit_citi_bike_small.py/pyunit_citi_bike_large.py. Client apparently not notified

[exalate-issue-sync]

http://mr-0xb1:8080/job/h2o_master_DEV_pyunit_small/14549/artifact/h2o-py/tests/results/java_1_0.out.txt

starts here
06-14 12:32:44.224 172.16.2.172:56791 15740 # Session INFO: ------------------------------------------------------------
06-14 12:32:44.226 172.16.2.172:56791 15740 # Session INFO:
06-14 12:32:44.304 172.16.2.172:56791 15740 # Session INFO: STARTING TEST: pyunit_citi_bike_small.py
06-14 12:32:44.309 172.16.2.172:56791 15740 # Session INFO:
06-14 12:32:44.314 172.16.2.172:56791 15740 # Session INFO: ------------------------------------------------------------

....

06-14 12:34:04.563 172.16.2.172:56791 15740 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput py51ed09ad-ed04-42cc-ae0e-49f1514c26bf (cbind %FALSE '$04ff01000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff02000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff03000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff04000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff18000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff19000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff1a000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff1f000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff22000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv')) (colnames= %py51ed09ad-ed04-42cc-ae0e-49f1514c26bf (: #0 #8) (slist "Year Local" "Month Local" "Day Local" "Hour Local" "Dew Point (C)" "Humidity Fraction" "Rain (mm)" "Temperature (C)" "WC1")}
06-14 12:34:04.569 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/py51ed09ad-ed04-42cc-ae0e-49f1514c26bf, route: /3/DKV/(?.), parms: {key=py51ed09ad-ed04-42cc-ae0e-49f1514c26bf}
06-14 12:34:04.573 172.16.2.172:56791 15740 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput py0cae986a-6c47-4208-90fa-7686a4b0d3e6 (cbind %FALSE 'pyd4365f80-c003-4de7-b98a-c3cd0470df3f' 'py86ae3907-f0fe-41cc-9717-d73851cbc226' 'py55bc4ed7-3814-4f2e-9cdc-177f4669dcf6' 'pyda6e981a-e1b9-4641-9614-25a61dec48ca' 'pyc9b01cbc-d120-41f5-beef-76d6597f1458' 'pyb72a7fa5-4939-4c48-ac55-1470b7c9db1a' 'py2283839f-2d05-4a84-bca8-7e2ab7cba326' 'py064e4f5e-a975-4f1a-b460-f4d990721915' 'pyfb56a793-5deb-4ec2-a64e-702e5385b338' 'pyb8e21cef-cdc9-4427-b6c9-b05b11d5a310')) (colnames= %py0cae986a-6c47-4208-90fa-7686a4b0d3e6 (: #0 #9) (slist "Year Local" "Month Local" "Day Local" "Hour Local" "Dew Point (C)" "Humidity Fraction" "Temperature (C)" "WC1" "msec" "Days")}
06-14 12:34:04.574 172.16.2.172:56791 15740 # Session ERRR: java.lang.AssertionError
java.lang.AssertionError
at water.fvec.Frame.(Frame.java:102)
at water.fvec.Frame.(Frame.java:72)
at water.fvec.Frame.(Frame.java:70)
at water.fvec.Frame.add(Frame.java:484)
at water.rapids.ASTCbind.apply(ASTOp.java:2308)
at water.rapids.AST.treeWalk(AST.java:49)
at water.rapids.AST.treeWalk(AST.java:48)
at water.rapids.ASTStatement.exec(AST.java:474)
at water.rapids.AST.treeWalk(AST.java:112)
at water.rapids.Exec.exec(Exec.java:68)
at water.api.RapidsHandler.exec(RapidsHandler.java:37)
at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at water.api.Handler.handle(Handler.java:56)
at water.api.RequestServer.handle(RequestServer.java:677)
at water.api.RequestServer.serve(RequestServer.java:614)
at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438)
at java.lang.Thread.run(Thread.java:745)
06-14 12:34:04.575 172.16.2.172:56791 15740 # Session WARN: Caught exception: java.lang.AssertionError; Stacktrace: [water.api.RapidsHandler.exec(RapidsHandler.java:132), sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source), sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43), java.lang.reflect.Method.invoke(Method.java:606), water.api.Handler.handle(Handler.java:56), water.api.RequestServer.handle(RequestServer.java:677), water.api.RequestServer.serve(RequestServer.java:614), water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438), java.lang.Thread.run(Thread.java:745)]
06-14 12:34:04.578 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/DRFModel__a5596556bd859d81c1512f7527e24a95, route: /3/DKV/(?.), parms: {key=DRFModel__a5596556bd859d81c1512f7527e24a95}
06-14 12:34:04.583 172.16.2.172:56791 15740 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput pyabf1e289-7f0f-452e-a275-df5de30b0937 (cbind %FALSE '$04ff52000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff53000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff54000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff55000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff56000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff57000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff58000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff59000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff5a000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff5b000000fffffffffd6d436533f737a9554e05386860cd0d$')) (colnames= %pyabf1e289-7f0f-452e-a275-df5de30b0937 (: #0 #9) (slist "Days" "start station name" "bikes" "Month" "DayOfWeek" "Humidity Fraction" "Rain (mm)" "Temperature (C)" "WC1" "Dew Point (C)")}
06-14 12:34:04.589 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/pyabf1e289-7f0f-452e-a275-df5de30b0937, route: /3/DKV/(?.), parms: {key=pyabf1e289-7f0f-452e-a275-df5de30b0937}
06-14 12:34:04.592 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/pye719600b-37f4-4237-936d-106cbfc024ec, route: /3/DKV/(?.), parms: {key=pye719600b-37f4-4237-936d-106cbfc024ec}
06-14 12:34:04.595 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/pye719600b-37f4-4237-936d-106cbfc024ec, route: /3/DKV/(?.), parms: {key=pye719600b-37f4-4237-936d-106cbfc024ec}
06-14 12:34:04.598 172.16.2.172:56791 15740 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput py7110bc7b-ba69-4d6d-b124-c390ac0370fa (cbind %FALSE '$04ff01000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff02000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff03000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff04000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff05000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff06000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff07000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff08000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff09000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff0a000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff0b000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff0c000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff0d000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff0e000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' '$04ff0f000000ffffffff$nfs://home2/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_small/bigdata/laptop/citibike-nyc/2013-10.csv' 'py1014c88c-3e98-4405-ba47-c335b652bdf5')) (colnames= %py7110bc7b-ba69-4d6d-b124-c390ac0370fa (: #0 #15) (slist "tripduration" "starttime" "stoptime" "start station id" "start station name" "start station latitude" "start station longitude" "end station id" "end station name" "end station latitude" "end station longitude" "bikeid" "usertype" "birth year" "gender" "Days")}
06-14 12:34:04.607 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/py7110bc7b-ba69-4d6d-b124-c390ac0370fa, route: /3/DKV/(?.), parms: {key=py7110bc7b-ba69-4d6d-b124-c390ac0370fa}
06-14 12:34:04.612 172.16.2.172:56791 15740 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput pyf77d2c7b-9ff0-46c4-a6f9-7f0f7b057a8b (cbind %FALSE '$04ff07000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff08000000fffffffffd6d436533f737a9554e05386860cd0d$' '$04ff09000000fffffffffd6d436533f737a9554e05386860cd0d$' 'py8311c266-04e7-48c0-b094-f133b871e4f6' 'pya946a1b3-33ee-4c58-9dfe-8dd18d6c84f2')) (colnames= %pyf77d2c7b-9ff0-46c4-a6f9-7f0f7b057a8b (: #0 #4) (slist "Days" "start station name" "bikes" "Month" "DayOfWeek")}
06-14 12:34:04.612 172.16.2.172:56791 15740 # Session ERRR: java.lang.AssertionError
java.lang.AssertionError
at water.fvec.Frame.(Frame.java:102)
at water.fvec.Frame.(Frame.java:72)
at water.rapids.ASTCbind.apply(ASTOp.java:2301)
at water.rapids.AST.treeWalk(AST.java:49)
at water.rapids.AST.treeWalk(AST.java:48)
at water.rapids.ASTStatement.exec(AST.java:474)
at water.rapids.AST.treeWalk(AST.java:112)
at water.rapids.Exec.exec(Exec.java:68)
at water.api.RapidsHandler.exec(RapidsHandler.java:37)
at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at water.api.Handler.handle(Handler.java:56)
at water.api.RequestServer.handle(RequestServer.java:677)
at water.api.RequestServer.serve(RequestServer.java:614)
at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438)
at java.lang.Thread.run(Thread.java:745)
06-14 12:34:04.613 172.16.2.172:56791 15740 # Session WARN: Caught exception: java.lang.AssertionError; Stacktrace: [water.api.RapidsHandler.exec(RapidsHandler.java:132), sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source), sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43), java.lang.reflect.Method.invoke(Method.java:606), water.api.Handler.handle(Handler.java:56), water.api.RequestServer.handle(RequestServer.java:677), water.api.RequestServer.serve(RequestServer.java:614), water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438), java.lang.Thread.run(Thread.java:745)]
06-14 12:34:04.616 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/py33a32efb-4096-46f8-934d-9fb5df9f54df, route: /3/DKV/(?.), parms: {key=py33a32efb-4096-46f8-934d-9fb5df9f54df}
06-14 12:34:04.619 172.16.2.172:56791 15740 # Session INFO: Method: DELETE, URI: /3/DKV/DeepLearningModel__b767c13f6646ac7d5ee6953890214668, route: /3/DKV/(?.), parms: {key=DeepLearningModel__b767c13f6646ac7d5ee6953890214668}

[exalate-issue-sync]

Neeraja Madabhushi commented: Below is error from pyunit_citibike_large.py

06-22 13:00:05.857 172.17.2.195:56789 5543 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput pycb2b678c-9475-41d3-9cfc-709f0b25bfdb (cbind %FALSE '$04ff01000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff02000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff03000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff04000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff18000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff19000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff1a000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff1f000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv' '$04ff22000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/31081_New_York_City__Hourly_2013.csv')) (colnames= %pycb2b678c-9475-41d3-9cfc-709f0b25bfdb (: #0 #8) (slist "Year Local" "Month Local" "Day Local" "Hour Local" "Dew Point (C)" "Humidity Fraction" "Rain (mm)" "Temperature (C)" "WC1")}
06-22 13:00:05.868 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/pycb2b678c-9475-41d3-9cfc-709f0b25bfdb, route: /3/DKV/(?.), parms: {key=pycb2b678c-9475-41d3-9cfc-709f0b25bfdb}
06-22 13:00:05.873 172.17.2.195:56789 5543 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput py88755515-5fac-418f-9c42-eca7633c0e9b (cbind %FALSE 'py8d4d09af-624a-4df7-be12-fd9e073393d5' 'py497ccea9-fb05-41f6-b73e-b7a7142d526e' 'pyd1910259-0879-4eba-8412-10e2f6fb5c26' 'py85fe3ec9-e97b-4018-8714-535767843cbc' 'py208fac4f-a2cd-4507-ade8-9c8fbd38bed9' 'py9cd07382-ad25-41eb-830d-5dd83c5a6b4f' 'pyd50ca106-ae49-459b-9774-a163e0256fd5' 'py5e8410e8-0997-4ee6-a85a-f7fa60d81b1c' 'pyf09ace05-828f-4dfe-9d50-93dba27998f0' 'py8d9bdb3c-52cb-463a-a665-d2cbe1e28c7f')) (colnames= %py88755515-5fac-418f-9c42-eca7633c0e9b (: #0 #9) (slist "Year Local" "Month Local" "Day Local" "Hour Local" "Dew Point (C)" "Humidity Fraction" "Temperature (C)" "WC1" "msec" "Days")}
06-22 13:00:05.876 172.17.2.195:56789 5543 # Session ERRR: java.lang.AssertionError
java.lang.AssertionError
at water.fvec.Frame.(Frame.java:102)
at water.fvec.Frame.(Frame.java:72)
at water.fvec.Frame.(Frame.java:70)
at water.fvec.Frame.add(Frame.java:485)
at water.rapids.ASTCbind.apply(ASTOp.java:2308)
at water.rapids.AST.treeWalk(AST.java:49)
at water.rapids.AST.treeWalk(AST.java:48)
at water.rapids.ASTStatement.exec(AST.java:474)
at water.rapids.AST.treeWalk(AST.java:112)
at water.rapids.Exec.exec(Exec.java:68)
at water.api.RapidsHandler.exec(RapidsHandler.java:37)
at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at water.api.Handler.handle(Handler.java:56)
at water.api.RequestServer.handle(RequestServer.java:677)
at water.api.RequestServer.serve(RequestServer.java:614)
at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438)
at java.lang.Thread.run(Thread.java:745)
06-22 13:00:05.878 172.17.2.195:56789 5543 # Session WARN: Caught exception: java.lang.AssertionError; Stacktrace: [water.api.RapidsHandler.exec(RapidsHandler.java:132), sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source), sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43), java.lang.reflect.Method.invoke(Method.java:606), water.api.Handler.handle(Handler.java:56), water.api.RequestServer.handle(RequestServer.java:677), water.api.RequestServer.serve(RequestServer.java:614), water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438), java.lang.Thread.run(Thread.java:745)]
06-22 13:00:05.888 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/DRFModel__820470ea2c98cebe32b1b994be1941ca, route: /3/DKV/(?.), parms: {key=DRFModel__820470ea2c98cebe32b1b994be1941ca}
06-22 13:00:06.310 172.17.2.195:56789 5543 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput pybcf91608-f135-4535-afec-bd4d9498d7a3 (cbind %FALSE '$04ff5d000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff5e000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff5f000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff60000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff61000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff62000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff63000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff64000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff65000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff66000000ffffffff346a723c2d2200996e48ab5620beeb$=')) (colnames= %pybcf91608-f135-4535-afec-bd4d9498d7a3 (: #0 #9) (slist "Days" "start station name" "bikes" "Month" "DayOfWeek" "Humidity Fraction" "Rain (mm)" "Temperature (C)" "WC1" "Dew Point (C)")}
06-22 13:00:06.725 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/pybcf91608-f135-4535-afec-bd4d9498d7a3, route: /3/DKV/(?.), parms: {key=pybcf91608-f135-4535-afec-bd4d9498d7a3}
06-22 13:00:06.732 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/py2a61baec-c528-4c33-b0b3-74b543d3fdb1, route: /3/DKV/(?.), parms: {key=py2a61baec-c528-4c33-b0b3-74b543d3fdb1}
06-22 13:00:06.736 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/py2a61baec-c528-4c33-b0b3-74b543d3fdb1, route: /3/DKV/(?.), parms: {key=py2a61baec-c528-4c33-b0b3-74b543d3fdb1}
06-22 13:00:06.740 172.17.2.195:56789 5543 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput py9e75d344-c07b-419e-bcd7-fe730215090b (cbind %FALSE '$04ff01000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff02000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff03000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff04000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff05000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff06000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff07000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff08000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff09000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff0a000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff0b000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff0c000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff0d000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff0e000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' '$04ff0f000000ffffffff$nfs://home4/jenkins/slave_dir_from_mr-0xb1/workspace/h2o_master_DEV_pyunit_medium_large/bigdata/laptop/citibike-nyc/2013-07.csv' 'py1a6dabc4-ceca-4a96-82cf-905a9461f416')) (colnames= %py9e75d344-c07b-419e-bcd7-fe730215090b (: #0 #15) (slist "tripduration" "starttime" "stoptime" "start station id" "start station name" "start station latitude" "start station longitude" "end station id" "end station name" "end station latitude" "end station longitude" "bikeid" "usertype" "birth year" "gender" "Days")}
06-22 13:00:07.162 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/py9e75d344-c07b-419e-bcd7-fe730215090b, route: /3/DKV/(?.), parms: {key=py9e75d344-c07b-419e-bcd7-fe730215090b}
06-22 13:00:07.174 172.17.2.195:56789 5543 # Session INFO: Method: POST , URI: /99/Rapids, route: /99/Rapids, parms: {ast=(, (gput py1fbeb9a8-1372-4235-9fe5-0a13ce0fcabc (cbind %FALSE '$04ff07000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff08000000ffffffff346a723c2d2200996e48ab5620beeb$=' '$04ff09000000ffffffff346a723c2d2200996e48ab5620beeb$=' 'py2e7f5bc9-db57-424e-9639-979a8c45d417' 'py0fcb2585-1d18-43d3-9201-d12cdd114d45')) (colnames= %py1fbeb9a8-1372-4235-9fe5-0a13ce0fcabc (: #0 #4) (slist "Days" "start station name" "bikes" "Month" "DayOfWeek")}
06-22 13:00:07.177 172.17.2.195:56789 5543 # Session ERRR: java.lang.AssertionError
java.lang.AssertionError
at water.fvec.Frame.(Frame.java:102)
at water.fvec.Frame.(Frame.java:72)
at water.rapids.ASTCbind.apply(ASTOp.java:2301)
at water.rapids.AST.treeWalk(AST.java:49)
at water.rapids.AST.treeWalk(AST.java:48)
at water.rapids.ASTStatement.exec(AST.java:474)
at water.rapids.AST.treeWalk(AST.java:112)
at water.rapids.Exec.exec(Exec.java:68)
at water.api.RapidsHandler.exec(RapidsHandler.java:37)
at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at water.api.Handler.handle(Handler.java:56)
at water.api.RequestServer.handle(RequestServer.java:677)
at water.api.RequestServer.serve(RequestServer.java:614)
at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438)
at java.lang.Thread.run(Thread.java:745)
06-22 13:00:07.178 172.17.2.195:56789 5543 # Session WARN: Caught exception: java.lang.AssertionError; Stacktrace: [water.api.RapidsHandler.exec(RapidsHandler.java:132), sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source), sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43), java.lang.reflect.Method.invoke(Method.java:606), water.api.Handler.handle(Handler.java:56), water.api.RequestServer.handle(RequestServer.java:677), water.api.RequestServer.serve(RequestServer.java:614), water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:438), java.lang.Thread.run(Thread.java:745)]
06-22 13:00:07.181 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/py16f356a2-c5a9-4e15-a894-aff1b9420e27, route: /3/DKV/(?.), parms: {key=py16f356a2-c5a9-4e15-a894-aff1b9420e27}
06-22 13:00:07.185 172.17.2.195:56789 5543 # Session INFO: Method: DELETE, URI: /3/DKV/DeepLearningModel__b5f5b8cf0b6b57af2a92c37899cc402f, route: /3/DKV/(?.), parms: {key=DeepLearningModel__b5f5b8cf0b6b57af2a92c37899cc402f}
06-22 13:00:08.260 172.17.2.195:56789 5543 # Session INFO: ------------------------------------------------------------
06-22 13:00:08.263 172.17.2.195:56789 5543 # Session INFO:
06-22 13:00:08.302 172.17.2.195:56789 5543 # Session INFO: STARTING TEST: pyunit_vec_scaler_comparisions_medium.py
06-22 13:00:08.305 172.17.2.195:56789 5543 # Session INFO:
06-22 13:00:08.308 172.17.2.195:56789 5543 # Session INFO: ------------------------------------------------------------

[exalate-issue-sync]

Neeraja Madabhushi commented: pyunit_citibike_mediuim_large shows error below in log results, and test doesn't shows as passed instead of failed.

http://172.16.2.161:8080/job/h2o_master_DEV_pyunit_medium_large/6097/artifact/h2o-py/tests/results/testdir_demos_notebooks_pyunit_citi_bike_large.py.out.txt

deeplearning Model Build Progress: [##################################################] 100%Exception EnvironmentError: EnvironmentError('h2o-py got an unexpected HTTP status code:\n 412 Precondition Failed (method = POST; url = http://127.0.0.1:56789/99/Rapids). \ndetailed error messages: java.lang.AssertionError',) in <bound method H2OFrame.del of <h2o.frame.H2OFrame instance at 0x3c5bc20>> ignored
Exception EnvironmentError: EnvironmentError('h2o-py got an unexpected HTTP status code:\n 412 Precondition Failed (method = POST; url = http://127.0.0.1:56789/99/Rapids). \ndetailed error messages: java.lang.AssertionError',) in <bound method H2OFrame.del of <h2o.frame.H2OFrame instance at 0x3c63ea8>> ignored

Model R2 TRAIN R2 TEST R2 HOLDOUT Model Training Time (s)

---

GBM 0.967338 0.92733 0.924671 120.318
DRF 0.895052 0.847572 0.843452 1517.89
GLM 0.88587 0.868932 0.863385 0.676
DL 0.929237 0.91455 0.911581 38.749
Leaked Keys!

[exalate-issue-sync]

Spencer Aiello commented: haven't seen citi bike fail for a few days -- claiming resolved

[DinukaH2O]

JIRA Issue Migration Info

Jira Issue: PUBDEV-1413
Assignee: Spencer Butt
Reporter: Kevin Normoyle
State: Resolved
Fix Version: N/A
Attachments: N/A
Development PRs: N/A