Program received and didn't handle signal TRAP
If you happen to receive this error message:
Program received and didn't handle signal TRAP (5)
make sure you haven’t forgotten a debugger statement somewhere.
hive create table from parquet file
Example of creating a hive table from a parquet file:
create external table mytable (name string,id int) STORED AS PARQUET LOCATION '/user/me/file.parquet'
brew llvm 3.9.0 installation error
Tried to upgrade to llvm 3.9.0, got this error:
[ 40%] Building C object lib/builtins/CMakeFiles/clang_rt.cc_kext_x86_64h_osx.dir/emutls.c.o [ 40%] Building C object lib/builtins/CMakeFiles/clang_rt.cc_kext_x86_64h_osx.dir/gcc_personality_v0.c.o [ 40%] Building C object lib/builtins/CMakeFiles/clang_rt.cc_kext_x86_64h_osx.dir/__/profile/InstrProfiling.c.o [ 40%] Building C object lib/builtins/CMakeFiles/clang_rt.cc_kext_x86_64h_osx.dir/__/profile/InstrProfilingBuffer.c.o [ 40%] Building C object lib/builtins/CMakeFiles/clang_rt.cc_kext_x86_64h_osx.dir/__/profile/InstrProfilingPlatformDarwin.c.o [ 40%] Linking C static library libclang_rt.cc_kext_x86_64_osx.a [ 40%] Built target clang_rt.cc_kext_i386_osx [ 40%] Building C object lib/builtins/CMakeFiles/clang_rt.cc_kext_x86_64h_osx.dir/__/profile/InstrProfilingWriter.c.o [ 42%] Linking C static library libclang_rt.cc_kext_x86_64h_osx.a [ 42%] Built target clang_rt.cc_kext_x86_64_osx [ 42%] Built target clang_rt.cc_kext_x86_64h_osx make[3]: *** [all] Error 2 make[2]: *** [tools/clang/runtime/compiler-rt-stamps/compiler-rt-build] Error 2 make[1]: *** [tools/clang/runtime/CMakeFiles/compiler-rt.dir/all] Error 2 make: *** [all] Error 2
Fix was to install it like this:
brew install -s llvm --without-compiler-rt
python shutil.copyfileobj
Use shutil.copyfileobj instead of having some obj.read(). It will be much better in terms of memory consumption.