noctua 1.5.0

Updated package version for cran release

noctua 1.4.0.9001

New Feature

library(noctua)

noctua_options("vroom")

Unit tests

noctua 1.4.0.9000

Documentation

noctua 1.4.0

Updated package version for cran release

noctua 1.3.0.9003

Major Change

warning('Appended `file.type` is not compatible with the existing Athena DDL file type and has been converted to "', File.Type,'".', call. = FALSE)

Bug fix

Unit Tests

noctua 1.3.0.9002

New Feature

Unit Tests

noctua 1.3.0.9001

Minor Change

noctua 1.3.0.9000

Minor Change

Bug fixed

Unit Tests

noctua 1.3.0

Updated package version for cran release

noctua 1.2.1.9004

Major Change

Performance results

library(DBI)
X <- 1e8
df <- data.frame(w =runif(X),
                 x = 1:X,
                 y = sample(letters, X, replace = T), 
                 z = sample(c(TRUE, FALSE), X, replace = T))
con <- dbConnect(noctua::athena())
# upload dataframe with different splits
dbWriteTable(con, "test_split1", df, compress = T, max.batch = nrow(df), overwrite = T) # no splits
dbWriteTable(con, "test_split2", df, compress = T, max.batch = 0.05 * nrow(df), overwrite = T) # 20 splits
dbWriteTable(con, "test_split3", df, compress = T, max.batch = 0.1 * nrow(df), overwrite = T) # 10 splits

AWS Athena performance results from AWS console (query executed: select count(*) from .... ):

library(DBI)
X <- 1e8
df <- data.frame(w =runif(X),
                 x = 1:X,
                 y = sample(letters, X, replace = T), 
                 z = sample(c(TRUE, FALSE), X, replace = T))
con <- dbConnect(noctua::athena())
dbWriteTable(con, "test_split1", df, compress = T, overwrite = T) # default will now split compressed file into 20 equal size files.

Added information message to inform user about what files have been added to S3 location if user is overwriting an Athena table.

Minor Change

noctua 1.2.1.9003

Bug Fixed

noctua 1.2.1.9002

Bug Fixed

Unit tests

noctua 1.2.1.9001

Bug Fixed

When returning a single column data.frame from Athena, noctua would translate output into a vector with current the method dbFetch n = 0.

noctua 1.2.1.9000

Bug Fixed

Thanks to @OssiLehtinen for identifying issue around sql_translate_env. Previously noctua would take the default dplyr::sql_translate_env, now noctua has a custom method that uses Data types from: https://docs.aws.amazon.com/athena/latest/ug/data-types.html and window functions from: https://docs.aws.amazon.com/athena/latest/ug/functions-operators-reference-section.html

Unit tests

noctua 1.2.1

New Features:

Bug fixed

noctua 1.2.0

Updated package version for cran release

noctua 1.1.0.9001

Minor Change

Backend Change

library(DBI)

con <- dbConnect(noctua::athena())

dbWriteTable(con, "iris", iris)

Bug Fix

Unit Tests

noctua 1.1.0.9000

New Feature

Minor Change

noctua 1.1.0

noctua 1.0.9000

New Features

Bug

Unit Tests

Minor Change

Major Change

noctua 1.0.0

New Features

DBI

Athena lower level api