Flux is a refreshing approach to machine learning. It provides lightweight abstractions on top of Julia's native GPU and AD support, while remaining fully hackable (right down to the GPU kernels).
See the documentation or the model zoo for examples.
julia> Pkg.add("Flux")