Spark SQL magic command for Jupyter notebooks

💻 Padrões de Projeto em Python

Repo for Introduction to Iceberg Video

Coleta de dados de Segurança Pública do Estado de São Paulo (Disponíveis em basedosdados.org e Secretaria de Segurança Pública dos Estado de São Paulo)

⚙️ Código de manutenção do datalake (metadados e pacotes de acesso) | 📖 Docs: https://basedosdados.github.io/mais/

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

💰 Configurable Cryptocurrency Price & Volume Scanner for Binance

This application connects to the Binance.com public API to get live 24h price change data for all crypto trading pairs on their platform and allows you to set custom alerts or watch for price chang…

Details on how to get Binance public data

Football scouts from Cartola FC at a data lake with data warehouse and dashboard

Docker image for Jupyter notebooks with PySpark

Repository used for Spark Trainings

[EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook and HDFS FileBrowser.

Fuzzy String Matching in Python

Use Airflow to move data from multiple MySQL databases to BigQuery

Bigquery ETL

Simple Python client for interacting with Google BigQuery.