Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#25 / DE-7685: Fix Dockerfile base image source #26

Merged
merged 1 commit into from
Sep 24, 2024
Merged

#25 / DE-7685: Fix Dockerfile base image source #26

merged 1 commit into from
Sep 24, 2024

Conversation

rmoff
Copy link
Contributor

@rmoff rmoff commented Sep 24, 2024

Fixed Docker image source.

Tested:

# Confirm no local images
❯ docker images --all
REPOSITORY   TAG       IMAGE ID   CREATED   SIZE

# Bring up stack
❯ docker compose up -d
[…]
❯ docker compose ps
NAME                         IMAGE                               COMMAND                  SERVICE          CREATED          STATUS         PORTS
apache-flink-taskmanager-1   apache-flink-taskmanager            "/docker-entrypoint.…"   taskmanager      10 seconds ago   Up 9 seconds   6123/tcp, 8081/tcp
apache-flink-taskmanager-2   apache-flink-taskmanager            "/docker-entrypoint.…"   taskmanager      10 seconds ago   Up 9 seconds   6123/tcp, 8081/tcp
broker                       confluentinc/cp-kafka:7.5.1         "/etc/confluent/dock…"   kafka            10 seconds ago   Up 9 seconds   0.0.0.0:9092->9092/tcp, :::9092->9092/tcp
duckdb                       davidgasquez/duckdb                 "tail -f /dev/null"      duckdb           10 seconds ago   Up 9 seconds
hms                          apache-flink-hive-metastore         "./run.sh"               hive-metastore   10 seconds ago   Up 9 seconds   0.0.0.0:9083->9083/tcp, :::9083->9083/tcp
jobmanager                   apache-flink-jobmanager             "/docker-entrypoint.…"   jobmanager       10 seconds ago   Up 9 seconds   6123/tcp, 0.0.0.0:8081->8081/tcp, :::8081->8081/tcp
kcat                         edenhill/kcat:1.7.1                 "tail -f /dev/null"      kcat             10 seconds ago   Up 9 seconds
mc                           minio/mc                            "/bin/sh -c ' until …"   mc               10 seconds ago   Up 9 seconds
minio                        minio/minio                         "/usr/bin/docker-ent…"   minio            10 seconds ago   Up 9 seconds   0.0.0.0:9000-9001->9000-9001/tcp, :::9000-9001->9000-9001/tcp
pyiceberg                    python:3.12-bookworm                "/bin/sh -c ' pip in…"   pyiceberg        10 seconds ago   Up 9 seconds
shadowtraffic                shadowtraffic/shadowtraffic:0.6.0   "java -jar /home/sha…"   shadowtraffic    10 seconds ago   Up 9 seconds
zookeeper                    confluentinc/cp-zookeeper:7.5.1     "/etc/confluent/dock…"   zookeeper        10 seconds ago   Up 9 seconds   2181/tcp, 2888/tcp, 3888/tcp

Ran through https://github.com/decodableco/examples/blob/main/kafka-iceberg/apache-flink/ksl-demo.adoc successfully

CleanShot 2024-09-24 at 10 05 10

⚫◗ SELECT count(*), strftime(to_timestamp(max(create_ts)/1000),'%Y-%m-%d %H:%M:%S') as max_ts,
     avg(cost), min(cost)
     FROM iceberg_scan('s3://warehouse/default_database.db/t_i_orders/metadata/00001-6f1fb481-4d2e-4547-b930-b679899d32be.metadata.json');
┌──────────────┬─────────────────────┬────────────────────┬─────────────┐
│ count_star() │       max_ts        │    avg("cost")     │ min("cost") │
│    int64     │       varchar       │       double       │    float    │
├──────────────┼─────────────────────┼────────────────────┼─────────────┤
│           672024-09-24 09:05:12113.40406514637506100.41236 │
└──────────────┴─────────────────────┴────────────────────┴─────────────┘

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant