Portfolio

Blog

Foodie Friday: Quick Trip to Vancouver

by dennyglee Categories: Foodie FridayTags: · · · · 1 Comment

A quick three day trip to Vancouver (British Columbia, Canada) is the theme of my next Foodie Friday post (this time only a day late!). For those that want to skip the pictures and albeit short descriptions – it’s about ramen, baked goods, and donuts. Kintaro Ramen This is the amazingly rich and flavourful spicy garlic ramen at Kintaro Ramen in downtown Vancouver on Denman St. My personal favorite is the rich broth and fatty pork – the ball of garlic hits your taste buds and lightly burns your nostrils – so you know the garlic working! A Bread Affair…

Rate this:

Why does altering a Delta Lake table schema not show up in the Spark DataFrame?

by dennyglee Categories: Delta Lake · SparkTags: · Leave a comment

Recently there was a great Delta Lake Stackoverflow question DeltaTable schema not updating when using `ALTER TABLE ADD COLUMNS` by wtfzambo. This is a great question as succinctly: What is happening here is actually as expected: To better showcase this, allow me to provide context via the file system. To recreate this exact scenario, please use the docker at https://go.delta.io/docker and use the DELTA_PACKAGE_VERSION as delta-core_2.12:2.1.0. That is, run the Docker container and use the pts-ark steps: 1. To start PySpark, run the command: 2. Run the basic commands to create a simple table 3. Run the following command to see the table structure As…

Rate this:

Foodie Friday: A very quick trip to Portland

by dennyglee Categories: Foodie FridayTags: · · Leave a comment

I do not get to travel to Portland, Oregon as often as I like but a few weeks ago, I was fortunate to have a great meeting with my friend Scott Haines – a Databricks Beacon, an awesome engineer at Nike, an amazing person in general! Even though his meetings were in Beaverton, I was able to convince him to come over one of my favorite districts in Portland – the Northwest District. In addition to be enjoying the general vibe of the district, it holds one of my favorite French bakeries – St. Honoré Bakery (the following is picture…

Rate this:

You gotta shift it (to higher gear), to get the biscuit

by dennyglee Categories: Foodie FridayTags: · · Leave a comment

With PyData Seattle 2023 coming up so soon, my Friday Foodie installment for (only three days late) for April 2023 is where in Seattle can you get amazing biscuits? Well, as the three followers of my Strava know, one of my motivations to go for longer rides is food. An example is this ride involving Lake Washington North and stopping off for one of Seattle best biscuit companies – Seattle Biscuit Company. These biscuits are big, carry some actual weight, and of course delicious. The picture below is one of my to-go favorites – a modified version of the Hickey…

Rate this:

Deep Learning Fundamentals Series

by dennyglee Categories: Deep LearningTags: · · · · Leave a comment

This webinar series covers deep learning fundamentals with a focus on Keras and TensorFlow. Deep Learning has shown tremendous success, but what makes it so special? What are neural networks, and how do they work? What are the differences between popular Deep Learning frameworks like Keras or TensorFlow, and where should you start? Webinar | Presentation | Notebook | Q&A Webinar | Presentation | Notebook | Q&A Webinar | Presentation | Notebook | Q&A

Rate this:

Relaxing in Encinitas

by dennyglee Categories: Foodie Friday · Travel TuesdayTags: · · · · · 1 Comment

Just north of San Diego, there is the wonderful town of Encinitas.  It is a nice relaxing surfer (or beach bum) town with excellent dining in the heart of the town itself. Juanitas Taco Shop A great little taco shop right off of North Coast Highway 101 that is not your normal tourist cafe – which is perfect!  While normally a corn tortilla fan, they have the best wheat tortillas.  This is a picture of the to-go carnitas plate where the beans are creamy, the rice is delicious yet light, the meat is flavorful, and the avocado and salsa were…

Rate this:

Introduction to Apache Spark 2.0

by dennyglee Categories: BigData · SparkTags: · · · · · Leave a comment

A Primer on Spark 2.0 Fundamentals and Architecture I’m proud to post that my O’Reilly video series Introduction to Apache Spark 2.0: A Primer on Spark 2.0 Fundamentals and Architecture is now available on O’Reilly Safari (Start your ten-day free trial) or you can purchase the video series directly. This video series highlights what’s new in Apache 2.0 and reviews its core concepts. The course starts with a high-level overview of Spark’s components and then dives into Spark 2.0’s three main themes: simplicity, speed, and intelligence. The simplicity section describes how Spark 2.0 unifies the Spark APIs and Spark session,…

Rate this:

Jump Start into Python and Apache Spark with Learning PySpark

by dennyglee Categories: SparkTags: · · · · · · 2 Comments

For the last few years, I have had the opportunity to work on some of the coolest Apache Spark committers, contributors, and projects.  As luck would have it, I got the opportunity to meet my co-author Tomasz Drabas (author of the awesome Practical Data Analysis Cookbook) while we were solving some other cool Apache Spark projects.  In the process, we joined forces to share our lessons learned that will hopefully help you jump start your Python and Apache Spark projects with our book: Learning PySpark. And just to make sure, this book was reviewed by the incomparable Holden Karau, author of the…

Rate this: