Issue Report

David McGinnis

Jan 19, 20224 min read

Debugging from the Field: Sudden CI Test Failures

This is one of a series of posts revolving around debugging stories from the field. The goal of this series is to help demonstrate how to...

David McGinnis

Mar 3, 20205 min read

Debugging From The Field: When Parallelization Goes Wrong

Blog post chronicling the investigation of a series of errors in a Spark Streaming job reading from Spark.

David McGinnis

Feb 25, 20207 min read

Debugging From The Field: The Case of the Empty Files

A team at a client was using Spark to read and write to a Kafka topic. [...] files that would be written that were completely empty.

David McGinnis

Dec 3, 20195 min read

Debugging From The Field: The Case of the Ignored Configuration Change

We made the change on a Sunday, but four days later, the number of files had not appreciably changed in the YARN logs directory.

David McGinnis

Nov 12, 20194 min read

Debugging from the Field: Smartsense Activity Explorer Stops Working

This client didn't use the activity explorer much [...] I tried to run one of the paragraphs and immediately [failed].

David McGinnis

Sep 15, 20194 min read

Debugging from the Field: Sudden En Masse Failures in 100s of Spark Streaming Jobs

As this case shows, it is very important to understand where to look and how to filter out noise from the signal you care about.

David McGinnis

Sep 8, 20194 min read

Debugging From the Field: Sudden Kerberos Failure in HiveServer2 Instance

A client has a medium sized kerberized HDP 2.6.0 installation. Hive Interactive is disabled and Hive is set up to use HTTP transport mode.