Are you preparing for the Microsoft Azure Data Engineering (DP-203) exam, or seeking a better understanding of how to design and develop data processing? This course, the fourth in a series, can help you. Noah Gift, founder of Pragmatic A.I. Labs and a Python Software Foundation Fellow, covers how to monitor and optimize data storage and data processing. Noah first covers how to monitor data storage and data processing, showing how to: implement logging used by Azure Monitor; configure monitoring services; measure query performance; and more. He then details topics pertaining to optimizing and troubleshooting data storage and processing, including how to: rewrite user-defined functions; tune queries by using indexers and cache; handle skew in data and data spill; troubleshoot a failed Spark job and pipeline run.
Learn More
