Transform Pub/Sub to Firestore Database in GCP

Rusty Divine Apache, Articles, Cloud, Data Science, Databases, Google Cloud Platform, Python Leave a Comment

This year, the client I work with has started exploring the offerings in Google Cloud Platform (GCP) after investing years into the Microsoft Azure cloud. The opportunity has allowed me to explore a few new technologies that this post will cover and that you will hopefully find interesting.

In short, I was tasked with transforming Pub/Sub to Firestore Database in GCP. The scenario explored in this post takes an FHIR healthcare data feed, extracts telephone and email information, and then stores that in a Firestore database.

SQL Server Agent Jobs with Spring Batch

Monitoring SQL Server Agent Jobs with Spring Batch

Josh Green Articles, Development Technologies & Tools, Java, Modernization, Spring Batch, SQL, SQL Server Leave a Comment

In this blog post, I will demonstrate a technique to query the status of a SQL Server Agent job that executes the SSIS package. SQL Server Agent scripts are asynchronous in nature. This can make it difficult to make code decisions based on the execution status of a script of this type.

Data Science

Predicting River Flow with a Supervised Learning Time Series Model

Alex Lagge Articles, Data Science, Machine Learning 1 Comment

In this blog, we will build a flow rate prediction algorithm for the Norfork River in Arkansas. Both farmers and recreationists are heavily dependent on the flow rate of the river. As the river flows faster, the risk of flooding increases and flooding can destroy crops for farmers and ruin vacations for tourists.

My goal with this flow rate prediction algorithm was to give a better idea of what the next 4 days of river flow will look like. Below, I will discuss the data science process that I underwent to make these predictions.

[Video] Data Mining/Science: Supervised Time-Series Model

Keyhole Software Development Technologies & Tools, Educational Event, PostgreSQL, Python, Videos 1 Comment

In this video, Alex presents an introduction to data science “big ideas” relevant to the model, an explanation of its data modeling process, and a demonstration of the real-life machine learning solution implemented with Python, Postgres SQL, and H2O (an open-source machine learning algorithm). Multiple data sources and technologies were combined to create an accurate model that allows farmers and recreationists to make actionable insights about the future. A few questions and answers round out the discussion.

Getting Started with Azure Data Studio

Todd Horn Articles, Azure, Cloud, Databases, Development Technologies & Tools, DevOps, Project Management Leave a Comment

On my last two projects, I decided to give Azure Data Studio a try to see how it measured up to SSMS. Azure Data Studio gives you a more modern editor experience. Itโ€™s comparable to Visual Studio Code with IntelliSense, source control with GIT, and an integrated terminal for Powershell or SQLMD commands.

Azure Data Studio was built with a data platform user in mind, and its easy editing and export options, built-in charting of query results, and customizable dashboards make it an incredibly valuable tool.

In this post, Iโ€™ll go over some of the basics of how to use Azure Data Studio.