Why Should Data Professionals Automate?

Automate_thumb.jpgTake a minute and look around you. Automation is all around you; whether you see it or not processes are automated on all levels of life.

One thing that I’ve noticed among professionals is that “change” is very difficult; while others do not know what to automate.

Time and Value

In today’s day and age time is an important factor for many. It is the vehicle for efficiency. If you are responsible for a process and it fails; would you want to know before someone else tells you? I would hope the answer is yes. Sure there are caveats to processes all around, but the majority of the time automation of daily processes is a key component to being a successful data professional.

What Should I Automate?

This is not a comprehensive list, but more or less some ideas to get one to think. You can add to your list; it should be considered a living list or document (there is that nasty word “document”; yes I am a firm believer in documentation being important, but will save that for a later post).

Some potential items to review for automating:

  1. Monitoring concepts
  2. Maintenance procedures
  3. Disaster Recovery
  4. Notifications
  5. Deployments
  6. Ticket generation
  7. ETL processing
  8. Creation of dashboards

The list can continue to grow, but under each point can be several other bullet points to specific items.


Every person, shop, and entity have their own views on automation. Understanding how best to utilize ones time can dictate what is automated versus what is not. Doing a gap analysis also provides some light into what may or may not be working efficiently.

For me doing nothing and continuing manual processes is not the way to survive.

I recently ran into a situation where business units were working as hard as they could not knowing that some of the processes could be streamlined which would free them up to do the work on projects that they needed to get done but couldn’t. These types of situations are everywhere; look at your own shop; what can you improve?

As my good friend John Morehouse (B|T) says, “Don’t just sweep items under the rug.” If you see an issue or a process that could be fixed take that initiative and start righting the ship. If your recommendation is not one that is approved that’s okay just keep being that voice; it takes one to make a difference.

The Challenge

Take a look around you, what can you automate to help streamline or become more efficient? What obstacle(s) are you facing that has a solution ready to be had, but no one has taken the initiative yet?

1 thought on “Why Should Data Professionals Automate?

  1. George

    From a production perspective, if it;s a regular task and you can’t automate it you should be questioning whether you should be doing it.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s