Data Governance Agents

[morebento]

A series of agents which support data governance (classification, data quality, data lineage, disposal, etc).

For example -

• A classification agent which accepts some data in Excel or SQL query from a database and classifies it according to the enterprise taxonomy. The enterprise taxonomy would be sourced from JSON
• A data quality agent which assesses data for data quality (missing values, range errors, spelling errors), proposes resolutions and creates code to fix
• An Orchestrator agent to string together agents to deliver an overall solution.

[morebento]

Not sure if this is entirely in line with what you're thinking for data science, but as I work in data governance a lot now I thought I'd add it in - the boring stuff is about 80% of data governance and Gen AI will be very useful in automating it

[mdancho84]

Excellent ideas. Would love to get more information on how you see this being implemented specifically on data sets that suffer from issue and data process that require enhanced governance

[morebento]

Excellent ideas. Would love to get more information on how you see this being implemented specifically on data sets that suffer from issue and data process that require enhanced governance

Thanks Matt, I'll put some more thought into it and write out some points over the next few days.