啥是DataOps?
怎么一步步搭建DataOps框架
- Project workspace (JIRA, Teams Channel, Confluence, Repository, Roles, Environments)
- Developer workspace (Local develop environment, debug tools,commit convention, code scan,vulnerability check,pr review,compliance check,deploy,test,document(versioning,badging))
- Engineering workspace (data landing, data pipeline, data models, data apis, data monitor)
- Batch / Streaming
为什么要搞DataOps?
- For leaders: Data governance - standardisation, federation, meshing
- For developers & engineers: collaboration, automation, maintenance
caveats:
- Team working culture
- Leader's aspiration
- Have someone to sell up
- Rome isn't build in one day, be patient
- Getting early feedback is the key, form your alpha group of people and start a pilot project, test and iterate.
- Agile - stakeholder (Product Owner, Project Manager, SME) continuous engagement.
- DevOps practise